-- Logs begin at Tue 2022-08-09 10:40:08 UTC, end at Tue 2022-08-09 11:57:40 UTC. -- Aug 09 11:11:22.841898 dv-cinder-849890-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 09 11:11:22.854313 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 09 11:11:22.859353 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 11:11:22 2022] *** Aug 09 11:11:22.859353 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 11:11:22.859353 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 11:11:22.859353 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: nodename: dv-cinder-849890-5-iscsi Aug 09 11:11:22.859353 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: machine: x86_64 Aug 09 11:11:22.859353 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: clock source: unix Aug 09 11:11:22.859353 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: pcre jit disabled Aug 09 11:11:22.859353 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: detected number of CPU cores: 4 Aug 09 11:11:22.859353 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: current working directory: / Aug 09 11:11:22.859353 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: detected binary path: /usr/bin/uwsgi-core Aug 09 11:11:22.859353 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: your processes number limit is 47680 Aug 09 11:11:22.859353 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: your memory page size is 4096 bytes Aug 09 11:11:22.859353 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: detected max file descriptor number: 2048 Aug 09 11:11:22.859353 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: lock engine: pthread robust mutexes Aug 09 11:11:22.860286 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: thunder lock: enabled Aug 09 11:11:22.860286 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 09 11:11:22.860286 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 11:11:22.901661 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: Python main interpreter initialized at 0x564341d669c0 Aug 09 11:11:22.901661 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: python threads support enabled Aug 09 11:11:22.901661 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: your server socket listen backlog is limited to 100 connections Aug 09 11:11:22.901661 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: your mercy for graceful operations on workers is 90 seconds Aug 09 11:11:22.902200 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 11:11:22.902200 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: *** Operational MODE: preforking *** Aug 09 11:11:22.902403 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: *** uWSGI is running in multiple interpreter mode *** Aug 09 11:11:22.902403 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: spawned uWSGI master process (pid: 80041) Aug 09 11:11:22.902667 dv-cinder-849890-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 09 11:11:22.903760 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: spawned uWSGI worker 1 (pid: 80054, cores: 1) Aug 09 11:11:22.903760 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: spawned uWSGI worker 2 (pid: 80055, cores: 1) Aug 09 11:11:22.903760 dv-cinder-849890-5-iscsi devstack@keystone.service[80041]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 11:11:28.458705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:11:28.458705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: from cryptography.utils import int_from_bytes Aug 09 11:11:28.459856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:11:28.459856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: from cryptography.utils import int_from_bytes Aug 09 11:11:28.511683 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 11:11:28.511930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 11:11:28.512086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] command line args: [] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 11:11:28.512295 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 11:11:28.512451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ================================================================================ {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 11:11:28.512795 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] admin_token = **** {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.513102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] config_dir = [] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.513324 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.513528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] config_source = [] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.513735 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] debug = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.513954 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.514382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.514543 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.516151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.516151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.516151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] list_limit = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.516151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] log_config_append = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.516151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.516151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] log_dir = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.517183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] log_file = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.517183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.517183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.517183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.517771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.517771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.517771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.518202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.518335 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.518602 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.518930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.519197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.519485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.519791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.520083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.520471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.521061 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.521279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] publish_errors = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.521531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.521820 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.522023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.522332 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.522611 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.522927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] standard_threads = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.523216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.523514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.523715 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.523920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] use_journal = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.524122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] use_json = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.524323 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] use_stderr = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.524523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] use_syslog = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.524810 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.525121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.525413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.525768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.526074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.526414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.526719 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.527105 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.527451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.527887 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.528247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.528509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.528733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.528983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.529217 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.529464 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.529712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.529948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.530220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.530454 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.530698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.530972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.531229 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.531495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.531749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.531996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.532229 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.532466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.532686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.532998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.533256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.533504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.533735 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.533963 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.534206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.534453 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.534691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.534960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.535194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.535431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.535668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.535898 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.536128 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.536355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.536586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.536821 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.537069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.537299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.537544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.537772 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.538006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.538243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.538490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.538719 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.538981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.539218 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.539453 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.539688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.539923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.540151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.540399 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.540637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.540871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.541102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.541362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.541596 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.541825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.542059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.542292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.542563 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.542802 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.543071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.543320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.543553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.543785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.544018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.544263 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.544495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.544728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.544969 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.545203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.545437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.545670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.545906 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.546133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.546371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.546621 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.546880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.547120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.547355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.547596 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.547825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.548059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.548289 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.548566 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.548794 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.549029 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.549258 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.549495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.549727 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.549975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.550207 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.550462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.550720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.550994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.551229 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] auth.external = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.551459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.551752 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.551980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.552211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] auth.password = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.552438 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] auth.token = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.552672 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.552905 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.553149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.553377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.553622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.553867 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.554098 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.554333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] credential.caching = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.554575 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.554868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.555095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.555331 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.555571 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.555807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.556073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.556325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.556560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.556810 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.557094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.557340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.557607 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.557847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.558094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.558320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] federation.caching = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.558554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.558796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.559068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.559296 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.559541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.559782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.560033 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.560272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.560522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.560758 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.561001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.561234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity.caching = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.561479 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.561722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.561955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.562189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.562436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.562665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.562923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.563169 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.563421 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.563648 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.563877 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.564174 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.564418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.564662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.564905 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.565157 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.565401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.565670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.565910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.566133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.566364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.566597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.566972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.567172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.567294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.567539 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.567788 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.568023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.568265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.568510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.568746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.568990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.569238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.569470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.569704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.569931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.570175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.570440 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.570650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.570910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.571147 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.571394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.571642 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.571871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.572100 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.572346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.572593 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.572825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.573056 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.573288 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.573515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.573746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.574003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.574234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.574478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.574724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.574991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.575228 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.575458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.575689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.575919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.576154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.576381 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.576625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.576866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.577109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.577353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.577600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.577829 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.578071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.578307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.578540 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.578771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.579028 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.579269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.579515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.579796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.580047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.580279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.580523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.580805 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.580989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.581225 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.581472 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.581713 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.581942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.582178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.582417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] resource.caching = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.582664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.583009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.583247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.583494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.583740 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.583971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.584214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.584448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.584577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:11:28.584577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: from cryptography.utils import int_from_bytes Aug 09 11:11:28.585348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.585471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:11:28.585471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: from cryptography.utils import int_from_bytes Aug 09 11:11:28.585676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] role.caching = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.585676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] role.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.585676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.585676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.586140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.586140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.586363 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.586496 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.586743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.587012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.587262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.587500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.587743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.587988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.588231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.588476 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.588914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.589149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.589395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.589646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.590044 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.590293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.590538 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.590793 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.591069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.591310 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.591541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.591772 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.592027 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.592256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.592493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.592737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.592976 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.593209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.593441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.593673 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] token.caching = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.593907 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.594154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.594387 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.594648 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.594917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.595162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.595479 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.595722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.595967 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.596202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.596441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.596674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.596917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.597167 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.597395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.597641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.597931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.598196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.connection = **** {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.598436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.598683 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.598942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.599178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.599414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.599643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.599879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.600111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.600351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.600585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.600825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.601057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.601303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.601541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.601783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.602010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.602248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.602478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.602649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 11:11:28.633183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.633434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.633611 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.634551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 11:11:28.634770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 11:11:28.634989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] command line args: [] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 11:11:28.635270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 11:11:28.635446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ================================================================================ {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 11:11:28.635706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] admin_token = **** {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.635949 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] config_dir = [] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.636138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.636321 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] config_source = [] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.636499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] debug = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.636720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.636961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.637142 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.637396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.637646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.637875 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] list_limit = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.638071 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] log_config_append = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.638199 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.638380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] log_dir = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.638558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] log_file = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.638795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.639068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.639318 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.639565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.639744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.639920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.640165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.640412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.640639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.640876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.641104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.641338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.641585 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.641831 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.642113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.642681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.642958 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] publish_errors = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.643195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.643426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.643604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.643852 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.643979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.644097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.644309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] standard_threads = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.644539 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.644781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.644958 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.645141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] use_journal = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.645538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] use_json = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.645538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] use_stderr = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.645835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] use_syslog = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.645955 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:11:28.646197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.646380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.646638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.647030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.647329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.647530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.647780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.648036 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.648327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.648639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.648835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.649025 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.649310 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.649545 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.649735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.649987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.650224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.650503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.650847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.651144 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.651387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.651613 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.651905 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.652152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.652413 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.652643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.652892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.653191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.653432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.653758 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.653944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.654180 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.654412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.654661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.655003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.655286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.655541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.655798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.656039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.656295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.656589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.656899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.657081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.657301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.657551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.657927 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.658165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.658402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.658637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.658899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.659139 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.659389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.659623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.659859 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.660098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.660390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.660570 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.660807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.661037 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.661288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.661525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.661773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.662004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.662269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.662488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.662726 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.662989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.663229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.663503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.663756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.664004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.664258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.664496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.664734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.664968 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.665225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.665462 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.665779 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.665987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.666205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.666525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.666765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.667048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.667286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.667552 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.667796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.668038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.668274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.668516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.668751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.668987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.669224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.669453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.669685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.669917 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.670152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.670385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.670627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.670888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.671140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.671379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.671638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.671897 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.672140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.672371 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] auth.external = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.672584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.672732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.672869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.673007 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.673143 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.673322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] auth.password = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.673662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] auth.token = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.673898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.674091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.674334 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.674564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.674850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.675156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.675388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.675627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] credential.caching = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.675876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.676129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.676375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.676615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.676861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.677095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.677362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.677618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.677855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.678108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.678397 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.678643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.678948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.679192 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.679450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.679684 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] federation.caching = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.679924 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.680166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.680417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.680647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.680899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.681140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.681397 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.681635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.681890 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.682122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.682378 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.682615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity.caching = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.682885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.683138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.683372 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.683610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.683860 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.684089 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.684327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.684579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.684834 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.685073 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.685306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.685538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.685780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.686029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.686276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.686530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.686780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.687079 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.687324 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.687560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.687795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.688033 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.688263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.688504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.688745 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.688986 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.689290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.689523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.689773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.690021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.690257 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.690503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.690750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.691010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.691246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.691479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.691719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.691951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.692199 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.692436 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.692676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.692924 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.693176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.693405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.693639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.693889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.694141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.694373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.694607 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.694859 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.695101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.695342 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.695601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.695835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.696085 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.696332 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.696580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.696813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.697047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.697279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.697516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.697751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.697982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.698227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.698473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.698715 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.698986 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.699229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.699463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.699709 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.699946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.700183 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.700417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.700655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.700895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.701143 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.701379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.701632 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.701863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.702109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.702348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.702583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.702903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.703089 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.703329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.703582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.703821 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.704061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] resource.caching = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.704311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.704559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.704869 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.705128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.705383 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.705619 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.705864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.706100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.706339 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.706574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] role.caching = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.706842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] role.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.707079 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.707326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.707578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.707824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.708364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.708616 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.708862 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.709109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.709357 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.709592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.709838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.710086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.710333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.710577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.711070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.711305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.711553 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.711804 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.712082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.712306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.712543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.712953 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.713206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.713445 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.713679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.713915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.714148 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.714399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.714657 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.714939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.715184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.715421 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.715654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.715890 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] token.caching = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.716125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.716374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.716612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.716871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.717119 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.717360 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.717605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.717851 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.718098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.718336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.718576 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.718863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.719082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.719333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.719563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.719806 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.720103 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.720412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.connection = **** {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.720660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.720907 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.721145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.721427 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.721666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.722158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.722405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.722643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.722914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.723153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.723399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.723637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.723884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.724124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.724371 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.724602 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.724842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.725083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:11:28.725256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 11:11:28.725927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.751362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.751638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.751848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.762295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.778284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.778577 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.781192 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.781423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.820050 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.846766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.847113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.847255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.847392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.847614 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.847825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.859955 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.860298 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.872282 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.872525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.872717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.872940 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.873155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.873368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.873645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.885113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.898702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.899056 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.899196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.899377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.899595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.899806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.900019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.905957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.906294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.906605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.906959 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.907268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.907583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.918352 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.918607 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 11:11:28.918778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.919011 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 11:11:28.919286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.919545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.919806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.920058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.923234 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.923666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.923978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.924288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.924593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.924894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.925200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.932156 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.932433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.932702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.932984 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.934390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.938099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.938423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.938729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.939104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.939410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.939719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.940022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:11:28.940169 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:28.943314 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:28.943600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.943883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.944174 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.944457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.944717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.944984 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.945257 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.945525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.945793 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.946062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.950437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.950647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 11:11:28.951187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.951387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 11:11:28.951686 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.951961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.952232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.952493 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.964614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.965025 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.965387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.965756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.969491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.971100 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:28.971389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.973268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:28.976073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:28.976366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.976534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:28.976684 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.976770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.977041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.977327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.977614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.977896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.978166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.978456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.978728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.979030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.979306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.983418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:28.983711 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.987946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:28.988239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.988518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.988806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.989086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.989380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.989660 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:28.989922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.003222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.004920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.005213 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.006440 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.006742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.010398 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.010711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.010948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.011268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.014005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.014308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.018100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.018389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.018850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.022040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.022526 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.022847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.023132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.023427 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.023713 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.023988 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.024267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.024539 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.025234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.025532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.025826 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.026119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.026398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.026678 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.040691 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.041038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.043032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.043349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.043620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.043882 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.045165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.049030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.049331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.050923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.052505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.052782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.053660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.055667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.055953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.056263 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.056553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.056834 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.057058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.060287 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.060595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.060886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.061177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.061507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.061705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.068598 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.068935 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.069174 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.069450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.069728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.070004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.070281 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.077957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.078261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.078534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.078942 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.086015 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.087377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.087601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.087892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.090415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.090710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.091060 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.091315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.091614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.091896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.093396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.095026 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.096632 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.096925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.097216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.103622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.103916 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.104119 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.104339 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.104537 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.104739 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.104994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.105278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.105480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.108350 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.108649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.108937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.109212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.117557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.117874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.118231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.123064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.125631 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.125927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.126154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.126354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.126665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.126799 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.127083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.127370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.127643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.128040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.128313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.128584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.128857 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.129132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.129321 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.129508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.130772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.132322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.132609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.132896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.139463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.140975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.144150 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.144437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.144721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.145002 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.153036 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.153444 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.153730 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.160915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:11:29.161208 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.161495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.161771 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.162047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.162325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.162599 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.162900 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.163064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564341d669c0 pid: 80054 (default app) Aug 09 11:11:29.163204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.163453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.163726 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.163985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.164369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.164643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:11:29.166612 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff833a-2063-4e04-9236-2561fc8a6846 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:29.166921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff833a-2063-4e04-9236-2561fc8a6846 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:29.167193 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff833a-2063-4e04-9236-2561fc8a6846 None None] PATH_INFO: `/v3` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:29.171689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Tue Aug 9 11:11:29 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:29.198747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564341d669c0 pid: 80055 (default app) Aug 09 11:11:36.922675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de096bc2-72b8-4785-8b97-29dd62854605 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:36.923311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de096bc2-72b8-4785-8b97-29dd62854605 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:36.923311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de096bc2-72b8-4785-8b97-29dd62854605 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:36.924609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:11:36.932565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f17d8-e461-469d-a458-b053a18c4004 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:36.933046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f17d8-e461-469d-a458-b053a18c4004 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:36.933046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f17d8-e461-469d-a458-b053a18c4004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:37.004327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: INFO dbcounter [None req-558f17d8-e461-469d-a458-b053a18c4004 None None] Registered counter for database keystone Aug 09 11:11:37.024506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG oslo_db.sqlalchemy.engines [None req-558f17d8-e461-469d-a458-b053a18c4004 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:11:37.031068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writer thread running {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:11:37.214104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG passlib.handlers.bcrypt [None req-558f17d8-e461-469d-a458-b053a18c4004 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80055) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 11:11:37.214425 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG passlib.handlers.bcrypt [None req-558f17d8-e461-469d-a458-b053a18c4004 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80055) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 11:11:37.273714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-558f17d8-e461-469d-a458-b053a18c4004 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:37.276418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-558f17d8-e461-469d-a458-b053a18c4004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:37.437292 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1/3] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 11:11:37.594800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de096bc2-72b8-4785-8b97-29dd62854605 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:37.680910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: INFO dbcounter [None req-de096bc2-72b8-4785-8b97-29dd62854605 None None] Registered counter for database keystone Aug 09 11:11:37.703105 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG oslo_db.sqlalchemy.engines [None req-de096bc2-72b8-4785-8b97-29dd62854605 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80054) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:11:37.709640 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writer thread running {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:11:37.834334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de096bc2-72b8-4785-8b97-29dd62854605 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:37.839184 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7143ba-7f04-4789-a910-326543172f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:37.839810 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7143ba-7f04-4789-a910-326543172f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:37.840081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7143ba-7f04-4789-a910-326543172f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:37.840351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7143ba-7f04-4789-a910-326543172f24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:37.849716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7143ba-7f04-4789-a910-326543172f24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:37.902039 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dd7143ba-7f04-4789-a910-326543172f24 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 11:11:37.902356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7143ba-7f04-4789-a910-326543172f24 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:37.913117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 3/4] 10.222.0.59 () {58 vars in 1324 bytes} [Tue Aug 9 11:11:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:11:37.919437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f17d8-e461-469d-a458-b053a18c4004 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:37.935167 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f17d8-e461-469d-a458-b053a18c4004 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:37.940583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a8f24-dde4-4d1e-8264-c89e6801d572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:37.941743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8f24-dde4-4d1e-8264-c89e6801d572 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:37.942022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8f24-dde4-4d1e-8264-c89e6801d572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:37.942304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8f24-dde4-4d1e-8264-c89e6801d572 admin admin] PATH_INFO: `/v3/projects/3f8f671817444c358cd7614c06a172b5` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:37.943941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a8f24-dde4-4d1e-8264-c89e6801d572 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f8f671817444c358cd7614c06a172b5)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:37.996851 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: WARNING keystone.common.rbac_enforcer.enforcer [None req-909a8f24-dde4-4d1e-8264-c89e6801d572 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 11:11:37.997192 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a8f24-dde4-4d1e-8264-c89e6801d572 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:38.001989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 2/5] 10.222.0.59 () {56 vars in 1207 bytes} [Tue Aug 9 11:11:37 2022] GET /identity/v3/projects/3f8f671817444c358cd7614c06a172b5 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:11:39.992564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaee8b-46e6-44c6-bcb8-dd117b857bd4 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:39.993115 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaee8b-46e6-44c6-bcb8-dd117b857bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:39.993115 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaee8b-46e6-44c6-bcb8-dd117b857bd4 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:39.997568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 4/6] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:40.003517 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a8fe5-8f79-4314-85b7-12c13787fbdc None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:40.004030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a8fe5-8f79-4314-85b7-12c13787fbdc None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:40.004030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a8fe5-8f79-4314-85b7-12c13787fbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:40.026365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f71a8fe5-8f79-4314-85b7-12c13787fbdc None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:40.027914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f71a8fe5-8f79-4314-85b7-12c13787fbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:40.036013 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 3/7] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 11:11:40.057802 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eaee8b-46e6-44c6-bcb8-dd117b857bd4 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:40.071030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eaee8b-46e6-44c6-bcb8-dd117b857bd4 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:40.075654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3994156-cf3c-458b-8f82-d15f8a7c4efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:40.076278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3994156-cf3c-458b-8f82-d15f8a7c4efd admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:40.076552 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3994156-cf3c-458b-8f82-d15f8a7c4efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:40.076820 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3994156-cf3c-458b-8f82-d15f8a7c4efd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:40.085689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3994156-cf3c-458b-8f82-d15f8a7c4efd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:40.087525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3994156-cf3c-458b-8f82-d15f8a7c4efd admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:40.096924 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 5/8] 10.222.0.59 () {58 vars in 1324 bytes} [Tue Aug 9 11:11:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:11:40.103267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a8fe5-8f79-4314-85b7-12c13787fbdc None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:40.113270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a8fe5-8f79-4314-85b7-12c13787fbdc None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:40.119033 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe59a9-aa68-41ae-9655-0b493b07512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:40.120039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe59a9-aa68-41ae-9655-0b493b07512b admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:40.120340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe59a9-aa68-41ae-9655-0b493b07512b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:40.120586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe59a9-aa68-41ae-9655-0b493b07512b admin admin] PATH_INFO: `/v3/users/b49c0d97d3434e41bf484d267b0b8e0e` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:40.122062 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe59a9-aa68-41ae-9655-0b493b07512b admin admin] RBAC: Authorizing `identity:get_user(user_id=b49c0d97d3434e41bf484d267b0b8e0e)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:40.123944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe59a9-aa68-41ae-9655-0b493b07512b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:40.125525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 4/9] 10.222.0.59 () {56 vars in 1198 bytes} [Tue Aug 9 11:11:40 2022] GET /identity/v3/users/b49c0d97d3434e41bf484d267b0b8e0e => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:42.242199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d68ed9-ce8b-43da-8cc9-9456272bd19f None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:42.242732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d68ed9-ce8b-43da-8cc9-9456272bd19f None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:42.242861 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d68ed9-ce8b-43da-8cc9-9456272bd19f None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:42.244804 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:42.250371 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c666e0a-e17d-4d82-ae92-b0ece13748e1 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:42.251048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c666e0a-e17d-4d82-ae92-b0ece13748e1 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:42.251048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c666e0a-e17d-4d82-ae92-b0ece13748e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:42.270397 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-8c666e0a-e17d-4d82-ae92-b0ece13748e1 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:42.271636 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-8c666e0a-e17d-4d82-ae92-b0ece13748e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:42.290842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d1890-533f-4d5c-a627-510819da6bdf None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:42.291296 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d1890-533f-4d5c-a627-510819da6bdf None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:42.291627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d1890-533f-4d5c-a627-510819da6bdf None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:42.293177 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 7/11] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:11:42.299028 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ce8ef-20aa-40d5-a6f9-eebf7dfc1800 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:42.299303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ce8ef-20aa-40d5-a6f9-eebf7dfc1800 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:42.299570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ce8ef-20aa-40d5-a6f9-eebf7dfc1800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:42.343679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG passlib.handlers.bcrypt [None req-f19ce8ef-20aa-40d5-a6f9-eebf7dfc1800 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80054) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 11:11:42.344114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG passlib.handlers.bcrypt [None req-f19ce8ef-20aa-40d5-a6f9-eebf7dfc1800 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80054) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 11:11:42.356962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 5/12] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:11:42.380333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c666e0a-e17d-4d82-ae92-b0ece13748e1 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:42.389839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-f19ce8ef-20aa-40d5-a6f9-eebf7dfc1800 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:42.391484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f19ce8ef-20aa-40d5-a6f9-eebf7dfc1800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:42.408421 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:42.506108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 8/13] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:11:42.511881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c666e0a-e17d-4d82-ae92-b0ece13748e1 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:42.527973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ce8ef-20aa-40d5-a6f9-eebf7dfc1800 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:42.554639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efda370-2210-4468-b560-40a4ddf9ecb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:42.555316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efda370-2210-4468-b560-40a4ddf9ecb6 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:42.555589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efda370-2210-4468-b560-40a4ddf9ecb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:42.555856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efda370-2210-4468-b560-40a4ddf9ecb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:42.567654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efda370-2210-4468-b560-40a4ddf9ecb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-1efda370-2210-4468-b560-40a4ddf9ecb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:11:42.576538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:11:42.578130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:11:42.579527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:11:42.579527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:11:42.579527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:11:42.579527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:11:42.579527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:11:42.579527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:11:42.579527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:11:42.579527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:11:42.579527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:11:42.579527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:11:42.579527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:11:42.579527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:11:42.579527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 6/14] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:11:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:11:42.583818 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efda370-2210-4468-b560-40a4ddf9ecb6 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:42.645413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ce8ef-20aa-40d5-a6f9-eebf7dfc1800 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:42.648344 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:42.687780 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1873-98c0-480d-8bf2-834267177696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:42.688670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1873-98c0-480d-8bf2-834267177696 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:42.688948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1873-98c0-480d-8bf2-834267177696 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:42.689217 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1873-98c0-480d-8bf2-834267177696 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:42.701428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:42.721347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efda370-2210-4468-b560-40a4ddf9ecb6 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:42.755661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ff820-28ce-4167-a93b-4e2d914960dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:42.756326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ff820-28ce-4167-a93b-4e2d914960dd None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:42.756544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ff820-28ce-4167-a93b-4e2d914960dd None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:42.756807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ff820-28ce-4167-a93b-4e2d914960dd None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:42.757480 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ff820-28ce-4167-a93b-4e2d914960dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:11:42.757775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ff820-28ce-4167-a93b-4e2d914960dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:42.759242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ff820-28ce-4167-a93b-4e2d914960dd None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:42.762501 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b1873-98c0-480d-8bf2-834267177696 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:42.764421 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b1873-98c0-480d-8bf2-834267177696 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:42.771380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 7/15] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:11:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:11:42.777212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ff820-28ce-4167-a93b-4e2d914960dd None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:42.873464 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 9/16] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:11:42.879914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1873-98c0-480d-8bf2-834267177696 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:42.883352 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:42.991948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1873-98c0-480d-8bf2-834267177696 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:43.001696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ff820-28ce-4167-a93b-4e2d914960dd None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:43.039513 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb67326-3afd-44ad-9075-7849947d9949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:43.040750 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb67326-3afd-44ad-9075-7849947d9949 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:43.041193 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb67326-3afd-44ad-9075-7849947d9949 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:43.041643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb67326-3afd-44ad-9075-7849947d9949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:43.047889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1e536-fbc9-4b95-b28c-b7f48d5d912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:43.048506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e536-fbc9-4b95-b28c-b7f48d5d912c None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:43.048779 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e536-fbc9-4b95-b28c-b7f48d5d912c None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:43.049147 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e536-fbc9-4b95-b28c-b7f48d5d912c None admin] PATH_INFO: `/v3/users/b49c0d97d3434e41bf484d267b0b8e0e` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:43.050332 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1e536-fbc9-4b95-b28c-b7f48d5d912c None admin] RBAC: Authorizing `identity:get_user(user_id=b49c0d97d3434e41bf484d267b0b8e0e)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:43.051848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1e536-fbc9-4b95-b28c-b7f48d5d912c None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:43.053450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 8/17] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:11:42 2022] GET /identity/v3/users/b49c0d97d3434e41bf484d267b0b8e0e => generated 247 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:43.061674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1e536-fbc9-4b95-b28c-b7f48d5d912c None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:43.061850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb67326-3afd-44ad-9075-7849947d9949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:43.063224 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb67326-3afd-44ad-9075-7849947d9949 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:43.077203 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-1bb67326-3afd-44ad-9075-7849947d9949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:11:43.082428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:11:43.083452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:11:43.084584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:11:43.084584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:11:43.084584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:11:43.084584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 10/18] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:11:43.092798 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb67326-3afd-44ad-9075-7849947d9949 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:43.165740 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:43.185484 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1e536-fbc9-4b95-b28c-b7f48d5d912c None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:43.216015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb67326-3afd-44ad-9075-7849947d9949 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:43.221763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8f76c-231c-497f-9fcd-8b8c608223cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:43.222426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8f76c-231c-497f-9fcd-8b8c608223cc None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:43.222723 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8f76c-231c-497f-9fcd-8b8c608223cc None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:43.223019 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8f76c-231c-497f-9fcd-8b8c608223cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:43.224165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8f76c-231c-497f-9fcd-8b8c608223cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:43.225613 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8f76c-231c-497f-9fcd-8b8c608223cc None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:43.227212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 9/19] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:11:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:11:43.233148 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8f76c-231c-497f-9fcd-8b8c608223cc None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:43.256417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7ce47-13d2-43a9-966b-6121e1702dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:43.257153 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7ce47-13d2-43a9-966b-6121e1702dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:43.257293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7ce47-13d2-43a9-966b-6121e1702dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:43.257549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7ce47-13d2-43a9-966b-6121e1702dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:43.258185 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7ce47-13d2-43a9-966b-6121e1702dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:11:43.258483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7ce47-13d2-43a9-966b-6121e1702dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:43.259927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7ce47-13d2-43a9-966b-6121e1702dd0 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:43.277867 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 11/20] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:11:43.322380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:43.345171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8f76c-231c-497f-9fcd-8b8c608223cc None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:43.386429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab088a-3342-4cdd-b87a-90e68584a847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:43.387088 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab088a-3342-4cdd-b87a-90e68584a847 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:43.387368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab088a-3342-4cdd-b87a-90e68584a847 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:43.387640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab088a-3342-4cdd-b87a-90e68584a847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:43.388388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab088a-3342-4cdd-b87a-90e68584a847 None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.domain.id=default, user.id=b49c0d97d3434e41bf484d267b0b8e0e) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:11:43.388694 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab088a-3342-4cdd-b87a-90e68584a847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:43.390215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab088a-3342-4cdd-b87a-90e68584a847 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:43.397906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 10/21] 10.222.0.59 () {56 vars in 1322 bytes} [Tue Aug 9 11:11:43 2022] GET /identity/v3/role_assignments?user.id=b49c0d97d3434e41bf484d267b0b8e0e&scope.domain.id=default&role.id=169d11e171d04c87af71475295957618 => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:11:45.636116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fb4d8-958d-400a-9446-9e52a2cf3db7 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:45.636891 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fb4d8-958d-400a-9446-9e52a2cf3db7 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:45.636891 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fb4d8-958d-400a-9446-9e52a2cf3db7 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:45.638319 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 12/22] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:45.643891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21b5b7-3af1-45e3-831b-ccf85fe8c7ce None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:45.644486 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21b5b7-3af1-45e3-831b-ccf85fe8c7ce None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:45.644486 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21b5b7-3af1-45e3-831b-ccf85fe8c7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:45.671998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-2f21b5b7-3af1-45e3-831b-ccf85fe8c7ce None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:45.673146 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-2f21b5b7-3af1-45e3-831b-ccf85fe8c7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:45.758740 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 11/23] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:11:45.818875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fb4d8-958d-400a-9446-9e52a2cf3db7 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:45.947643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fb4d8-958d-400a-9446-9e52a2cf3db7 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:45.977875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:45.998374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132663b-e11d-42a5-bc03-f211da6c9c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:45.999057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132663b-e11d-42a5-bc03-f211da6c9c0c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:45.999325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132663b-e11d-42a5-bc03-f211da6c9c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:45.999601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132663b-e11d-42a5-bc03-f211da6c9c0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:46.023382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132663b-e11d-42a5-bc03-f211da6c9c0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-0132663b-e11d-42a5-bc03-f211da6c9c0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:11:46.174158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:11:46.175149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:11:46.175929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:11:46.175929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:11:46.175929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:11:46.175929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:11:46.175929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:11:46.175929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:11:46.175929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:11:46.175929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:11:46.175929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:11:46.175929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:11:46.175929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:11:46.175929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:11:46.176522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 13/24] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:11:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:11:46.183952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21b5b7-3af1-45e3-831b-ccf85fe8c7ce None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:46.356247 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:46.404093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21b5b7-3af1-45e3-831b-ccf85fe8c7ce None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:46.459078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f74965-a2bf-49e1-bbce-0d8e3cc6a146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:46.459773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f74965-a2bf-49e1-bbce-0d8e3cc6a146 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:46.460053 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f74965-a2bf-49e1-bbce-0d8e3cc6a146 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:46.460354 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f74965-a2bf-49e1-bbce-0d8e3cc6a146 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:46.461364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f74965-a2bf-49e1-bbce-0d8e3cc6a146 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:11:46.461669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f74965-a2bf-49e1-bbce-0d8e3cc6a146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:46.463124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f74965-a2bf-49e1-bbce-0d8e3cc6a146 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:46.477918 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 12/25] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:11:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:46.492722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132663b-e11d-42a5-bc03-f211da6c9c0c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:46.746265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132663b-e11d-42a5-bc03-f211da6c9c0c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:46.772124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e670fa7-db64-4fe3-b312-b7352d1a0f4a None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:46.773732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e670fa7-db64-4fe3-b312-b7352d1a0f4a None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:46.774460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e670fa7-db64-4fe3-b312-b7352d1a0f4a None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:46.781521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 13/26] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:46 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:46.788663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df52a-2e6c-4757-8640-04726d87be11 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:46.789544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df52a-2e6c-4757-8640-04726d87be11 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:46.790283 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df52a-2e6c-4757-8640-04726d87be11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:46.841449 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-054df52a-2e6c-4757-8640-04726d87be11 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:46.844407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-054df52a-2e6c-4757-8640-04726d87be11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:46.879898 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d233c36-8274-47df-8f6b-a40063e282e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:46.881383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d233c36-8274-47df-8f6b-a40063e282e1 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:46.882004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d233c36-8274-47df-8f6b-a40063e282e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:46.882632 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d233c36-8274-47df-8f6b-a40063e282e1 None admin] PATH_INFO: `/v3/users/b49c0d97d3434e41bf484d267b0b8e0e` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:46.887045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d233c36-8274-47df-8f6b-a40063e282e1 None admin] RBAC: Authorizing `identity:get_user(user_id=b49c0d97d3434e41bf484d267b0b8e0e)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:46.889948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d233c36-8274-47df-8f6b-a40063e282e1 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:46.893246 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 14/27] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:11:46 2022] GET /identity/v3/users/b49c0d97d3434e41bf484d267b0b8e0e => generated 247 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:46.899635 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d233c36-8274-47df-8f6b-a40063e282e1 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:47.047587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 14/28] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:11:47.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:47.121961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054df52a-2e6c-4757-8640-04726d87be11 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:47.223705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d233c36-8274-47df-8f6b-a40063e282e1 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:47.238923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:47.325997 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054df52a-2e6c-4757-8640-04726d87be11 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:47.344017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139808d9-c4b8-4b32-ac2b-6a9207dada41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:47.345234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139808d9-c4b8-4b32-ac2b-6a9207dada41 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:47.345660 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139808d9-c4b8-4b32-ac2b-6a9207dada41 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:47.346168 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139808d9-c4b8-4b32-ac2b-6a9207dada41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:47.348337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139808d9-c4b8-4b32-ac2b-6a9207dada41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:47.351000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139808d9-c4b8-4b32-ac2b-6a9207dada41 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:47.354065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 15/29] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:11:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:47.361699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139808d9-c4b8-4b32-ac2b-6a9207dada41 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:47.406790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7fc3d-7b6f-4515-b596-c34b1ab29db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:47.407515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7fc3d-7b6f-4515-b596-c34b1ab29db0 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:47.407796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7fc3d-7b6f-4515-b596-c34b1ab29db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:47.408063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7fc3d-7b6f-4515-b596-c34b1ab29db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:47.428015 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7fc3d-7b6f-4515-b596-c34b1ab29db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:47.429887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7fc3d-7b6f-4515-b596-c34b1ab29db0 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-67b7fc3d-7b6f-4515-b596-c34b1ab29db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:11:47.447654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:11:47.448674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:11:47.449509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:11:47.449509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:11:47.449509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:11:47.451737 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 15/30] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:11:47.453327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c54f09-c663-4f79-8659-83e0bb9b992b None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:47.453816 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c54f09-c663-4f79-8659-83e0bb9b992b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:47.454304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c54f09-c663-4f79-8659-83e0bb9b992b None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:47.456234 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 16/31] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:47.464817 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c54f09-c663-4f79-8659-83e0bb9b992b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:47.664039 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139808d9-c4b8-4b32-ac2b-6a9207dada41 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:47.687945 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:47.704312 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89577247-d412-4ad6-9b76-2f19bd47600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:47.705447 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577247-d412-4ad6-9b76-2f19bd47600d None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:47.705920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577247-d412-4ad6-9b76-2f19bd47600d None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:47.706390 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577247-d412-4ad6-9b76-2f19bd47600d None admin] PATH_INFO: `/v3/domains/default/users/b49c0d97d3434e41bf484d267b0b8e0e/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:47.708589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89577247-d412-4ad6-9b76-2f19bd47600d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b49c0d97d3434e41bf484d267b0b8e0e, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:47.710385 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89577247-d412-4ad6-9b76-2f19bd47600d None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:47.713640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c54f09-c663-4f79-8659-83e0bb9b992b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:47.759240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:47.777915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba3ec2-d095-41fc-8413-0c8dd7ad1a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:47.780185 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba3ec2-d095-41fc-8413-0c8dd7ad1a19 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:47.780962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba3ec2-d095-41fc-8413-0c8dd7ad1a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:47.781676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba3ec2-d095-41fc-8413-0c8dd7ad1a19 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:47.783136 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba3ec2-d095-41fc-8413-0c8dd7ad1a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:11:47.784008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba3ec2-d095-41fc-8413-0c8dd7ad1a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:47.786886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba3ec2-d095-41fc-8413-0c8dd7ad1a19 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:47.819249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 17/32] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:11:47.821023 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4412-ec3f-4daa-836d-993908604fc6 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:47.821471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4412-ec3f-4daa-836d-993908604fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:47.821899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4412-ec3f-4daa-836d-993908604fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:47.839008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 16/33] 10.222.0.59 () {58 vars in 1361 bytes} [Tue Aug 9 11:11:47 2022] PUT /identity/v3/domains/default/users/b49c0d97d3434e41bf484d267b0b8e0e/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:11:47.847027 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304e60f-6403-479d-bd91-39d4f53087a9 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:47.847027 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304e60f-6403-479d-bd91-39d4f53087a9 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:47.847027 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304e60f-6403-479d-bd91-39d4f53087a9 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:47.847027 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 17/34] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:47.847408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304e60f-6403-479d-bd91-39d4f53087a9 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:47.851717 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-922a4412-ec3f-4daa-836d-993908604fc6 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:47.853122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-922a4412-ec3f-4daa-836d-993908604fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:47.954386 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 18/35] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:11:47.958644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca0f1-a7d3-494c-9617-aff44447bf66 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:47.959564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca0f1-a7d3-494c-9617-aff44447bf66 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:47.960699 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca0f1-a7d3-494c-9617-aff44447bf66 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:47.964676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:47.967411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94529546-de47-44a1-912a-42ced4d32004 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:47.968207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94529546-de47-44a1-912a-42ced4d32004 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:47.969004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94529546-de47-44a1-912a-42ced4d32004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:47.990776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304e60f-6403-479d-bd91-39d4f53087a9 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:48.004203 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-94529546-de47-44a1-912a-42ced4d32004 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:48.005627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-94529546-de47-44a1-912a-42ced4d32004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:48.059092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91bd77-8d64-4ddc-be99-49f655ecba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:48.060023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91bd77-8d64-4ddc-be99-49f655ecba6a None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:48.060488 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91bd77-8d64-4ddc-be99-49f655ecba6a None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:48.060993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91bd77-8d64-4ddc-be99-49f655ecba6a None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:48.062325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91bd77-8d64-4ddc-be99-49f655ecba6a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:48.065702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91bd77-8d64-4ddc-be99-49f655ecba6a None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:48.094944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 20/37] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:11:48.096086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69577621-3045-48ca-8b8f-6ef08ccf37e8 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:48.096377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69577621-3045-48ca-8b8f-6ef08ccf37e8 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:48.096649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69577621-3045-48ca-8b8f-6ef08ccf37e8 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:48.102512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 21/38] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:48.102512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8236055-0661-4b41-8df1-a4d3ee7d78ce None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:48.102512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8236055-0661-4b41-8df1-a4d3ee7d78ce None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:48.102512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8236055-0661-4b41-8df1-a4d3ee7d78ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:48.114931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 18/39] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Aug 9 11:11:47 2022] POST /identity/v3/projects => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:11:48.116285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91bd77-8d64-4ddc-be99-49f655ecba6a None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:48.146208 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a8236055-0661-4b41-8df1-a4d3ee7d78ce None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:48.148944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a8236055-0661-4b41-8df1-a4d3ee7d78ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:48.163481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:48.205622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:48.267296 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91bd77-8d64-4ddc-be99-49f655ecba6a None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:48.268360 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 22/40] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:11:48.270287 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a747415-a8d2-4830-bfac-b925b1b46d04 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:48.271643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a747415-a8d2-4830-bfac-b925b1b46d04 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:48.271643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a747415-a8d2-4830-bfac-b925b1b46d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:48.301058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-6a747415-a8d2-4830-bfac-b925b1b46d04 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:48.302264 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6a747415-a8d2-4830-bfac-b925b1b46d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:48.327687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db10ace-0f01-4720-939d-fbe3ec222065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:48.329103 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db10ace-0f01-4720-939d-fbe3ec222065 None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:48.329389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db10ace-0f01-4720-939d-fbe3ec222065 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:48.329646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db10ace-0f01-4720-939d-fbe3ec222065 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:48.331697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db10ace-0f01-4720-939d-fbe3ec222065 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:48.332429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db10ace-0f01-4720-939d-fbe3ec222065 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:48.362606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 19/41] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Aug 9 11:11:48 2022] POST /identity/v3/roles => generated 225 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:11:48.363669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db10ace-0f01-4720-939d-fbe3ec222065 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:48.399782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 23/42] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:11:48.400773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a747415-a8d2-4830-bfac-b925b1b46d04 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:48.496396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:48.528940 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db10ace-0f01-4720-939d-fbe3ec222065 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:48.574598 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce526156-8242-4f86-972c-374b8388a756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:48.575410 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce526156-8242-4f86-972c-374b8388a756 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:48.575757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce526156-8242-4f86-972c-374b8388a756 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:48.576098 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce526156-8242-4f86-972c-374b8388a756 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:48.578055 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce526156-8242-4f86-972c-374b8388a756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:48.580141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce526156-8242-4f86-972c-374b8388a756 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:48.582591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 20/43] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:11:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:48.583434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce526156-8242-4f86-972c-374b8388a756 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:48.589703 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a747415-a8d2-4830-bfac-b925b1b46d04 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:48.600898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:48.651579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cd51e-5ba9-484f-97e0-b2b9a868d072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:48.653077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cd51e-5ba9-484f-97e0-b2b9a868d072 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:48.653874 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cd51e-5ba9-484f-97e0-b2b9a868d072 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:48.654602 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cd51e-5ba9-484f-97e0-b2b9a868d072 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:48.656138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cd51e-5ba9-484f-97e0-b2b9a868d072 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:48.658408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cd51e-5ba9-484f-97e0-b2b9a868d072 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:48.754321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce526156-8242-4f86-972c-374b8388a756 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:48.787290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 24/44] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Aug 9 11:11:48 2022] POST /identity/v3/roles => generated 219 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:11:48.790027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cd51e-5ba9-484f-97e0-b2b9a868d072 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:48.814175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077c309-8f9f-4e2b-86b9-01061438f719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:48.815542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077c309-8f9f-4e2b-86b9-01061438f719 None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:48.815756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077c309-8f9f-4e2b-86b9-01061438f719 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:48.816240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077c309-8f9f-4e2b-86b9-01061438f719 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:48.817568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077c309-8f9f-4e2b-86b9-01061438f719 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:48.820183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077c309-8f9f-4e2b-86b9-01061438f719 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:48.842152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 21/45] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Aug 9 11:11:48 2022] POST /identity/v3/roles => generated 223 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:11:48.953939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cd51e-5ba9-484f-97e0-b2b9a868d072 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:49.001590 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8817a-9206-458f-948b-b89e0b5e6a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:49.002442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8817a-9206-458f-948b-b89e0b5e6a02 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:49.002728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8817a-9206-458f-948b-b89e0b5e6a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:49.003020 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8817a-9206-458f-948b-b89e0b5e6a02 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:49.003694 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8817a-9206-458f-948b-b89e0b5e6a02 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:49.005406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8817a-9206-458f-948b-b89e0b5e6a02 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:49.040030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 25/46] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Aug 9 11:11:48 2022] POST /identity/v3/projects => generated 312 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:11:50.012602 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d664e38-efcb-43de-b4ce-4db639716a4a None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:50.013168 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d664e38-efcb-43de-b4ce-4db639716a4a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:50.013168 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d664e38-efcb-43de-b4ce-4db639716a4a None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:50.014537 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 22/47] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:50.020391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449fc2e-b2e9-4f1b-bf19-b40e57f350e5 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:50.020840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449fc2e-b2e9-4f1b-bf19-b40e57f350e5 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:50.021224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449fc2e-b2e9-4f1b-bf19-b40e57f350e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:50.042836 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f449fc2e-b2e9-4f1b-bf19-b40e57f350e5 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:50.044412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f449fc2e-b2e9-4f1b-bf19-b40e57f350e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:50.047817 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:50.132228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 26/48] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:11:50.155125 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d664e38-efcb-43de-b4ce-4db639716a4a None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:50.173610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:50.279670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d664e38-efcb-43de-b4ce-4db639716a4a None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:50.320403 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0b56b-cd74-43c6-9690-840d833adb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:50.321019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0b56b-cd74-43c6-9690-840d833adb45 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:50.321291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0b56b-cd74-43c6-9690-840d833adb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:50.321559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0b56b-cd74-43c6-9690-840d833adb45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:50.333404 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0b56b-cd74-43c6-9690-840d833adb45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-fff0b56b-cd74-43c6-9690-840d833adb45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:11:50.338284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:11:50.339370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:11:50.340196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:11:50.340196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:11:50.340196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:11:50.340196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:11:50.340196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:11:50.340196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:11:50.340196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:11:50.340196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:11:50.340196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:11:50.340196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:11:50.340196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:11:50.340196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:11:50.340196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 23/49] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:11:50.348103 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449fc2e-b2e9-4f1b-bf19-b40e57f350e5 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:50.458033 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449fc2e-b2e9-4f1b-bf19-b40e57f350e5 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:50.498023 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3fb76-bf3f-493f-9f0e-73685f976b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:50.498647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3fb76-bf3f-493f-9f0e-73685f976b04 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:50.498964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3fb76-bf3f-493f-9f0e-73685f976b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:50.499244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3fb76-bf3f-493f-9f0e-73685f976b04 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:50.499921 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3fb76-bf3f-493f-9f0e-73685f976b04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:11:50.500230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3fb76-bf3f-493f-9f0e-73685f976b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:50.501672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3fb76-bf3f-493f-9f0e-73685f976b04 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:50.510593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 27/50] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:11:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:50.516409 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0b56b-cd74-43c6-9690-840d833adb45 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:50.591040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:50.622650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0b56b-cd74-43c6-9690-840d833adb45 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:50.658310 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289f72b-8fae-468e-852d-1abfb03db614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:50.659023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289f72b-8fae-468e-852d-1abfb03db614 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:50.659285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289f72b-8fae-468e-852d-1abfb03db614 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:50.659565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289f72b-8fae-468e-852d-1abfb03db614 None admin] PATH_INFO: `/v3/users/b49c0d97d3434e41bf484d267b0b8e0e` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:50.660713 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289f72b-8fae-468e-852d-1abfb03db614 None admin] RBAC: Authorizing `identity:get_user(user_id=b49c0d97d3434e41bf484d267b0b8e0e)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:50.662192 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289f72b-8fae-468e-852d-1abfb03db614 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:50.664001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 24/51] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:11:50 2022] GET /identity/v3/users/b49c0d97d3434e41bf484d267b0b8e0e => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:50.669422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3fb76-bf3f-493f-9f0e-73685f976b04 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:50.672444 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:50.781549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3fb76-bf3f-493f-9f0e-73685f976b04 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:50.822722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f90cf1-e8a7-4963-918b-bc8c7bea792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:50.823397 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f90cf1-e8a7-4963-918b-bc8c7bea792e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:50.823669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f90cf1-e8a7-4963-918b-bc8c7bea792e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:50.823944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f90cf1-e8a7-4963-918b-bc8c7bea792e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:50.825091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f90cf1-e8a7-4963-918b-bc8c7bea792e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:50.826575 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f90cf1-e8a7-4963-918b-bc8c7bea792e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:50.828196 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 28/52] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:11:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:50.834284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289f72b-8fae-468e-852d-1abfb03db614 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:50.971528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289f72b-8fae-468e-852d-1abfb03db614 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:51.006914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3f3af-db42-4aa4-8ce3-4d6e8da8d5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:51.007539 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3f3af-db42-4aa4-8ce3-4d6e8da8d5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:51.007820 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3f3af-db42-4aa4-8ce3-4d6e8da8d5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:51.008094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3f3af-db42-4aa4-8ce3-4d6e8da8d5f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:51.008854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3f3af-db42-4aa4-8ce3-4d6e8da8d5f6 None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.domain.id=default, user.id=b49c0d97d3434e41bf484d267b0b8e0e) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:11:51.009145 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3f3af-db42-4aa4-8ce3-4d6e8da8d5f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:51.010605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3f3af-db42-4aa4-8ce3-4d6e8da8d5f6 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:51.019326 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 25/53] 10.222.0.59 () {56 vars in 1322 bytes} [Tue Aug 9 11:11:50 2022] GET /identity/v3/role_assignments?user.id=b49c0d97d3434e41bf484d267b0b8e0e&scope.domain.id=default&role.id=169d11e171d04c87af71475295957618 => generated 530 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:11:51.081954 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706ab75-0eb7-4204-a21c-1209674525b3 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:51.082595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706ab75-0eb7-4204-a21c-1209674525b3 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:51.082595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706ab75-0eb7-4204-a21c-1209674525b3 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:51.083926 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 29/54] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:51.089824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f704e72-96c9-45e7-9a31-6451058bdba5 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:51.090114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f704e72-96c9-45e7-9a31-6451058bdba5 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:51.090394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f704e72-96c9-45e7-9a31-6451058bdba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:51.098914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:51.111312 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-8f704e72-96c9-45e7-9a31-6451058bdba5 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:51.112969 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-8f704e72-96c9-45e7-9a31-6451058bdba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:51.189243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 26/55] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:11:51.211885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706ab75-0eb7-4204-a21c-1209674525b3 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:51.294147 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:51.326668 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706ab75-0eb7-4204-a21c-1209674525b3 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:51.382193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90669850-4844-44ac-8d2a-007088b62738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:51.383258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90669850-4844-44ac-8d2a-007088b62738 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:51.383709 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90669850-4844-44ac-8d2a-007088b62738 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:51.384173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90669850-4844-44ac-8d2a-007088b62738 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:51.385580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90669850-4844-44ac-8d2a-007088b62738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:51.387116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90669850-4844-44ac-8d2a-007088b62738 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:51.388717 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 30/56] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:51.395015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f704e72-96c9-45e7-9a31-6451058bdba5 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:51.504695 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f704e72-96c9-45e7-9a31-6451058bdba5 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:51.542657 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbb321-007c-4c58-8815-4df0ef1434d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:51.543315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbb321-007c-4c58-8815-4df0ef1434d5 None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:51.543596 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbb321-007c-4c58-8815-4df0ef1434d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:51.543869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbb321-007c-4c58-8815-4df0ef1434d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:51.544579 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbb321-007c-4c58-8815-4df0ef1434d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:51.545989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbb321-007c-4c58-8815-4df0ef1434d5 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:51.550865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:51.574778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 27/57] 10.222.0.59 () {60 vars in 1140 bytes} [Tue Aug 9 11:11:51 2022] POST /identity/v3/projects => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:11:53.604710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7760960-50c4-44e4-a8f9-1c32446f64dc None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:53.605479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7760960-50c4-44e4-a8f9-1c32446f64dc None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:53.605649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7760960-50c4-44e4-a8f9-1c32446f64dc None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:53.607072 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 31/58] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:53.612798 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57192c1-c526-4cfd-a939-88237c96b3b8 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:53.613527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57192c1-c526-4cfd-a939-88237c96b3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:53.613527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57192c1-c526-4cfd-a939-88237c96b3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:53.633671 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-e57192c1-c526-4cfd-a939-88237c96b3b8 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:53.634977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e57192c1-c526-4cfd-a939-88237c96b3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:53.708878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 28/59] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:11:53.733053 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7760960-50c4-44e4-a8f9-1c32446f64dc None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:53.856506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7760960-50c4-44e4-a8f9-1c32446f64dc None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:53.893480 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71063ad7-3add-4df2-8106-e483ec10b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:53.894235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063ad7-3add-4df2-8106-e483ec10b960 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:53.894596 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063ad7-3add-4df2-8106-e483ec10b960 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:53.895012 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063ad7-3add-4df2-8106-e483ec10b960 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:53.896278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71063ad7-3add-4df2-8106-e483ec10b960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:53.897881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71063ad7-3add-4df2-8106-e483ec10b960 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:53.899529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 32/60] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:11:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:53.905457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57192c1-c526-4cfd-a939-88237c96b3b8 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:54.014021 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57192c1-c526-4cfd-a939-88237c96b3b8 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:54.031183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:54.055996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901b158-a7a1-4e21-b859-f6a2325be0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:54.056622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901b158-a7a1-4e21-b859-f6a2325be0c0 None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:54.056899 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901b158-a7a1-4e21-b859-f6a2325be0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:54.057167 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901b158-a7a1-4e21-b859-f6a2325be0c0 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:54.057822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901b158-a7a1-4e21-b859-f6a2325be0c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:54.059361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901b158-a7a1-4e21-b859-f6a2325be0c0 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:54.088567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 29/61] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:11:53 2022] POST /identity/v3/users => generated 275 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:11:57.439914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4ab98-d2e7-401b-afc8-36615c257a04 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:57.441003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4ab98-d2e7-401b-afc8-36615c257a04 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:57.441485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4ab98-d2e7-401b-afc8-36615c257a04 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:57.443661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 33/62] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:57.449668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a8aa4-edaa-4a54-ab3c-135aba22336b None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:57.450223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a8aa4-edaa-4a54-ab3c-135aba22336b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:57.450223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a8aa4-edaa-4a54-ab3c-135aba22336b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:57.477177 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-fd0a8aa4-edaa-4a54-ab3c-135aba22336b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:57.480669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-fd0a8aa4-edaa-4a54-ab3c-135aba22336b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:57.598355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 30/63] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:11:57.652542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4ab98-d2e7-401b-afc8-36615c257a04 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:57.666182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:57.801357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b2a22-dd32-489e-bf30-bebd05227f95 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:57.802044 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b2a22-dd32-489e-bf30-bebd05227f95 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:57.802521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b2a22-dd32-489e-bf30-bebd05227f95 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:57.804244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 31/64] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:11:57.810685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4ab98-d2e7-401b-afc8-36615c257a04 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:57.811831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182273d-7682-4a91-b2ff-9656eb46015a None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:57.812336 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182273d-7682-4a91-b2ff-9656eb46015a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:57.813019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182273d-7682-4a91-b2ff-9656eb46015a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:57.836324 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-7182273d-7682-4a91-b2ff-9656eb46015a None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:57.838082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7182273d-7682-4a91-b2ff-9656eb46015a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:57.888540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f68de-4595-425a-b063-7e1aecb5fecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:57.890139 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f68de-4595-425a-b063-7e1aecb5fecf None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:57.890947 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f68de-4595-425a-b063-7e1aecb5fecf None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:57.891693 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f68de-4595-425a-b063-7e1aecb5fecf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:57.922360 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f68de-4595-425a-b063-7e1aecb5fecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-291f68de-4595-425a-b063-7e1aecb5fecf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:11:57.927963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:11:57.929566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:11:57.931118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:11:57.931118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:11:57.931118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:11:57.931118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:11:57.931118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:11:57.931118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:11:57.931118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:11:57.931118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:11:57.931118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:11:57.931118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:11:57.931118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:11:57.931118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:11:57.931118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 34/65] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:11:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:11:57.943402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f68de-4595-425a-b063-7e1aecb5fecf None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:57.957802 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 32/66] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:11:58.007654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182273d-7682-4a91-b2ff-9656eb46015a None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:58.071284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:58.075872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:58.140687 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f68de-4595-425a-b063-7e1aecb5fecf None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:58.169365 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182273d-7682-4a91-b2ff-9656eb46015a None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:58.199352 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4b097-2ac9-4952-9686-04886db7857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:58.200345 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4b097-2ac9-4952-9686-04886db7857d None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:58.200838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4b097-2ac9-4952-9686-04886db7857d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:58.201328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4b097-2ac9-4952-9686-04886db7857d None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:58.202571 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4b097-2ac9-4952-9686-04886db7857d None admin] RBAC: Adding query filter params (name=member) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:11:58.203143 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4b097-2ac9-4952-9686-04886db7857d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:58.205893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4b097-2ac9-4952-9686-04886db7857d None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:58.212284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23134e82-78fe-4e25-afe0-761ba36951f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:58.213025 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23134e82-78fe-4e25-afe0-761ba36951f8 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:58.213348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23134e82-78fe-4e25-afe0-761ba36951f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:58.213658 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23134e82-78fe-4e25-afe0-761ba36951f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:58.221688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 35/67] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:11:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:58.223784 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c67b7-96fe-42de-a50a-5f11c0e313e0 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:58.224294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c67b7-96fe-42de-a50a-5f11c0e313e0 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:58.224756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c67b7-96fe-42de-a50a-5f11c0e313e0 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:58.230878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 36/68] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:58.230878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14506aa7-f16a-4fdd-8e02-8f40c6ac1102 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:58.230878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14506aa7-f16a-4fdd-8e02-8f40c6ac1102 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:58.230878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14506aa7-f16a-4fdd-8e02-8f40c6ac1102 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:58.232381 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 37/69] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:58.233694 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14506aa7-f16a-4fdd-8e02-8f40c6ac1102 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:58.240626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23134e82-78fe-4e25-afe0-761ba36951f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-23134e82-78fe-4e25-afe0-761ba36951f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:11:58.245957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:11:58.246979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:11:58.247823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:11:58.247823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:11:58.247823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:11:58.247823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:11:58.247823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:11:58.247823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:11:58.247823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:11:58.247823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:11:58.247823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:11:58.247823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:11:58.247823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:11:58.247823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:11:58.247823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 33/70] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:11:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:11:58.249263 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d80575-c2e9-4aa3-addb-28e6420b4692 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:58.249558 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d80575-c2e9-4aa3-addb-28e6420b4692 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:58.249830 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d80575-c2e9-4aa3-addb-28e6420b4692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:58.268838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-f3d80575-c2e9-4aa3-addb-28e6420b4692 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:58.270112 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f3d80575-c2e9-4aa3-addb-28e6420b4692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:58.347133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14506aa7-f16a-4fdd-8e02-8f40c6ac1102 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:58.374708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 34/71] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:11:58.374708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672b438-1334-470a-b565-d306e17ae90e None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:58.374708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672b438-1334-470a-b565-d306e17ae90e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:58.374708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672b438-1334-470a-b565-d306e17ae90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:58.379465 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:58.389652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087f2e8-ee44-4eef-be80-af5aaa38cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:58.390372 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087f2e8-ee44-4eef-be80-af5aaa38cd29 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:58.390642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087f2e8-ee44-4eef-be80-af5aaa38cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:58.391016 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087f2e8-ee44-4eef-be80-af5aaa38cd29 None admin] PATH_INFO: `/v3/users/6c00a943c52a48299d08f42c54466487` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:58.394474 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-e672b438-1334-470a-b565-d306e17ae90e None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:58.395869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e672b438-1334-470a-b565-d306e17ae90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:58.409022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087f2e8-ee44-4eef-be80-af5aaa38cd29 None admin] RBAC: Authorizing `identity:get_user(user_id=6c00a943c52a48299d08f42c54466487)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:58.410620 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087f2e8-ee44-4eef-be80-af5aaa38cd29 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:58.412541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 38/72] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:11:58 2022] GET /identity/v3/users/6c00a943c52a48299d08f42c54466487 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:58.413913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316d749-031a-4e6c-82e8-bcec6883098d None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:58.414369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316d749-031a-4e6c-82e8-bcec6883098d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:58.414845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316d749-031a-4e6c-82e8-bcec6883098d None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:58.415771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:58.416487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 39/73] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:58.417553 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316d749-031a-4e6c-82e8-bcec6883098d None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:58.496043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 35/74] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:11:58.497152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672b438-1334-470a-b565-d306e17ae90e None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:58.550210 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316d749-031a-4e6c-82e8-bcec6883098d None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:58.587261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f251615-b22d-429c-93b0-ce0620f4b677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:58.587927 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f251615-b22d-429c-93b0-ce0620f4b677 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:58.588208 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f251615-b22d-429c-93b0-ce0620f4b677 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:58.588480 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f251615-b22d-429c-93b0-ce0620f4b677 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:58.589192 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f251615-b22d-429c-93b0-ce0620f4b677 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:11:58.589494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f251615-b22d-429c-93b0-ce0620f4b677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:58.591000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f251615-b22d-429c-93b0-ce0620f4b677 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:58.600442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 40/75] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:11:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:58.601411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f251615-b22d-429c-93b0-ce0620f4b677 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:58.612828 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672b438-1334-470a-b565-d306e17ae90e None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:58.654478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:58.660081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8b0b9-d214-42b0-9f11-1445f0b73e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:58.660930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8b0b9-d214-42b0-9f11-1445f0b73e16 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:58.661337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8b0b9-d214-42b0-9f11-1445f0b73e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:58.661681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8b0b9-d214-42b0-9f11-1445f0b73e16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:58.675703 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8b0b9-d214-42b0-9f11-1445f0b73e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-17f8b0b9-d214-42b0-9f11-1445f0b73e16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:11:58.682451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:11:58.683515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:11:58.684721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:11:58.684721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:11:58.684721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:11:58.684721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:11:58.684721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:11:58.684721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:11:58.684721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:11:58.684721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:11:58.684721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:11:58.684721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:11:58.684721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:11:58.684721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:11:58.684721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 36/76] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:11:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:11:58.685782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649199de-5dd1-4318-bed8-e90644514746 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:58.686170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649199de-5dd1-4318-bed8-e90644514746 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:58.686604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649199de-5dd1-4318-bed8-e90644514746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:58.712088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-649199de-5dd1-4318-bed8-e90644514746 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:58.713686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-649199de-5dd1-4318-bed8-e90644514746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:58.717957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f251615-b22d-429c-93b0-ce0620f4b677 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:58.727910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:58.756354 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab2f5f-061b-467e-8bb4-e9e6a9c1c31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:58.757064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab2f5f-061b-467e-8bb4-e9e6a9c1c31b None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:58.757345 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab2f5f-061b-467e-8bb4-e9e6a9c1c31b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:58.757976 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab2f5f-061b-467e-8bb4-e9e6a9c1c31b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:58.842864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 37/77] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:11:58.842864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649199de-5dd1-4318-bed8-e90644514746 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:58.854384 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab2f5f-061b-467e-8bb4-e9e6a9c1c31b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:58.856189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab2f5f-061b-467e-8bb4-e9e6a9c1c31b None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:58.912360 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:58.968053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649199de-5dd1-4318-bed8-e90644514746 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:58.971611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 41/78] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:11:58.973165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab2f5f-061b-467e-8bb4-e9e6a9c1c31b None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:59.006054 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467f068-33dc-44a2-9418-22ff1417f87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:59.006792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467f068-33dc-44a2-9418-22ff1417f87b None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:59.007050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467f068-33dc-44a2-9418-22ff1417f87b None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:59.007322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467f068-33dc-44a2-9418-22ff1417f87b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:59.018548 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467f068-33dc-44a2-9418-22ff1417f87b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-8467f068-33dc-44a2-9418-22ff1417f87b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:11:59.023429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:11:59.024333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:11:59.025432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:11:59.025432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:11:59.025432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:11:59.025432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:11:59.025432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:11:59.025432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:11:59.025432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:11:59.025432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:11:59.025432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:11:59.025432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:11:59.025432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:11:59.025432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:11:59.025432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 38/79] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:11:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:11:59.025432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467f068-33dc-44a2-9418-22ff1417f87b None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:59.028672 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:59.107761 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab2f5f-061b-467e-8bb4-e9e6a9c1c31b None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:59.134112 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467f068-33dc-44a2-9418-22ff1417f87b None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:59.147969 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69349c7-6998-4f1f-8bb2-a61bc73717cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:59.148648 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69349c7-6998-4f1f-8bb2-a61bc73717cb None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:59.148926 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69349c7-6998-4f1f-8bb2-a61bc73717cb None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:59.149198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69349c7-6998-4f1f-8bb2-a61bc73717cb None admin] PATH_INFO: `/v3/users/b49c0d97d3434e41bf484d267b0b8e0e` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:59.150463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69349c7-6998-4f1f-8bb2-a61bc73717cb None admin] RBAC: Authorizing `identity:get_user(user_id=b49c0d97d3434e41bf484d267b0b8e0e)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:59.152039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69349c7-6998-4f1f-8bb2-a61bc73717cb None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:59.153936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 42/80] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:11:58 2022] GET /identity/v3/users/b49c0d97d3434e41bf484d267b0b8e0e => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:59.154622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69349c7-6998-4f1f-8bb2-a61bc73717cb None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:59.174670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:59.175419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335ac33-4aec-467a-9708-756d8a96d335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:59.176089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335ac33-4aec-467a-9708-756d8a96d335 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:59.176382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335ac33-4aec-467a-9708-756d8a96d335 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:59.176653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335ac33-4aec-467a-9708-756d8a96d335 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:59.177392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335ac33-4aec-467a-9708-756d8a96d335 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:11:59.177701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335ac33-4aec-467a-9708-756d8a96d335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:59.179229 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335ac33-4aec-467a-9708-756d8a96d335 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:59.192029 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 39/81] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:11:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:59.192927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335ac33-4aec-467a-9708-756d8a96d335 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:59.274444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:59.274718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69349c7-6998-4f1f-8bb2-a61bc73717cb None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:59.317286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f512e-ef0f-4fce-a208-71c0cf8d527c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:59.318009 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f512e-ef0f-4fce-a208-71c0cf8d527c None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:59.318272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f512e-ef0f-4fce-a208-71c0cf8d527c None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:59.318537 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f512e-ef0f-4fce-a208-71c0cf8d527c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:59.319819 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f512e-ef0f-4fce-a208-71c0cf8d527c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:59.321005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335ac33-4aec-467a-9708-756d8a96d335 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:59.321370 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f512e-ef0f-4fce-a208-71c0cf8d527c None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:59.323062 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 43/82] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:11:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:59.323887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f512e-ef0f-4fce-a208-71c0cf8d527c None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:59.364088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c21e43-2569-425d-81eb-629b979ef099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:59.364782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c21e43-2569-425d-81eb-629b979ef099 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:59.365058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c21e43-2569-425d-81eb-629b979ef099 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:59.365337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c21e43-2569-425d-81eb-629b979ef099 None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:59.366590 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c21e43-2569-425d-81eb-629b979ef099 None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:59.368175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c21e43-2569-425d-81eb-629b979ef099 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:59.370242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 40/83] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:11:59 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:59.371085 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c21e43-2569-425d-81eb-629b979ef099 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:59.423733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:59.446388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f512e-ef0f-4fce-a208-71c0cf8d527c None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:59.490356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c21e43-2569-425d-81eb-629b979ef099 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:59.512321 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aaddf-dd7e-469f-965b-a5c10159b174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:59.513372 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aaddf-dd7e-469f-965b-a5c10159b174 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:59.513946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aaddf-dd7e-469f-965b-a5c10159b174 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:59.514357 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aaddf-dd7e-469f-965b-a5c10159b174 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:59.515628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149aaddf-dd7e-469f-965b-a5c10159b174 None admin] RBAC: Adding query filter params (name=member) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:11:59.516060 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149aaddf-dd7e-469f-965b-a5c10159b174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:59.518529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149aaddf-dd7e-469f-965b-a5c10159b174 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:59.525222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:59.530956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0aed-66cf-402f-8136-fb30d9869836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:59.531883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 44/84] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:11:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:59.531989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0aed-66cf-402f-8136-fb30d9869836 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:59.532481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0aed-66cf-402f-8136-fb30d9869836 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:59.532814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aaddf-dd7e-469f-965b-a5c10159b174 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:59.532933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0aed-66cf-402f-8136-fb30d9869836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:59.612216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0aed-66cf-402f-8136-fb30d9869836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:59.613843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0aed-66cf-402f-8136-fb30d9869836 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:59.657810 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aaddf-dd7e-469f-965b-a5c10159b174 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:59.693987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f37e9e-12fc-4c0e-8efe-24351439a39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:59.694663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f37e9e-12fc-4c0e-8efe-24351439a39e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:59.694988 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f37e9e-12fc-4c0e-8efe-24351439a39e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:59.695263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f37e9e-12fc-4c0e-8efe-24351439a39e None admin] PATH_INFO: `/v3/users/6c00a943c52a48299d08f42c54466487` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:59.696479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f37e9e-12fc-4c0e-8efe-24351439a39e None admin] RBAC: Authorizing `identity:get_user(user_id=6c00a943c52a48299d08f42c54466487)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:59.698020 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f37e9e-12fc-4c0e-8efe-24351439a39e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:59.699879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 45/85] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:11:59 2022] GET /identity/v3/users/6c00a943c52a48299d08f42c54466487 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:59.700574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f37e9e-12fc-4c0e-8efe-24351439a39e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:59.718117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:59.724433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 41/86] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:11:59.725356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0aed-66cf-402f-8136-fb30d9869836 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:59.758768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:59.832916 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f37e9e-12fc-4c0e-8efe-24351439a39e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:59.841390 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0aed-66cf-402f-8136-fb30d9869836 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:59.874431 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d134f20-3360-49e4-b231-51f670434655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:59.875294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134f20-3360-49e4-b231-51f670434655 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:59.875668 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134f20-3360-49e4-b231-51f670434655 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:59.876134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134f20-3360-49e4-b231-51f670434655 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:59.877033 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d134f20-3360-49e4-b231-51f670434655 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:59.879009 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d134f20-3360-49e4-b231-51f670434655 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:59.886032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa8de4-a015-461f-895e-14799af3ed71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:59.887137 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa8de4-a015-461f-895e-14799af3ed71 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:59.887521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa8de4-a015-461f-895e-14799af3ed71 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:59.887911 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa8de4-a015-461f-895e-14799af3ed71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:59.889016 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa8de4-a015-461f-895e-14799af3ed71 None admin] RBAC: Adding query filter params (role.id=04b89a35fc5442af92047f11f75d7b14, scope.project.id=3afdead5472b467db04217214f5e5d38, user.id=6c00a943c52a48299d08f42c54466487) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:11:59.889864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa8de4-a015-461f-895e-14799af3ed71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:59.892303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa8de4-a015-461f-895e-14799af3ed71 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:59.902722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 42/87] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:11:59 2022] GET /identity/v3/role_assignments?user.id=6c00a943c52a48299d08f42c54466487&scope.project.id=3afdead5472b467db04217214f5e5d38&role.id=04b89a35fc5442af92047f11f75d7b14 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:11:59.904196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa8de4-a015-461f-895e-14799af3ed71 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:59.946852 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 46/88] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:11:59 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:11:59.946852 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d134f20-3360-49e4-b231-51f670434655 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:00.051889 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:00.060068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa8de4-a015-461f-895e-14799af3ed71 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:00.075456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:00.107054 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17446cd4-a90f-42eb-a434-b8eab979d416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:00.107840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446cd4-a90f-42eb-a434-b8eab979d416 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:00.108198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446cd4-a90f-42eb-a434-b8eab979d416 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:00.108549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446cd4-a90f-42eb-a434-b8eab979d416 None admin] PATH_INFO: `/v3/users/6c00a943c52a48299d08f42c54466487` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:00.110066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17446cd4-a90f-42eb-a434-b8eab979d416 None admin] RBAC: Authorizing `identity:get_user(user_id=6c00a943c52a48299d08f42c54466487)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:00.112420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17446cd4-a90f-42eb-a434-b8eab979d416 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:00.114088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 43/89] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:11:59 2022] GET /identity/v3/users/6c00a943c52a48299d08f42c54466487 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:00.115196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17446cd4-a90f-42eb-a434-b8eab979d416 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:00.132157 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d134f20-3360-49e4-b231-51f670434655 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:00.192035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b982be-f37b-45ec-927e-5e7f1501df6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:00.194515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b982be-f37b-45ec-927e-5e7f1501df6f None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:00.195388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b982be-f37b-45ec-927e-5e7f1501df6f None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:00.196275 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b982be-f37b-45ec-927e-5e7f1501df6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:00.286689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17446cd4-a90f-42eb-a434-b8eab979d416 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:00.316216 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b982be-f37b-45ec-927e-5e7f1501df6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:00.318064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b982be-f37b-45ec-927e-5e7f1501df6f None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:00.355087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1bd8d-f5d8-4138-b1fd-650759b608ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:00.356524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1bd8d-f5d8-4138-b1fd-650759b608ac None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:00.357043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1bd8d-f5d8-4138-b1fd-650759b608ac None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:00.357737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1bd8d-f5d8-4138-b1fd-650759b608ac None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:00.359938 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1bd8d-f5d8-4138-b1fd-650759b608ac None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:00.361770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1bd8d-f5d8-4138-b1fd-650759b608ac None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:00.364757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 44/90] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:00 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:00.366341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1bd8d-f5d8-4138-b1fd-650759b608ac None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:00.418456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:00.426352 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:00.469531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 47/91] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:00.471009 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b982be-f37b-45ec-927e-5e7f1501df6f None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:00.539426 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1bd8d-f5d8-4138-b1fd-650759b608ac None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:00.594744 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d81b20-beff-4045-a0de-6c4dbf750eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:00.595465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d81b20-beff-4045-a0de-6c4dbf750eca None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:00.595738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d81b20-beff-4045-a0de-6c4dbf750eca None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:00.596016 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d81b20-beff-4045-a0de-6c4dbf750eca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:00.672196 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b982be-f37b-45ec-927e-5e7f1501df6f None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:00.722457 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca0f6f-9027-41ae-b20a-29caf5653583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:00.723154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca0f6f-9027-41ae-b20a-29caf5653583 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:00.723433 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca0f6f-9027-41ae-b20a-29caf5653583 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:00.723710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca0f6f-9027-41ae-b20a-29caf5653583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:00.724519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca0f6f-9027-41ae-b20a-29caf5653583 None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=3afdead5472b467db04217214f5e5d38, user.id=b49c0d97d3434e41bf484d267b0b8e0e) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:00.724882 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca0f6f-9027-41ae-b20a-29caf5653583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:00.726682 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca0f6f-9027-41ae-b20a-29caf5653583 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:00.738936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 48/92] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:00 2022] GET /identity/v3/role_assignments?user.id=b49c0d97d3434e41bf484d267b0b8e0e&scope.project.id=3afdead5472b467db04217214f5e5d38&role.id=169d11e171d04c87af71475295957618 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:00.739713 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca0f6f-9027-41ae-b20a-29caf5653583 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:00.746396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d81b20-beff-4045-a0de-6c4dbf750eca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:00.749680 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d81b20-beff-4045-a0de-6c4dbf750eca None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:00.828355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:00.836331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:00.978363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca0f6f-9027-41ae-b20a-29caf5653583 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:00.978926 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 45/93] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:00.984891 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d81b20-beff-4045-a0de-6c4dbf750eca None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:01.048662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2509e-c97a-4380-8ebb-dd5a67f3125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:01.049821 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2509e-c97a-4380-8ebb-dd5a67f3125a None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:01.050117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2509e-c97a-4380-8ebb-dd5a67f3125a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:01.050396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2509e-c97a-4380-8ebb-dd5a67f3125a None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:01.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2509e-c97a-4380-8ebb-dd5a67f3125a None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:01.053985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2509e-c97a-4380-8ebb-dd5a67f3125a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:01.055907 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 49/94] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:00 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:01.063407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2509e-c97a-4380-8ebb-dd5a67f3125a None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:01.172442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d81b20-beff-4045-a0de-6c4dbf750eca None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:01.218569 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:01.225847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c07f9-8a34-41bc-a891-1696402f5aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:01.226635 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c07f9-8a34-41bc-a891-1696402f5aae None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:01.227109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c07f9-8a34-41bc-a891-1696402f5aae None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:01.227457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c07f9-8a34-41bc-a891-1696402f5aae None admin] PATH_INFO: `/v3/projects/cc1d5b05b1f6476f892e6235359d6104` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:01.228700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c07f9-8a34-41bc-a891-1696402f5aae None admin] RBAC: Authorizing `identity:get_project(project_id=cc1d5b05b1f6476f892e6235359d6104)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:01.230727 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c07f9-8a34-41bc-a891-1696402f5aae None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:01.233430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 46/95] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:00 2022] GET /identity/v3/projects/cc1d5b05b1f6476f892e6235359d6104 => generated 312 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:01.240370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c07f9-8a34-41bc-a891-1696402f5aae None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:01.303811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2509e-c97a-4380-8ebb-dd5a67f3125a None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:01.307631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:01.396866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22824c32-565b-4c2d-b978-344e785cd46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:01.397517 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22824c32-565b-4c2d-b978-344e785cd46f None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:01.397795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22824c32-565b-4c2d-b978-344e785cd46f None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:01.398089 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22824c32-565b-4c2d-b978-344e785cd46f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:01.398878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22824c32-565b-4c2d-b978-344e785cd46f None admin] RBAC: Adding query filter params (role.id=6b72aeaf7c3646bdb33b40a371cc4d44, scope.project.id=3afdead5472b467db04217214f5e5d38, user.id=6c00a943c52a48299d08f42c54466487) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:01.399220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22824c32-565b-4c2d-b978-344e785cd46f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:01.413277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22824c32-565b-4c2d-b978-344e785cd46f None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:01.426068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 50/96] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:01 2022] GET /identity/v3/role_assignments?user.id=6c00a943c52a48299d08f42c54466487&scope.project.id=3afdead5472b467db04217214f5e5d38&role.id=6b72aeaf7c3646bdb33b40a371cc4d44 => generated 259 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:01.485524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c07f9-8a34-41bc-a891-1696402f5aae None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:01.533569 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5a298-c10f-4e07-8d23-4b9a1ad27c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:01.534323 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5a298-c10f-4e07-8d23-4b9a1ad27c42 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:01.534643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5a298-c10f-4e07-8d23-4b9a1ad27c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:01.539010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5a298-c10f-4e07-8d23-4b9a1ad27c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:01.539825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5a298-c10f-4e07-8d23-4b9a1ad27c42 None admin] RBAC: Adding query filter params (role.id=04b89a35fc5442af92047f11f75d7b14, scope.project.id=cc1d5b05b1f6476f892e6235359d6104, user.id=6c00a943c52a48299d08f42c54466487) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:01.540358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5a298-c10f-4e07-8d23-4b9a1ad27c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:01.541789 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5a298-c10f-4e07-8d23-4b9a1ad27c42 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:01.548818 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 47/97] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:01 2022] GET /identity/v3/role_assignments?user.id=6c00a943c52a48299d08f42c54466487&scope.project.id=cc1d5b05b1f6476f892e6235359d6104&role.id=04b89a35fc5442af92047f11f75d7b14 => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:02.488402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c39b4-8905-47a2-abaa-4d5bc013dc51 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:02.488930 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c39b4-8905-47a2-abaa-4d5bc013dc51 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:02.489003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c39b4-8905-47a2-abaa-4d5bc013dc51 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:02.490467 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 51/98] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:02.499407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed4a5a-b85c-4cb6-b03a-8f287c205d3b None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:02.499752 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed4a5a-b85c-4cb6-b03a-8f287c205d3b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:02.499960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed4a5a-b85c-4cb6-b03a-8f287c205d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:02.520050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-6fed4a5a-b85c-4cb6-b03a-8f287c205d3b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:02.521273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6fed4a5a-b85c-4cb6-b03a-8f287c205d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:02.598427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:02.612705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 48/99] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:02.652637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c39b4-8905-47a2-abaa-4d5bc013dc51 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:02.791702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c39b4-8905-47a2-abaa-4d5bc013dc51 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:02.837740 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41b8de-f5df-46ee-b3cb-606bdd0dade7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:02.838475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41b8de-f5df-46ee-b3cb-606bdd0dade7 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:02.838840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41b8de-f5df-46ee-b3cb-606bdd0dade7 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:02.839115 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41b8de-f5df-46ee-b3cb-606bdd0dade7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:02.859496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41b8de-f5df-46ee-b3cb-606bdd0dade7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-dd41b8de-f5df-46ee-b3cb-606bdd0dade7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:02.865134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:02.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:02.866772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:02.866772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:02.866772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:02.866772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:02.866772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:02.866772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:02.866772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:02.866772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:02.866772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:02.866772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:02.866772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:02.866772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:02.866772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 52/100] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:02.873246 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed4a5a-b85c-4cb6-b03a-8f287c205d3b None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:02.986627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed4a5a-b85c-4cb6-b03a-8f287c205d3b None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:03.029028 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669e560-375c-4f49-8cf5-b3a966da6133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:03.029830 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669e560-375c-4f49-8cf5-b3a966da6133 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.030109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669e560-375c-4f49-8cf5-b3a966da6133 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.030380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669e560-375c-4f49-8cf5-b3a966da6133 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.031071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669e560-375c-4f49-8cf5-b3a966da6133 None admin] RBAC: Adding query filter params (name=member) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:03.031433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669e560-375c-4f49-8cf5-b3a966da6133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:03.032822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669e560-375c-4f49-8cf5-b3a966da6133 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:03.042321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 49/101] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:03.047787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41b8de-f5df-46ee-b3cb-606bdd0dade7 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:03.080967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:03.179697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41b8de-f5df-46ee-b3cb-606bdd0dade7 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:03.232750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc0d28-c6ae-4ba1-8d19-8cf312218416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:03.233412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc0d28-c6ae-4ba1-8d19-8cf312218416 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.233688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc0d28-c6ae-4ba1-8d19-8cf312218416 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.233957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc0d28-c6ae-4ba1-8d19-8cf312218416 None admin] PATH_INFO: `/v3/users/6c00a943c52a48299d08f42c54466487` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.235325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc0d28-c6ae-4ba1-8d19-8cf312218416 None admin] RBAC: Authorizing `identity:get_user(user_id=6c00a943c52a48299d08f42c54466487)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:03.236993 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc0d28-c6ae-4ba1-8d19-8cf312218416 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:03.238674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 53/102] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:03 2022] GET /identity/v3/users/6c00a943c52a48299d08f42c54466487 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:03.248064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669e560-375c-4f49-8cf5-b3a966da6133 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:03.330661 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:03.384413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669e560-375c-4f49-8cf5-b3a966da6133 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:03.440186 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bde2b-57a4-4fad-8e94-e7a2d52353c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:03.440842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bde2b-57a4-4fad-8e94-e7a2d52353c5 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.441115 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bde2b-57a4-4fad-8e94-e7a2d52353c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.441385 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bde2b-57a4-4fad-8e94-e7a2d52353c5 None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.447668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bde2b-57a4-4fad-8e94-e7a2d52353c5 None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:03.450237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bde2b-57a4-4fad-8e94-e7a2d52353c5 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:03.453643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 50/103] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:03 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:03.460075 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc0d28-c6ae-4ba1-8d19-8cf312218416 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:03.493773 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21f35-e919-41bd-9ee0-54a7f3157dc6 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.494093 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21f35-e919-41bd-9ee0-54a7f3157dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.494314 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21f35-e919-41bd-9ee0-54a7f3157dc6 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.496326 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 51/104] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:03.501980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a3294-3102-40b6-84a5-5040f53e6f82 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.502255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a3294-3102-40b6-84a5-5040f53e6f82 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.502577 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a3294-3102-40b6-84a5-5040f53e6f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.536172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-5d7a3294-3102-40b6-84a5-5040f53e6f82 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:03.537261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-5d7a3294-3102-40b6-84a5-5040f53e6f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:03.577731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:03.587561 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc0d28-c6ae-4ba1-8d19-8cf312218416 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:03.636378 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888714-bcd8-44c0-8170-3144a1bc3cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:03.637473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888714-bcd8-44c0-8170-3144a1bc3cbe None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.637951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888714-bcd8-44c0-8170-3144a1bc3cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.638418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888714-bcd8-44c0-8170-3144a1bc3cbe None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38/users/6c00a943c52a48299d08f42c54466487/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.644425 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888714-bcd8-44c0-8170-3144a1bc3cbe None admin] RBAC: Authorizing `identity:create_grant(project_id=3afdead5472b467db04217214f5e5d38, user_id=6c00a943c52a48299d08f42c54466487, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:03.646270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888714-bcd8-44c0-8170-3144a1bc3cbe None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:03.673553 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 54/105] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:12:03 2022] PUT /identity/v3/projects/3afdead5472b467db04217214f5e5d38/users/6c00a943c52a48299d08f42c54466487/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:12:03.701443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 52/106] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:03.740706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888714-bcd8-44c0-8170-3144a1bc3cbe None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:03.817292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c6609-f86a-4238-a3c4-fcfffe19dca5 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.817624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c6609-f86a-4238-a3c4-fcfffe19dca5 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.817845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c6609-f86a-4238-a3c4-fcfffe19dca5 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.819610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 53/107] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:03.824910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7d63f-c153-4df4-8400-2e578ef04e42 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.825216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7d63f-c153-4df4-8400-2e578ef04e42 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.825460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7d63f-c153-4df4-8400-2e578ef04e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.863668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-81d7d63f-c153-4df4-8400-2e578ef04e42 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:03.864854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-81d7d63f-c153-4df4-8400-2e578ef04e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:03.882112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888714-bcd8-44c0-8170-3144a1bc3cbe None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:03.925328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba51ab-93ab-4d0a-88cd-3431afafb6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:03.927255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba51ab-93ab-4d0a-88cd-3431afafb6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.927994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba51ab-93ab-4d0a-88cd-3431afafb6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.929920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba51ab-93ab-4d0a-88cd-3431afafb6b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.945474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba51ab-93ab-4d0a-88cd-3431afafb6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-d9ba51ab-93ab-4d0a-88cd-3431afafb6b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:03.951290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:03.952193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:03.952961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:03.952961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:03.952961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:03.952961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:03.952961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:03.952961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:03.952961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:03.952961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:03.952961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:03.952961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:03.952961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:03.952961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:03.955361 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 55/108] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:03.958918 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe84aa1-e6f2-4e54-8c4b-ff5c42c76cb1 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.959433 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe84aa1-e6f2-4e54-8c4b-ff5c42c76cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.959710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe84aa1-e6f2-4e54-8c4b-ff5c42c76cb1 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.961746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 56/109] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:03.966048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe84aa1-e6f2-4e54-8c4b-ff5c42c76cb1 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:03.978178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:03.991734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:04.005582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 54/110] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:04.007330 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5516a8c-e911-4504-ac9d-5fe7d8e40c6f None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:04.007836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5516a8c-e911-4504-ac9d-5fe7d8e40c6f None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:04.008338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5516a8c-e911-4504-ac9d-5fe7d8e40c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:04.049215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-a5516a8c-e911-4504-ac9d-5fe7d8e40c6f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:04.051340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a5516a8c-e911-4504-ac9d-5fe7d8e40c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:04.184458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 55/111] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:04.186286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5516a8c-e911-4504-ac9d-5fe7d8e40c6f None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:04.236307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe84aa1-e6f2-4e54-8c4b-ff5c42c76cb1 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:04.363589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc380b-0b4c-4991-8afa-791858fb3cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:04.364223 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc380b-0b4c-4991-8afa-791858fb3cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:04.364500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc380b-0b4c-4991-8afa-791858fb3cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:04.364768 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc380b-0b4c-4991-8afa-791858fb3cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:04.365451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc380b-0b4c-4991-8afa-791858fb3cd2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:04.365750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc380b-0b4c-4991-8afa-791858fb3cd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:04.367207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc380b-0b4c-4991-8afa-791858fb3cd2 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:04.382545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5516a8c-e911-4504-ac9d-5fe7d8e40c6f None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:04.388635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 57/112] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:04.389508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc380b-0b4c-4991-8afa-791858fb3cd2 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:04.411215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:04.449636 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55a421-76d6-4e03-9304-8a36ff55b786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:04.450738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55a421-76d6-4e03-9304-8a36ff55b786 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:04.451496 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55a421-76d6-4e03-9304-8a36ff55b786 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:04.452090 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55a421-76d6-4e03-9304-8a36ff55b786 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:04.454092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55a421-76d6-4e03-9304-8a36ff55b786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:04.457327 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55a421-76d6-4e03-9304-8a36ff55b786 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:04.460384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 56/113] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:04.462165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55a421-76d6-4e03-9304-8a36ff55b786 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:04.506449 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:04.548591 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc380b-0b4c-4991-8afa-791858fb3cd2 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:04.625013 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01e8af-33de-45ee-8ada-84df555e6893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:04.626382 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01e8af-33de-45ee-8ada-84df555e6893 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:04.626791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01e8af-33de-45ee-8ada-84df555e6893 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:04.627254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01e8af-33de-45ee-8ada-84df555e6893 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:04.639463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01e8af-33de-45ee-8ada-84df555e6893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-9b01e8af-33de-45ee-8ada-84df555e6893 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:04.644886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:04.646041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:04.646971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:04.646971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:04.646971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:04.646971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:04.646971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:04.646971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:04.646971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:04.646971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:04.646971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:04.646971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:04.646971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:04.646971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:04.648929 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 58/114] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:12:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:04.649910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01e8af-33de-45ee-8ada-84df555e6893 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:04.692236 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55a421-76d6-4e03-9304-8a36ff55b786 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:04.757884 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbccabe-5def-4a24-b264-20884ddef2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:04.759397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbccabe-5def-4a24-b264-20884ddef2ca None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:04.760070 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbccabe-5def-4a24-b264-20884ddef2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:04.760471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbccabe-5def-4a24-b264-20884ddef2ca None admin] PATH_INFO: `/v3/users/7d9a7bb4ca4446f9abfd16c363437df7` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:04.763093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01e8af-33de-45ee-8ada-84df555e6893 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:04.793070 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbccabe-5def-4a24-b264-20884ddef2ca None admin] RBAC: Authorizing `identity:get_user(user_id=7d9a7bb4ca4446f9abfd16c363437df7)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:04.795988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbccabe-5def-4a24-b264-20884ddef2ca None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:04.802855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 57/115] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:04 2022] GET /identity/v3/users/7d9a7bb4ca4446f9abfd16c363437df7 => generated 289 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:04.802855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a46dc-b517-411a-9d66-111dd48ee217 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:04.802855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a46dc-b517-411a-9d66-111dd48ee217 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:04.802855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a46dc-b517-411a-9d66-111dd48ee217 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:04.806839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 58/116] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:04.806839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a46dc-b517-411a-9d66-111dd48ee217 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:04.808785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eef9f-4d03-47c1-879f-79bda436d6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:04.809599 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eef9f-4d03-47c1-879f-79bda436d6bd None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:04.810156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eef9f-4d03-47c1-879f-79bda436d6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:04.810595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eef9f-4d03-47c1-879f-79bda436d6bd None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:04.811454 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eef9f-4d03-47c1-879f-79bda436d6bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:04.813225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eef9f-4d03-47c1-879f-79bda436d6bd None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:04.821039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:04.852799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 59/117] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Aug 9 11:12:04 2022] POST /identity/v3/projects => generated 302 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:12:04.854273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eef9f-4d03-47c1-879f-79bda436d6bd None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:04.895243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:04.992295 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a46dc-b517-411a-9d66-111dd48ee217 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:05.038996 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eef9f-4d03-47c1-879f-79bda436d6bd None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:05.040524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f222ba4-f7c9-447c-94e1-addd386d05b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:05.041147 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222ba4-f7c9-447c-94e1-addd386d05b4 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.041421 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222ba4-f7c9-447c-94e1-addd386d05b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.041699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222ba4-f7c9-447c-94e1-addd386d05b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.042385 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f222ba4-f7c9-447c-94e1-addd386d05b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:05.042691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f222ba4-f7c9-447c-94e1-addd386d05b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:05.044166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f222ba4-f7c9-447c-94e1-addd386d05b4 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:05.057127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 59/118] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:05.057127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d14a04-e3cc-4aa3-8b4f-7c5a707c2287 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.057127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d14a04-e3cc-4aa3-8b4f-7c5a707c2287 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.057457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d14a04-e3cc-4aa3-8b4f-7c5a707c2287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.083423 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-08d14a04-e3cc-4aa3-8b4f-7c5a707c2287 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:05.085211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-08d14a04-e3cc-4aa3-8b4f-7c5a707c2287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:05.093506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13790bf-d789-46ed-83fa-6aaedb3d200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:05.095274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13790bf-d789-46ed-83fa-6aaedb3d200e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.095274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13790bf-d789-46ed-83fa-6aaedb3d200e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.095274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13790bf-d789-46ed-83fa-6aaedb3d200e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.167146 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:05.184473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 60/119] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:05.186763 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960f891-c0ad-4904-a735-1d2985e80300 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.187083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960f891-c0ad-4904-a735-1d2985e80300 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.187356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960f891-c0ad-4904-a735-1d2985e80300 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.188633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13790bf-d789-46ed-83fa-6aaedb3d200e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:05.189026 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 61/120] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:05.190043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960f891-c0ad-4904-a735-1d2985e80300 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:05.190836 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13790bf-d789-46ed-83fa-6aaedb3d200e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:05.242903 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:05.319728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 60/121] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:05.321041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333b62f-88e6-44a9-b47d-334fa82369c0 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.321332 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333b62f-88e6-44a9-b47d-334fa82369c0 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.321639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333b62f-88e6-44a9-b47d-334fa82369c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.343767 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f333b62f-88e6-44a9-b47d-334fa82369c0 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:05.344984 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f333b62f-88e6-44a9-b47d-334fa82369c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:05.368286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960f891-c0ad-4904-a735-1d2985e80300 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:05.417561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435c472-0b0e-46ec-9721-4723f6d73894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:05.418429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435c472-0b0e-46ec-9721-4723f6d73894 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.418914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435c472-0b0e-46ec-9721-4723f6d73894 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.419372 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435c472-0b0e-46ec-9721-4723f6d73894 None admin] PATH_INFO: `/v3/users/b49c0d97d3434e41bf484d267b0b8e0e` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.420762 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435c472-0b0e-46ec-9721-4723f6d73894 None admin] RBAC: Authorizing `identity:get_user(user_id=b49c0d97d3434e41bf484d267b0b8e0e)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:05.422597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435c472-0b0e-46ec-9721-4723f6d73894 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:05.425246 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 62/122] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:05 2022] GET /identity/v3/users/b49c0d97d3434e41bf484d267b0b8e0e => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:05.426161 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435c472-0b0e-46ec-9721-4723f6d73894 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:05.433312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 61/123] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:05.434271 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333b62f-88e6-44a9-b47d-334fa82369c0 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:05.457099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:05.552703 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333b62f-88e6-44a9-b47d-334fa82369c0 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:05.566553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:05.570247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435c472-0b0e-46ec-9721-4723f6d73894 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:05.592926 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3d885-44f7-41c0-b01c-67a20ad03e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:05.593928 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3d885-44f7-41c0-b01c-67a20ad03e83 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.594453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3d885-44f7-41c0-b01c-67a20ad03e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.594955 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3d885-44f7-41c0-b01c-67a20ad03e83 None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.596544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3d885-44f7-41c0-b01c-67a20ad03e83 None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:05.598503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3d885-44f7-41c0-b01c-67a20ad03e83 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:05.600601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 62/124] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:05 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:05.601859 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3d885-44f7-41c0-b01c-67a20ad03e83 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:05.609937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a970ac-a3eb-40c1-9a7f-1524c968612b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:05.610594 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a970ac-a3eb-40c1-9a7f-1524c968612b None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.610908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a970ac-a3eb-40c1-9a7f-1524c968612b None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.611188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a970ac-a3eb-40c1-9a7f-1524c968612b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.624116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a970ac-a3eb-40c1-9a7f-1524c968612b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-69a970ac-a3eb-40c1-9a7f-1524c968612b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:05.629685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:05.630625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:05.632053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:05.632053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:05.632053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:05.632053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:05.632053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:05.632053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:05.632053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:05.632053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:05.632053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:05.632053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:05.632053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:05.632053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:05.632053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 63/125] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:12:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:05.632717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a970ac-a3eb-40c1-9a7f-1524c968612b None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:05.707487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:05.726897 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3d885-44f7-41c0-b01c-67a20ad03e83 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:05.751714 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a970ac-a3eb-40c1-9a7f-1524c968612b None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:05.767582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2761da-3885-403b-8ee6-1263a58aa0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:05.768803 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2761da-3885-403b-8ee6-1263a58aa0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.769351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2761da-3885-403b-8ee6-1263a58aa0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.769826 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2761da-3885-403b-8ee6-1263a58aa0e5 None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.771331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2761da-3885-403b-8ee6-1263a58aa0e5 None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:05.773306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2761da-3885-403b-8ee6-1263a58aa0e5 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:05.775372 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 63/126] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:05 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:05.776517 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2761da-3885-403b-8ee6-1263a58aa0e5 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:05.791232 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e623acc-87b4-4977-b54d-08913024d036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:05.791914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e623acc-87b4-4977-b54d-08913024d036 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.792166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e623acc-87b4-4977-b54d-08913024d036 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.792439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e623acc-87b4-4977-b54d-08913024d036 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.804371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e623acc-87b4-4977-b54d-08913024d036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-4e623acc-87b4-4977-b54d-08913024d036 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:05.809666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:05.810627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:05.811866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:05.811866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:05.811866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:05.811866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:05.811866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:05.811866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:05.811866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:05.811866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:05.811866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:05.811866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:05.811866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:05.811866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:05.815018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 64/127] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:05.816060 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e623acc-87b4-4977-b54d-08913024d036 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:05.842503 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:05.898726 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2761da-3885-403b-8ee6-1263a58aa0e5 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:05.930441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e623acc-87b4-4977-b54d-08913024d036 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:05.937546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc33015-fc6b-4cfb-8dea-18eea37856cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:05.938535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc33015-fc6b-4cfb-8dea-18eea37856cd None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.939184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc33015-fc6b-4cfb-8dea-18eea37856cd None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.939676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc33015-fc6b-4cfb-8dea-18eea37856cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.940723 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc33015-fc6b-4cfb-8dea-18eea37856cd None admin] RBAC: Adding query filter params (role.id=b8a55f2fb9954ee99b8328fec6560de4, scope.project.id=3afdead5472b467db04217214f5e5d38, user.id=7d9a7bb4ca4446f9abfd16c363437df7) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:05.941251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc33015-fc6b-4cfb-8dea-18eea37856cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:05.943125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc33015-fc6b-4cfb-8dea-18eea37856cd None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:05.949867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 64/128] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:05 2022] GET /identity/v3/role_assignments?user.id=7d9a7bb4ca4446f9abfd16c363437df7&scope.project.id=3afdead5472b467db04217214f5e5d38&role.id=b8a55f2fb9954ee99b8328fec6560de4 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:05.951310 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc33015-fc6b-4cfb-8dea-18eea37856cd None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:05.971261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8840f24-0155-447f-97da-5cac036a354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:05.971947 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8840f24-0155-447f-97da-5cac036a354c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.972229 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8840f24-0155-447f-97da-5cac036a354c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.972507 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8840f24-0155-447f-97da-5cac036a354c None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.973205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8840f24-0155-447f-97da-5cac036a354c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:05.973549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8840f24-0155-447f-97da-5cac036a354c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:05.975038 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8840f24-0155-447f-97da-5cac036a354c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:05.977248 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:05.986759 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 65/129] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:05.987779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8840f24-0155-447f-97da-5cac036a354c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:06.076301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc33015-fc6b-4cfb-8dea-18eea37856cd None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:06.084764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:06.107111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8840f24-0155-447f-97da-5cac036a354c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:06.121829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f7186-5442-459b-87d0-2950c953bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:06.123022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f7186-5442-459b-87d0-2950c953bc3c None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:06.123519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f7186-5442-459b-87d0-2950c953bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:06.124070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f7186-5442-459b-87d0-2950c953bc3c None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38/users/b49c0d97d3434e41bf484d267b0b8e0e/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:06.126435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f7186-5442-459b-87d0-2950c953bc3c None admin] RBAC: Authorizing `identity:create_grant(project_id=3afdead5472b467db04217214f5e5d38, user_id=b49c0d97d3434e41bf484d267b0b8e0e, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:06.128455 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f7186-5442-459b-87d0-2950c953bc3c None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:06.148782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 65/130] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:12:05 2022] PUT /identity/v3/projects/3afdead5472b467db04217214f5e5d38/users/b49c0d97d3434e41bf484d267b0b8e0e/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:12:06.150274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f7186-5442-459b-87d0-2950c953bc3c None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:06.150839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf16af-ca61-4b69-a2c5-847092b37606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:06.151724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf16af-ca61-4b69-a2c5-847092b37606 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:06.152066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf16af-ca61-4b69-a2c5-847092b37606 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:06.152470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf16af-ca61-4b69-a2c5-847092b37606 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:06.153355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf16af-ca61-4b69-a2c5-847092b37606 None admin] RBAC: Adding query filter params (name=member) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:06.153671 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf16af-ca61-4b69-a2c5-847092b37606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:06.155573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf16af-ca61-4b69-a2c5-847092b37606 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:06.177829 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 66/131] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:06.184407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf16af-ca61-4b69-a2c5-847092b37606 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:06.271255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:06.347106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f7186-5442-459b-87d0-2950c953bc3c None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:06.370421 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf16af-ca61-4b69-a2c5-847092b37606 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:06.417609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2ae7e-da30-4a69-b8b7-819ec2b1d54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:06.418264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2ae7e-da30-4a69-b8b7-819ec2b1d54e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:06.418542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2ae7e-da30-4a69-b8b7-819ec2b1d54e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:06.418840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2ae7e-da30-4a69-b8b7-819ec2b1d54e None admin] PATH_INFO: `/v3/users/6c00a943c52a48299d08f42c54466487` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:06.421800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2ae7e-da30-4a69-b8b7-819ec2b1d54e None admin] RBAC: Authorizing `identity:get_user(user_id=6c00a943c52a48299d08f42c54466487)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:06.423333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2ae7e-da30-4a69-b8b7-819ec2b1d54e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:06.431887 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 67/132] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:06 2022] GET /identity/v3/users/6c00a943c52a48299d08f42c54466487 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:06.432585 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881a65e-a081-4d74-81e8-689118e709f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:06.433282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881a65e-a081-4d74-81e8-689118e709f4 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:06.433610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881a65e-a081-4d74-81e8-689118e709f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:06.433890 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881a65e-a081-4d74-81e8-689118e709f4 None admin] PATH_INFO: `/v3/users/6c00a943c52a48299d08f42c54466487` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:06.435300 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881a65e-a081-4d74-81e8-689118e709f4 None admin] RBAC: Authorizing `identity:get_user(user_id=6c00a943c52a48299d08f42c54466487)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:06.436808 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881a65e-a081-4d74-81e8-689118e709f4 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:06.438605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 66/133] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:06 2022] GET /identity/v3/users/6c00a943c52a48299d08f42c54466487 => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:06.444441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2ae7e-da30-4a69-b8b7-819ec2b1d54e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:06.460828 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881a65e-a081-4d74-81e8-689118e709f4 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:06.476242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:06.604335 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2ae7e-da30-4a69-b8b7-819ec2b1d54e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:06.626403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881a65e-a081-4d74-81e8-689118e709f4 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:06.683212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a834c3-886a-4ed5-8b5f-1ca375946e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:06.684293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a834c3-886a-4ed5-8b5f-1ca375946e5f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:06.684738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a834c3-886a-4ed5-8b5f-1ca375946e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:06.685200 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a834c3-886a-4ed5-8b5f-1ca375946e5f None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:06.688918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a834c3-886a-4ed5-8b5f-1ca375946e5f None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:06.690883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a834c3-886a-4ed5-8b5f-1ca375946e5f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:06.692868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 68/134] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:06 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:06.694642 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fbf8-7e86-4207-9e62-084f531eb8ce None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:06.695243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fbf8-7e86-4207-9e62-084f531eb8ce None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:06.695708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fbf8-7e86-4207-9e62-084f531eb8ce None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:06.702984 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 69/135] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:06.704194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49fbf8-7e86-4207-9e62-084f531eb8ce None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:06.704631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae854ff-4417-4aac-9b63-a244e9891a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:06.705856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae854ff-4417-4aac-9b63-a244e9891a18 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:06.706418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae854ff-4417-4aac-9b63-a244e9891a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:06.707098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae854ff-4417-4aac-9b63-a244e9891a18 None admin] PATH_INFO: `/v3/projects/cc1d5b05b1f6476f892e6235359d6104` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:06.715120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae854ff-4417-4aac-9b63-a244e9891a18 None admin] RBAC: Authorizing `identity:get_project(project_id=cc1d5b05b1f6476f892e6235359d6104)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:06.717877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae854ff-4417-4aac-9b63-a244e9891a18 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:06.722055 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 67/136] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:06 2022] GET /identity/v3/projects/cc1d5b05b1f6476f892e6235359d6104 => generated 312 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:06.724992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85306c-23dd-4b3c-bf9b-cb55c37338fb None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:06.725489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85306c-23dd-4b3c-bf9b-cb55c37338fb None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:06.725980 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85306c-23dd-4b3c-bf9b-cb55c37338fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:06.763224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-9c85306c-23dd-4b3c-bf9b-cb55c37338fb None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:06.765322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9c85306c-23dd-4b3c-bf9b-cb55c37338fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:06.787195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:06.904440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 68/137] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:06.906301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85306c-23dd-4b3c-bf9b-cb55c37338fb None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:06.985379 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:07.012475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49fbf8-7e86-4207-9e62-084f531eb8ce None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:07.087953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0116476-b459-43bc-aa09-d970c4b0db70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:07.089001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0116476-b459-43bc-aa09-d970c4b0db70 None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:07.089323 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0116476-b459-43bc-aa09-d970c4b0db70 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:07.089703 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0116476-b459-43bc-aa09-d970c4b0db70 None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38/users/6c00a943c52a48299d08f42c54466487/roles/6b72aeaf7c3646bdb33b40a371cc4d44` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:07.097638 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0116476-b459-43bc-aa09-d970c4b0db70 None admin] RBAC: Authorizing `identity:create_grant(project_id=3afdead5472b467db04217214f5e5d38, user_id=6c00a943c52a48299d08f42c54466487, role_id=6b72aeaf7c3646bdb33b40a371cc4d44)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:07.100207 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0116476-b459-43bc-aa09-d970c4b0db70 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:07.135907 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 70/138] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:12:06 2022] PUT /identity/v3/projects/3afdead5472b467db04217214f5e5d38/users/6c00a943c52a48299d08f42c54466487/roles/6b72aeaf7c3646bdb33b40a371cc4d44 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:12:07.139089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0116476-b459-43bc-aa09-d970c4b0db70 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:07.168835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85306c-23dd-4b3c-bf9b-cb55c37338fb None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:07.344613 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee368d64-cbe7-4089-b869-c8b12388a6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:07.345766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee368d64-cbe7-4089-b869-c8b12388a6d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:07.346246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee368d64-cbe7-4089-b869-c8b12388a6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:07.346828 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee368d64-cbe7-4089-b869-c8b12388a6d6 None admin] PATH_INFO: `/v3/projects/cc1d5b05b1f6476f892e6235359d6104/users/6c00a943c52a48299d08f42c54466487/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:07.352934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee368d64-cbe7-4089-b869-c8b12388a6d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc1d5b05b1f6476f892e6235359d6104, user_id=6c00a943c52a48299d08f42c54466487, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:07.358380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee368d64-cbe7-4089-b869-c8b12388a6d6 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:07.384170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 69/139] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:12:06 2022] PUT /identity/v3/projects/cc1d5b05b1f6476f892e6235359d6104/users/6c00a943c52a48299d08f42c54466487/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:12:07.385528 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730c56d-c507-43d1-ad31-d3f84d556557 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:07.385892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730c56d-c507-43d1-ad31-d3f84d556557 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:07.386211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730c56d-c507-43d1-ad31-d3f84d556557 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:07.391198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 70/140] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:07.394396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1b2a5-45cd-4dcf-877a-8ed093228227 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:07.394678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1b2a5-45cd-4dcf-877a-8ed093228227 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:07.395436 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1b2a5-45cd-4dcf-877a-8ed093228227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:07.404479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:07.422071 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-e3c1b2a5-45cd-4dcf-877a-8ed093228227 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:07.423280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e3c1b2a5-45cd-4dcf-877a-8ed093228227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:07.481945 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0116476-b459-43bc-aa09-d970c4b0db70 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:07.509858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 71/141] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:07.536507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1b2a5-45cd-4dcf-877a-8ed093228227 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:07.555013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235ff86-38e4-49cd-b9e1-527f3f70be36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:07.556134 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235ff86-38e4-49cd-b9e1-527f3f70be36 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:07.556628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235ff86-38e4-49cd-b9e1-527f3f70be36 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:07.557113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235ff86-38e4-49cd-b9e1-527f3f70be36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:07.584174 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:07.588575 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235ff86-38e4-49cd-b9e1-527f3f70be36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-8235ff86-38e4-49cd-b9e1-527f3f70be36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:07.604511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:07.605457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:07.606237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:07.606237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:07.606237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:07.606237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:07.606237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:07.606237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:07.606237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:07.606237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:07.606237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:07.606237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:07.606237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:07.606237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:07.607381 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 71/142] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 470 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:07.617199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235ff86-38e4-49cd-b9e1-527f3f70be36 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:07.666876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1b2a5-45cd-4dcf-877a-8ed093228227 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:07.708928 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fd619-b5df-42c4-be6f-b3006cf8a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:07.709644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fd619-b5df-42c4-be6f-b3006cf8a3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:07.710034 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fd619-b5df-42c4-be6f-b3006cf8a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:07.710323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fd619-b5df-42c4-be6f-b3006cf8a3d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:07.711685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fd619-b5df-42c4-be6f-b3006cf8a3d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:07.713185 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fd619-b5df-42c4-be6f-b3006cf8a3d9 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:07.714975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 72/143] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:07.721206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fd619-b5df-42c4-be6f-b3006cf8a3d9 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:07.724505 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:07.846995 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fd619-b5df-42c4-be6f-b3006cf8a3d9 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:07.887234 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fba0d-2260-4fac-8ed8-e41f7ae7f682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:07.887881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fba0d-2260-4fac-8ed8-e41f7ae7f682 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:07.888155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fba0d-2260-4fac-8ed8-e41f7ae7f682 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:07.888427 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fba0d-2260-4fac-8ed8-e41f7ae7f682 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:07.889099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fba0d-2260-4fac-8ed8-e41f7ae7f682 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:07.890587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fba0d-2260-4fac-8ed8-e41f7ae7f682 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:07.895411 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235ff86-38e4-49cd-b9e1-527f3f70be36 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:07.922583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 73/144] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:12:07 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:12:07.968148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eef104-1aef-474b-aec4-27739d1725c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:07.968708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eef104-1aef-474b-aec4-27739d1725c3 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:07.968980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eef104-1aef-474b-aec4-27739d1725c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:07.969245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eef104-1aef-474b-aec4-27739d1725c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:07.969929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eef104-1aef-474b-aec4-27739d1725c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:07.970231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eef104-1aef-474b-aec4-27739d1725c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:07.971823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eef104-1aef-474b-aec4-27739d1725c3 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:07.988836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 72/145] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:07.997746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fba0d-2260-4fac-8ed8-e41f7ae7f682 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:08.080775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:08.138923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fba0d-2260-4fac-8ed8-e41f7ae7f682 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:08.177842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378719d8-ab54-480b-847b-e61b4c037fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:08.178517 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378719d8-ab54-480b-847b-e61b4c037fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:08.178796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378719d8-ab54-480b-847b-e61b4c037fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:08.179102 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378719d8-ab54-480b-847b-e61b4c037fc5 None admin] PATH_INFO: `/v3/users/6c00a943c52a48299d08f42c54466487` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:08.180434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378719d8-ab54-480b-847b-e61b4c037fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=6c00a943c52a48299d08f42c54466487)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:08.181962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378719d8-ab54-480b-847b-e61b4c037fc5 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:08.184240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 74/146] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:07 2022] GET /identity/v3/users/6c00a943c52a48299d08f42c54466487 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:08.192515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eef104-1aef-474b-aec4-27739d1725c3 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:08.286799 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:08.356283 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eef104-1aef-474b-aec4-27739d1725c3 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:08.416084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d514e0-92e8-4dc9-b674-386aeec5ecb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:08.416765 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d514e0-92e8-4dc9-b674-386aeec5ecb3 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:08.417204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d514e0-92e8-4dc9-b674-386aeec5ecb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:08.417677 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d514e0-92e8-4dc9-b674-386aeec5ecb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:08.561849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d514e0-92e8-4dc9-b674-386aeec5ecb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:08.564260 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d514e0-92e8-4dc9-b674-386aeec5ecb3 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:08.690238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:08.766121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 73/147] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:08.774313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378719d8-ab54-480b-847b-e61b4c037fc5 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:08.887493 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378719d8-ab54-480b-847b-e61b4c037fc5 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:08.916532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:08.927175 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbcb39-e19e-412e-8dc1-9e46f8b393cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:08.927883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbcb39-e19e-412e-8dc1-9e46f8b393cb None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:08.928156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbcb39-e19e-412e-8dc1-9e46f8b393cb None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:08.928424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbcb39-e19e-412e-8dc1-9e46f8b393cb None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:08.929739 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbcb39-e19e-412e-8dc1-9e46f8b393cb None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:08.931276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbcb39-e19e-412e-8dc1-9e46f8b393cb None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:08.933004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 75/148] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:08 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:08.939321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d514e0-92e8-4dc9-b674-386aeec5ecb3 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:08.950232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e0435-4676-4cb0-b87f-f18d64f7b10c None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:08.950526 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e0435-4676-4cb0-b87f-f18d64f7b10c None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:08.950750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e0435-4676-4cb0-b87f-f18d64f7b10c None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:08.954118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 76/149] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:08.961325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d9cb-e7d9-4b89-acfa-d3b1b06c41c8 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:08.961601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d9cb-e7d9-4b89-acfa-d3b1b06c41c8 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:08.961847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d9cb-e7d9-4b89-acfa-d3b1b06c41c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:08.991972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b868d9cb-e7d9-4b89-acfa-d3b1b06c41c8 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:08.993420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b868d9cb-e7d9-4b89-acfa-d3b1b06c41c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:09.080190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 77/150] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:09.096910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d514e0-92e8-4dc9-b674-386aeec5ecb3 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:09.119504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868d9cb-e7d9-4b89-acfa-d3b1b06c41c8 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:09.194651 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bde0f3-63dd-49c8-a909-cf8a0a7677ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:09.195219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bde0f3-63dd-49c8-a909-cf8a0a7677ec None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:09.195492 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bde0f3-63dd-49c8-a909-cf8a0a7677ec None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:09.195756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bde0f3-63dd-49c8-a909-cf8a0a7677ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:09.196500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bde0f3-63dd-49c8-a909-cf8a0a7677ec None admin] RBAC: Adding query filter params (role.id=04b89a35fc5442af92047f11f75d7b14, scope.project.id=3afdead5472b467db04217214f5e5d38, user.id=6c00a943c52a48299d08f42c54466487) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:09.197729 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bde0f3-63dd-49c8-a909-cf8a0a7677ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:09.199520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bde0f3-63dd-49c8-a909-cf8a0a7677ec None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:09.215452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 74/151] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:08 2022] GET /identity/v3/role_assignments?user.id=6c00a943c52a48299d08f42c54466487&scope.project.id=3afdead5472b467db04217214f5e5d38&role.id=04b89a35fc5442af92047f11f75d7b14 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:09.323331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868d9cb-e7d9-4b89-acfa-d3b1b06c41c8 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:09.353581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:09.366854 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca678308-171d-4039-a078-fafb4b5efe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:09.367508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca678308-171d-4039-a078-fafb4b5efe14 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:09.367775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca678308-171d-4039-a078-fafb4b5efe14 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:09.368040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca678308-171d-4039-a078-fafb4b5efe14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:09.383663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca678308-171d-4039-a078-fafb4b5efe14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-ca678308-171d-4039-a078-fafb4b5efe14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:09.388671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:09.389628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:09.390422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:09.390422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:09.390422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:09.390422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:09.390422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:09.390422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:09.390422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:09.390422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:09.390422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:09.390422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:09.390422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:09.390422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:09.390422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 78/152] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:09.396234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bde0f3-63dd-49c8-a909-cf8a0a7677ec None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:09.428583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853a8aa-77c7-475f-bb18-878a7fe14ea0 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:09.428895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853a8aa-77c7-475f-bb18-878a7fe14ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:09.429117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853a8aa-77c7-475f-bb18-878a7fe14ea0 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:09.430599 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 79/153] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:09.436784 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:09.442983 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8fa94-b9ba-4c40-b869-2246a4147dbf None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:09.443327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8fa94-b9ba-4c40-b869-2246a4147dbf None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:09.443520 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8fa94-b9ba-4c40-b869-2246a4147dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:09.482298 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-81f8fa94-b9ba-4c40-b869-2246a4147dbf None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:09.486845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-81f8fa94-b9ba-4c40-b869-2246a4147dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:09.629133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bde0f3-63dd-49c8-a909-cf8a0a7677ec None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:09.651268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 80/154] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:09.691896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8fa94-b9ba-4c40-b869-2246a4147dbf None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:09.704826 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a30fa1-0d23-4213-b76d-e14f84e7cdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:09.705445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30fa1-0d23-4213-b76d-e14f84e7cdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:09.705746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30fa1-0d23-4213-b76d-e14f84e7cdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:09.706002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30fa1-0d23-4213-b76d-e14f84e7cdb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:09.706676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a30fa1-0d23-4213-b76d-e14f84e7cdb2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:09.706996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a30fa1-0d23-4213-b76d-e14f84e7cdb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:09.708386 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a30fa1-0d23-4213-b76d-e14f84e7cdb2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:09.725023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 75/155] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:09.731141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a30fa1-0d23-4213-b76d-e14f84e7cdb2 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:09.939470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:09.962298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a30fa1-0d23-4213-b76d-e14f84e7cdb2 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:10.033488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8fa94-b9ba-4c40-b869-2246a4147dbf None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:10.083868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:10.099595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b4210-618c-4b01-9411-c8ce6a94bfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:10.100946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b4210-618c-4b01-9411-c8ce6a94bfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:10.101417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b4210-618c-4b01-9411-c8ce6a94bfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:10.101901 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b4210-618c-4b01-9411-c8ce6a94bfe1 None admin] PATH_INFO: `/v3/users/7d9a7bb4ca4446f9abfd16c363437df7` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:10.103467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b4210-618c-4b01-9411-c8ce6a94bfe1 None admin] RBAC: Authorizing `identity:get_user(user_id=7d9a7bb4ca4446f9abfd16c363437df7)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:10.105227 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b4210-618c-4b01-9411-c8ce6a94bfe1 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:10.107222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 76/156] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:09 2022] GET /identity/v3/users/7d9a7bb4ca4446f9abfd16c363437df7 => generated 289 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:10.113037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b4210-618c-4b01-9411-c8ce6a94bfe1 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:10.143801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9e8d9-1922-4c44-ad98-fc130fc75059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:10.144915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9e8d9-1922-4c44-ad98-fc130fc75059 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:10.146082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9e8d9-1922-4c44-ad98-fc130fc75059 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:10.146569 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9e8d9-1922-4c44-ad98-fc130fc75059 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:10.179461 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9e8d9-1922-4c44-ad98-fc130fc75059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-7bb9e8d9-1922-4c44-ad98-fc130fc75059 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:10.195215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:10.196344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:10.197201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:10.197201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:10.197201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:10.197201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:10.197201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:10.197201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:10.197201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:10.197201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:10.197201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:10.197201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:10.197201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:10.197201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:10.197798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 81/157] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:12:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 507 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:10.212488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9e8d9-1922-4c44-ad98-fc130fc75059 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:10.343817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b4210-618c-4b01-9411-c8ce6a94bfe1 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:10.407178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89cdf8-5355-4ac0-94d6-025746d80b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:10.408089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89cdf8-5355-4ac0-94d6-025746d80b65 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:10.408597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89cdf8-5355-4ac0-94d6-025746d80b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:10.409131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89cdf8-5355-4ac0-94d6-025746d80b65 None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:10.415739 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89cdf8-5355-4ac0-94d6-025746d80b65 None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:10.417605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89cdf8-5355-4ac0-94d6-025746d80b65 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:10.419661 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 77/158] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:10 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:10.425834 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89cdf8-5355-4ac0-94d6-025746d80b65 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:10.475045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:10.479875 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9e8d9-1922-4c44-ad98-fc130fc75059 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:10.579609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c780428-64f4-4025-b506-04297d9a290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:10.580384 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c780428-64f4-4025-b506-04297d9a290b None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:10.580668 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c780428-64f4-4025-b506-04297d9a290b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:10.581053 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c780428-64f4-4025-b506-04297d9a290b None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:10.582261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c780428-64f4-4025-b506-04297d9a290b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:10.582792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c780428-64f4-4025-b506-04297d9a290b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:10.585201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c780428-64f4-4025-b506-04297d9a290b None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:10.612738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 82/159] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:10.633642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c780428-64f4-4025-b506-04297d9a290b None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:10.636412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89cdf8-5355-4ac0-94d6-025746d80b65 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:10.717022 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e802e0-452c-4b0a-a36c-6d75535ff5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:10.717710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e802e0-452c-4b0a-a36c-6d75535ff5ee None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:10.717998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e802e0-452c-4b0a-a36c-6d75535ff5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:10.718253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e802e0-452c-4b0a-a36c-6d75535ff5ee None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38/users/7d9a7bb4ca4446f9abfd16c363437df7/roles/b8a55f2fb9954ee99b8328fec6560de4` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:10.724292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e802e0-452c-4b0a-a36c-6d75535ff5ee None admin] RBAC: Authorizing `identity:create_grant(project_id=3afdead5472b467db04217214f5e5d38, user_id=7d9a7bb4ca4446f9abfd16c363437df7, role_id=b8a55f2fb9954ee99b8328fec6560de4)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:10.725850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e802e0-452c-4b0a-a36c-6d75535ff5ee None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:10.749111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 78/160] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:12:10 2022] PUT /identity/v3/projects/3afdead5472b467db04217214f5e5d38/users/7d9a7bb4ca4446f9abfd16c363437df7/roles/b8a55f2fb9954ee99b8328fec6560de4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:12:10.769109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:10.916977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c780428-64f4-4025-b506-04297d9a290b None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:11.010524 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519941ef-35b7-4f54-849c-2f246e07f129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:11.011509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519941ef-35b7-4f54-849c-2f246e07f129 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:11.011970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519941ef-35b7-4f54-849c-2f246e07f129 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:11.012425 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519941ef-35b7-4f54-849c-2f246e07f129 None admin] PATH_INFO: `/v3/users/b49c0d97d3434e41bf484d267b0b8e0e` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:11.014507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519941ef-35b7-4f54-849c-2f246e07f129 None admin] RBAC: Authorizing `identity:get_user(user_id=b49c0d97d3434e41bf484d267b0b8e0e)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:11.017270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519941ef-35b7-4f54-849c-2f246e07f129 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:11.024746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 83/161] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:10 2022] GET /identity/v3/users/b49c0d97d3434e41bf484d267b0b8e0e => generated 247 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:11.030664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e802e0-452c-4b0a-a36c-6d75535ff5ee None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:11.131392 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686d22f-4795-47f3-b1e6-603a7c36ddfd None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:11.132863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686d22f-4795-47f3-b1e6-603a7c36ddfd None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:11.133560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686d22f-4795-47f3-b1e6-603a7c36ddfd None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:11.136863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 84/162] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:11.146558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aa9de-c233-4ab0-8155-11301bb3a4b3 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:11.147862 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aa9de-c233-4ab0-8155-11301bb3a4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:11.148587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aa9de-c233-4ab0-8155-11301bb3a4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:11.164776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:11.186378 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-7a4aa9de-c233-4ab0-8155-11301bb3a4b3 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:11.188842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-7a4aa9de-c233-4ab0-8155-11301bb3a4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:11.189249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e802e0-452c-4b0a-a36c-6d75535ff5ee None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:11.243670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf952-f058-4401-8220-2a1fa78c8462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:11.244321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf952-f058-4401-8220-2a1fa78c8462 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:11.244612 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf952-f058-4401-8220-2a1fa78c8462 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:11.244872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf952-f058-4401-8220-2a1fa78c8462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:11.416334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bf952-f058-4401-8220-2a1fa78c8462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:11.419110 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bf952-f058-4401-8220-2a1fa78c8462 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:11.439873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 85/163] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:11.457595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19aef-dc9b-41bd-9835-6640ebd1ef2b None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:11.458070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19aef-dc9b-41bd-9835-6640ebd1ef2b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:11.458546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19aef-dc9b-41bd-9835-6640ebd1ef2b None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:11.461092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 86/164] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:11.470260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f8285-08bf-4852-941e-f7d5b1279c12 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:11.470724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f8285-08bf-4852-941e-f7d5b1279c12 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:11.471214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f8285-08bf-4852-941e-f7d5b1279c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:11.539341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c82f8285-08bf-4852-941e-f7d5b1279c12 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:11.541687 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c82f8285-08bf-4852-941e-f7d5b1279c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:11.652193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:11.746622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 87/165] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:11.748193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f8285-08bf-4852-941e-f7d5b1279c12 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:11.757272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:11.834853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 79/166] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:12:11.837219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf952-f058-4401-8220-2a1fa78c8462 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:12.006784 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f8285-08bf-4852-941e-f7d5b1279c12 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:12.096461 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd359dfe-da5b-4cf0-999a-db9d8f084e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:12.098164 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd359dfe-da5b-4cf0-999a-db9d8f084e09 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:12.098904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd359dfe-da5b-4cf0-999a-db9d8f084e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:12.099715 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd359dfe-da5b-4cf0-999a-db9d8f084e09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:12.139224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd359dfe-da5b-4cf0-999a-db9d8f084e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-fd359dfe-da5b-4cf0-999a-db9d8f084e09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:12.154987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:12.156649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:12.159578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:12.159578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:12.159578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:12.159578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:12.159578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:12.159578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:12.159578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:12.159578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:12.159578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:12.159578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:12.159578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:12.159578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:12.164360 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 88/167] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:12:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:12.166254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd359dfe-da5b-4cf0-999a-db9d8f084e09 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:12.190264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf952-f058-4401-8220-2a1fa78c8462 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:12.239374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:12.325521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ca19b-2485-4b4c-840a-bbdee5977cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:12.326443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ca19b-2485-4b4c-840a-bbdee5977cde None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:12.326950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ca19b-2485-4b4c-840a-bbdee5977cde None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:12.327417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ca19b-2485-4b4c-840a-bbdee5977cde None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:12.331951 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ca19b-2485-4b4c-840a-bbdee5977cde None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:12.334564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ca19b-2485-4b4c-840a-bbdee5977cde None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:12.337836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 80/168] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:11 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:12.343865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ca19b-2485-4b4c-840a-bbdee5977cde None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:12.397063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd359dfe-da5b-4cf0-999a-db9d8f084e09 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:12.519615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0754112-66d3-46f3-b436-19c2a5693d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:12.520276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0754112-66d3-46f3-b436-19c2a5693d64 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:12.520550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0754112-66d3-46f3-b436-19c2a5693d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:12.520813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0754112-66d3-46f3-b436-19c2a5693d64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:12.528448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:12.552151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0754112-66d3-46f3-b436-19c2a5693d64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-c0754112-66d3-46f3-b436-19c2a5693d64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:12.558760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:12.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:12.562029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:12.562029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:12.562029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:12.562029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:12.562029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:12.562029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:12.562029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:12.562029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:12.562029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:12.562029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:12.562029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:12.562029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:12.562029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 89/169] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:12.564782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0754112-66d3-46f3-b436-19c2a5693d64 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:12.722636 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ca19b-2485-4b4c-840a-bbdee5977cde None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:12.811188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:12.845002 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0754112-66d3-46f3-b436-19c2a5693d64 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:12.852996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10094a-6ce9-4e0f-b039-e6d3b0d626d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:12.857651 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10094a-6ce9-4e0f-b039-e6d3b0d626d5 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:12.858182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10094a-6ce9-4e0f-b039-e6d3b0d626d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:12.858645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10094a-6ce9-4e0f-b039-e6d3b0d626d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:12.859937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10094a-6ce9-4e0f-b039-e6d3b0d626d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:12.860458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10094a-6ce9-4e0f-b039-e6d3b0d626d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:12.863204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10094a-6ce9-4e0f-b039-e6d3b0d626d5 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:12.888582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 81/170] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 550 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:12.891769 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10094a-6ce9-4e0f-b039-e6d3b0d626d5 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:12.909465 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd519a9-7546-455c-8ea0-4b6ce453ae17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:12.910099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd519a9-7546-455c-8ea0-4b6ce453ae17 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:12.910373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd519a9-7546-455c-8ea0-4b6ce453ae17 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:12.910643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd519a9-7546-455c-8ea0-4b6ce453ae17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:12.911454 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd519a9-7546-455c-8ea0-4b6ce453ae17 None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=3afdead5472b467db04217214f5e5d38, user.id=b49c0d97d3434e41bf484d267b0b8e0e) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:12.911924 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd519a9-7546-455c-8ea0-4b6ce453ae17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:12.913463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd519a9-7546-455c-8ea0-4b6ce453ae17 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:12.920434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 90/171] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:12 2022] GET /identity/v3/role_assignments?user.id=b49c0d97d3434e41bf484d267b0b8e0e&scope.project.id=3afdead5472b467db04217214f5e5d38&role.id=169d11e171d04c87af71475295957618 => generated 608 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:12.921425 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd519a9-7546-455c-8ea0-4b6ce453ae17 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:13.071807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd519a9-7546-455c-8ea0-4b6ce453ae17 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:13.114469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c8087-cc06-4bbb-91cd-f44f1e39b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:13.115518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c8087-cc06-4bbb-91cd-f44f1e39b157 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:13.115989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c8087-cc06-4bbb-91cd-f44f1e39b157 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:13.116442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c8087-cc06-4bbb-91cd-f44f1e39b157 None admin] PATH_INFO: `/v3/users/6c00a943c52a48299d08f42c54466487` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:13.119893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c8087-cc06-4bbb-91cd-f44f1e39b157 None admin] RBAC: Authorizing `identity:get_user(user_id=6c00a943c52a48299d08f42c54466487)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:13.122861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c8087-cc06-4bbb-91cd-f44f1e39b157 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:13.126200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 91/172] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:12 2022] GET /identity/v3/users/6c00a943c52a48299d08f42c54466487 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:13.144252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c8087-cc06-4bbb-91cd-f44f1e39b157 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:13.209805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:13.275190 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10094a-6ce9-4e0f-b039-e6d3b0d626d5 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:13.318132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:13.381509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663659d5-086f-4559-ac19-c8cf3ab2d247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:13.386862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663659d5-086f-4559-ac19-c8cf3ab2d247 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:13.386862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663659d5-086f-4559-ac19-c8cf3ab2d247 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:13.386862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663659d5-086f-4559-ac19-c8cf3ab2d247 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:13.386862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663659d5-086f-4559-ac19-c8cf3ab2d247 None admin] RBAC: Adding query filter params (name=member) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:13.386862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663659d5-086f-4559-ac19-c8cf3ab2d247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:13.387480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663659d5-086f-4559-ac19-c8cf3ab2d247 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:13.408475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 82/173] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:13.411088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92a155-828a-4987-83b4-7a5043a39f97 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:13.411557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92a155-828a-4987-83b4-7a5043a39f97 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:13.412019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92a155-828a-4987-83b4-7a5043a39f97 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:13.418588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 83/174] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:13.418588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f526f5-bf4f-48ee-9bf5-8c25b182193e None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:13.418588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f526f5-bf4f-48ee-9bf5-8c25b182193e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:13.418588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f526f5-bf4f-48ee-9bf5-8c25b182193e None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:13.421514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 84/175] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:13.428513 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f526f5-bf4f-48ee-9bf5-8c25b182193e None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:13.431976 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c8087-cc06-4bbb-91cd-f44f1e39b157 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:13.475093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57530-c4d1-4af8-9b83-8eb69c2ff663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:13.476139 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57530-c4d1-4af8-9b83-8eb69c2ff663 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:13.476743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57530-c4d1-4af8-9b83-8eb69c2ff663 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:13.477086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57530-c4d1-4af8-9b83-8eb69c2ff663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:13.590223 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d57530-c4d1-4af8-9b83-8eb69c2ff663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:13.591973 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d57530-c4d1-4af8-9b83-8eb69c2ff663 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:13.607851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f526f5-bf4f-48ee-9bf5-8c25b182193e None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:13.627288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:13.655509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101592e0-573e-4924-88f4-afe8df1a9e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:13.656216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101592e0-573e-4924-88f4-afe8df1a9e8f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:13.656588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101592e0-573e-4924-88f4-afe8df1a9e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:13.656959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101592e0-573e-4924-88f4-afe8df1a9e8f None admin] PATH_INFO: `/v3/users/6c00a943c52a48299d08f42c54466487` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:13.658898 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101592e0-573e-4924-88f4-afe8df1a9e8f None admin] RBAC: Authorizing `identity:get_user(user_id=6c00a943c52a48299d08f42c54466487)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:13.660755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101592e0-573e-4924-88f4-afe8df1a9e8f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:13.662649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 85/176] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:13 2022] GET /identity/v3/users/6c00a943c52a48299d08f42c54466487 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:13.664166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e3b8-d53f-440f-9c0e-5a415f1c7bc9 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:13.664619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e3b8-d53f-440f-9c0e-5a415f1c7bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:13.664983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e3b8-d53f-440f-9c0e-5a415f1c7bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:13.687768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-5119e3b8-d53f-440f-9c0e-5a415f1c7bc9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:13.689155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-5119e3b8-d53f-440f-9c0e-5a415f1c7bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:13.738223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:13.774865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 86/177] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:13.775119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1c391-611b-49cb-b10d-e69b5b1f4843 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:13.775457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1c391-611b-49cb-b10d-e69b5b1f4843 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:13.775824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1c391-611b-49cb-b10d-e69b5b1f4843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:13.798578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-d5b1c391-611b-49cb-b10d-e69b5b1f4843 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:13.800262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d5b1c391-611b-49cb-b10d-e69b5b1f4843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:13.836852 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 92/178] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:12:13.840475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57530-c4d1-4af8-9b83-8eb69c2ff663 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:13.895781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 87/179] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:13.901776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1c391-611b-49cb-b10d-e69b5b1f4843 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:14.029056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57530-c4d1-4af8-9b83-8eb69c2ff663 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:14.051778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:14.054234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1c391-611b-49cb-b10d-e69b5b1f4843 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:14.058757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:14.077933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ee340-1756-474b-9927-ab0f92d6563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:14.079057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee340-1756-474b-9927-ab0f92d6563e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:14.079597 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee340-1756-474b-9927-ab0f92d6563e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:14.079861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee340-1756-474b-9927-ab0f92d6563e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:14.111691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d62df7-3148-4dad-9cfe-c61a09d003a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:14.112531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d62df7-3148-4dad-9cfe-c61a09d003a0 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:14.112797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d62df7-3148-4dad-9cfe-c61a09d003a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:14.113068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d62df7-3148-4dad-9cfe-c61a09d003a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:14.124775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d62df7-3148-4dad-9cfe-c61a09d003a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-a6d62df7-3148-4dad-9cfe-c61a09d003a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:14.129737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:14.130688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:14.136770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:14.136770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:14.136770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:14.136770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:14.136770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:14.136770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:14.136770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:14.136770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:14.136770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:14.136770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:14.136770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:14.136770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:14.136770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 88/180] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:12:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:14.136770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d62df7-3148-4dad-9cfe-c61a09d003a0 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:14.178135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ee340-1756-474b-9927-ab0f92d6563e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:14.179674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ee340-1756-474b-9927-ab0f92d6563e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:14.272593 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d62df7-3148-4dad-9cfe-c61a09d003a0 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:14.316630 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 93/181] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:14.318473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559b5ba-b10f-43ea-9917-0662e0dee869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:14.319260 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559b5ba-b10f-43ea-9917-0662e0dee869 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:14.319567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559b5ba-b10f-43ea-9917-0662e0dee869 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:14.319994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559b5ba-b10f-43ea-9917-0662e0dee869 None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:14.320227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ee340-1756-474b-9927-ab0f92d6563e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:14.321698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559b5ba-b10f-43ea-9917-0662e0dee869 None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:14.324379 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559b5ba-b10f-43ea-9917-0662e0dee869 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:14.327414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 89/182] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:14 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:14.330264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1f1f9-ab99-48a5-b2b2-13c53e198a06 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:14.330264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1f1f9-ab99-48a5-b2b2-13c53e198a06 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:14.330550 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1f1f9-ab99-48a5-b2b2-13c53e198a06 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:14.334875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 90/183] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:14.334875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1f1f9-ab99-48a5-b2b2-13c53e198a06 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:14.349962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:14.375057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:14.453656 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1f1f9-ab99-48a5-b2b2-13c53e198a06 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:14.471058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ee340-1756-474b-9927-ab0f92d6563e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:14.493559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26339e-2009-4df1-b955-2a138bbf130d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:14.494175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26339e-2009-4df1-b955-2a138bbf130d None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:14.494450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26339e-2009-4df1-b955-2a138bbf130d None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:14.494716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26339e-2009-4df1-b955-2a138bbf130d None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:14.495790 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26339e-2009-4df1-b955-2a138bbf130d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:14.496088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26339e-2009-4df1-b955-2a138bbf130d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:14.497479 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26339e-2009-4df1-b955-2a138bbf130d None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:14.506471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 91/184] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:14.511259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308863-e35c-435a-a204-6c1beee76318 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:14.511259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308863-e35c-435a-a204-6c1beee76318 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:14.511259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308863-e35c-435a-a204-6c1beee76318 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:14.511259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 92/185] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:14.512273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4308863-e35c-435a-a204-6c1beee76318 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:14.522456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01daf78-1fec-4ead-9ad6-5bd7e8f62f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:14.523137 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01daf78-1fec-4ead-9ad6-5bd7e8f62f4c None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:14.523409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01daf78-1fec-4ead-9ad6-5bd7e8f62f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:14.523676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01daf78-1fec-4ead-9ad6-5bd7e8f62f4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:14.524918 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01daf78-1fec-4ead-9ad6-5bd7e8f62f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:14.526410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01daf78-1fec-4ead-9ad6-5bd7e8f62f4c None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:14.528160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 94/186] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:14.528992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01daf78-1fec-4ead-9ad6-5bd7e8f62f4c None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:14.639086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:14.647472 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:14.658293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4308863-e35c-435a-a204-6c1beee76318 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:14.661192 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01daf78-1fec-4ead-9ad6-5bd7e8f62f4c None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:14.696467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2db386-2bb6-45c5-849e-aac861103424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:14.697108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2db386-2bb6-45c5-849e-aac861103424 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:14.697377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2db386-2bb6-45c5-849e-aac861103424 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:14.697649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2db386-2bb6-45c5-849e-aac861103424 None admin] PATH_INFO: `/v3/projects/cc1d5b05b1f6476f892e6235359d6104` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:14.698959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2db386-2bb6-45c5-849e-aac861103424 None admin] RBAC: Authorizing `identity:get_project(project_id=cc1d5b05b1f6476f892e6235359d6104)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:14.700473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2db386-2bb6-45c5-849e-aac861103424 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:14.701424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d17f53-4b48-43a3-9990-e94f4a588097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:14.702054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17f53-4b48-43a3-9990-e94f4a588097 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:14.702197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 93/187] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:14 2022] GET /identity/v3/projects/cc1d5b05b1f6476f892e6235359d6104 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:14.702449 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17f53-4b48-43a3-9990-e94f4a588097 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:14.702662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17f53-4b48-43a3-9990-e94f4a588097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:14.703418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423bba5-a741-4515-ab11-b2cedf2e1d63 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:14.703563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d17f53-4b48-43a3-9990-e94f4a588097 None admin] RBAC: Adding query filter params (role.id=6b72aeaf7c3646bdb33b40a371cc4d44, scope.project.id=3afdead5472b467db04217214f5e5d38, user.id=6c00a943c52a48299d08f42c54466487) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:14.703676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423bba5-a741-4515-ab11-b2cedf2e1d63 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:14.703810 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d17f53-4b48-43a3-9990-e94f4a588097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:14.703924 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423bba5-a741-4515-ab11-b2cedf2e1d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:14.705334 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d17f53-4b48-43a3-9990-e94f4a588097 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:14.715176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 95/188] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:14 2022] GET /identity/v3/role_assignments?user.id=6c00a943c52a48299d08f42c54466487&scope.project.id=3afdead5472b467db04217214f5e5d38&role.id=6b72aeaf7c3646bdb33b40a371cc4d44 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:14.718016 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d17f53-4b48-43a3-9990-e94f4a588097 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:14.732875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-d423bba5-a741-4515-ab11-b2cedf2e1d63 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:14.735334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d423bba5-a741-4515-ab11-b2cedf2e1d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:14.846136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 94/189] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:14.847810 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ca91-d671-4a5c-8cc9-66de441f8d56 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:14.848215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ca91-d671-4a5c-8cc9-66de441f8d56 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:14.848713 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ca91-d671-4a5c-8cc9-66de441f8d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:14.868868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-66e0ca91-d671-4a5c-8cc9-66de441f8d56 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:14.870662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-66e0ca91-d671-4a5c-8cc9-66de441f8d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:14.887973 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d17f53-4b48-43a3-9990-e94f4a588097 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:14.929530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa80c32-d5c1-41d8-9fb4-d8ea57615cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:14.931165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa80c32-d5c1-41d8-9fb4-d8ea57615cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:14.931165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa80c32-d5c1-41d8-9fb4-d8ea57615cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:14.931165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa80c32-d5c1-41d8-9fb4-d8ea57615cd0 None admin] PATH_INFO: `/v3/users/9d454c8da91947788bf9195ecb53c5e5` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:14.946953 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa80c32-d5c1-41d8-9fb4-d8ea57615cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=9d454c8da91947788bf9195ecb53c5e5)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:14.948406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa80c32-d5c1-41d8-9fb4-d8ea57615cd0 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:14.950416 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 96/190] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:14 2022] GET /identity/v3/users/9d454c8da91947788bf9195ecb53c5e5 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:14.954863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa80c32-d5c1-41d8-9fb4-d8ea57615cd0 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:14.962356 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:14.963139 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 95/191] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:14.963773 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0ca91-d671-4a5c-8cc9-66de441f8d56 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:14.995831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:15.078147 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa80c32-d5c1-41d8-9fb4-d8ea57615cd0 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:15.089630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0ca91-d671-4a5c-8cc9-66de441f8d56 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:15.113270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f6cb6-7f38-4875-b522-a325ac6c7b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:15.113992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f6cb6-7f38-4875-b522-a325ac6c7b09 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:15.114266 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f6cb6-7f38-4875-b522-a325ac6c7b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:15.114535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f6cb6-7f38-4875-b522-a325ac6c7b09 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:15.115232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f6cb6-7f38-4875-b522-a325ac6c7b09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:15.116711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f6cb6-7f38-4875-b522-a325ac6c7b09 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:15.126757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638e47a-38db-462f-9f86-b258e16f92ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:15.127526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638e47a-38db-462f-9f86-b258e16f92ee None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:15.128223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638e47a-38db-462f-9f86-b258e16f92ee None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:15.128697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638e47a-38db-462f-9f86-b258e16f92ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:15.130198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638e47a-38db-462f-9f86-b258e16f92ee None admin] RBAC: Adding query filter params (role.id=04b89a35fc5442af92047f11f75d7b14, scope.project.id=cc1d5b05b1f6476f892e6235359d6104, user.id=6c00a943c52a48299d08f42c54466487) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:15.130732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638e47a-38db-462f-9f86-b258e16f92ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:15.133113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638e47a-38db-462f-9f86-b258e16f92ee None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:15.140994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 97/192] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:12:14 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:12:15.141387 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 96/193] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:14 2022] GET /identity/v3/role_assignments?user.id=6c00a943c52a48299d08f42c54466487&scope.project.id=cc1d5b05b1f6476f892e6235359d6104&role.id=04b89a35fc5442af92047f11f75d7b14 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:15.142456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638e47a-38db-462f-9f86-b258e16f92ee None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:15.147987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f6cb6-7f38-4875-b522-a325ac6c7b09 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:15.240672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:15.310005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:15.329135 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638e47a-38db-462f-9f86-b258e16f92ee None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:15.344582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f6cb6-7f38-4875-b522-a325ac6c7b09 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:15.370485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0180d4-40f7-427f-86a6-56cb3ccfd7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:15.371551 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0180d4-40f7-427f-86a6-56cb3ccfd7df None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:15.371832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0180d4-40f7-427f-86a6-56cb3ccfd7df None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:15.372104 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0180d4-40f7-427f-86a6-56cb3ccfd7df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:15.396674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7fb85-5582-404a-b021-e93903951b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:15.397339 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7fb85-5582-404a-b021-e93903951b81 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:15.397614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7fb85-5582-404a-b021-e93903951b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:15.397884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7fb85-5582-404a-b021-e93903951b81 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:15.412296 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7fb85-5582-404a-b021-e93903951b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-f2c7fb85-5582-404a-b021-e93903951b81 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:15.417889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:15.419540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:15.420349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:15.420349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:15.420349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:15.420349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:15.420349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:15.420349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:15.420349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:15.420349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:15.420349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:15.420349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:15.420349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:15.420349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:15.420349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 98/194] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:15.420349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7fb85-5582-404a-b021-e93903951b81 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:15.486250 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0180d4-40f7-427f-86a6-56cb3ccfd7df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:15.490785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0180d4-40f7-427f-86a6-56cb3ccfd7df None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:15.569363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7fb85-5582-404a-b021-e93903951b81 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:15.600160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:15.613968 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425ad34-21e6-46d0-b341-44d12343d78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:15.614612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ad34-21e6-46d0-b341-44d12343d78e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:15.614917 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ad34-21e6-46d0-b341-44d12343d78e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:15.615191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ad34-21e6-46d0-b341-44d12343d78e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:15.620871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:15.628258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425ad34-21e6-46d0-b341-44d12343d78e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-d425ad34-21e6-46d0-b341-44d12343d78e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:15.633610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:15.634506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:15.635338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:15.635338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:15.635338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:15.635338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:15.635338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:15.635338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:15.635338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:15.635338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:15.635338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:15.635338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:15.635338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:15.635338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:15.635338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 99/195] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:12:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:15.635992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425ad34-21e6-46d0-b341-44d12343d78e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:15.646351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 97/196] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:15.651619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0180d4-40f7-427f-86a6-56cb3ccfd7df None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:15.778612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425ad34-21e6-46d0-b341-44d12343d78e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:15.830738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96be42e-ccdb-41b4-830a-071646838308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:15.831915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96be42e-ccdb-41b4-830a-071646838308 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:15.832408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96be42e-ccdb-41b4-830a-071646838308 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:15.832846 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96be42e-ccdb-41b4-830a-071646838308 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:15.833409 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0180d4-40f7-427f-86a6-56cb3ccfd7df None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:15.833911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96be42e-ccdb-41b4-830a-071646838308 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:15.834371 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96be42e-ccdb-41b4-830a-071646838308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:15.836256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96be42e-ccdb-41b4-830a-071646838308 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:15.847472 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 100/197] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:15.848753 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96be42e-ccdb-41b4-830a-071646838308 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:15.887998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7df8e-6f88-420c-bc0f-7c846932027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:15.888804 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7df8e-6f88-420c-bc0f-7c846932027a None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:15.889144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7df8e-6f88-420c-bc0f-7c846932027a None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:15.889532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7df8e-6f88-420c-bc0f-7c846932027a None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:15.890252 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7df8e-6f88-420c-bc0f-7c846932027a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:15.890869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7df8e-6f88-420c-bc0f-7c846932027a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:15.892147 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7df8e-6f88-420c-bc0f-7c846932027a None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:15.901994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 98/198] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:15.903601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7df8e-6f88-420c-bc0f-7c846932027a None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:15.917756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:15.970765 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:16.034014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96be42e-ccdb-41b4-830a-071646838308 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:16.060617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7df8e-6f88-420c-bc0f-7c846932027a None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:16.082340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcff694-b064-483b-a458-06d06175bba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:16.083868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcff694-b064-483b-a458-06d06175bba9 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:16.084312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcff694-b064-483b-a458-06d06175bba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:16.085003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcff694-b064-483b-a458-06d06175bba9 None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:16.086633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcff694-b064-483b-a458-06d06175bba9 None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:16.089475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcff694-b064-483b-a458-06d06175bba9 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:16.097027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 101/199] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:15 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:16.097027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcff694-b064-483b-a458-06d06175bba9 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:16.103580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327638d-6f7c-4e7e-a36b-6ad592b6a67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:16.104225 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327638d-6f7c-4e7e-a36b-6ad592b6a67f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:16.104501 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327638d-6f7c-4e7e-a36b-6ad592b6a67f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:16.104772 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327638d-6f7c-4e7e-a36b-6ad592b6a67f None admin] PATH_INFO: `/v3/users/7d9a7bb4ca4446f9abfd16c363437df7` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:16.105981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327638d-6f7c-4e7e-a36b-6ad592b6a67f None admin] RBAC: Authorizing `identity:get_user(user_id=7d9a7bb4ca4446f9abfd16c363437df7)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:16.107480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327638d-6f7c-4e7e-a36b-6ad592b6a67f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:16.109085 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 99/200] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:15 2022] GET /identity/v3/users/7d9a7bb4ca4446f9abfd16c363437df7 => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:16.114901 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327638d-6f7c-4e7e-a36b-6ad592b6a67f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:16.243848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcff694-b064-483b-a458-06d06175bba9 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:16.254606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327638d-6f7c-4e7e-a36b-6ad592b6a67f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:16.266174 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:16.283233 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:16.309242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bddd5-8152-41b1-90c1-2dc825631164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:16.309775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bddd5-8152-41b1-90c1-2dc825631164 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:16.310041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bddd5-8152-41b1-90c1-2dc825631164 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:16.310309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bddd5-8152-41b1-90c1-2dc825631164 None admin] PATH_INFO: `/v3/users/9d454c8da91947788bf9195ecb53c5e5` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:16.311868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bddd5-8152-41b1-90c1-2dc825631164 None admin] RBAC: Authorizing `identity:get_user(user_id=9d454c8da91947788bf9195ecb53c5e5)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:16.313342 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bddd5-8152-41b1-90c1-2dc825631164 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:16.320133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61999c20-e776-40b1-b41a-a8bd17a245a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:16.321558 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61999c20-e776-40b1-b41a-a8bd17a245a3 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:16.322271 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61999c20-e776-40b1-b41a-a8bd17a245a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:16.322414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 102/201] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:16 2022] GET /identity/v3/users/9d454c8da91947788bf9195ecb53c5e5 => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:16.323272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61999c20-e776-40b1-b41a-a8bd17a245a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:16.323799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bddd5-8152-41b1-90c1-2dc825631164 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:16.325290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61999c20-e776-40b1-b41a-a8bd17a245a3 None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=b3ad94df1ce64d468d45f26d20103ef1, user.id=9d454c8da91947788bf9195ecb53c5e5) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:16.326048 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61999c20-e776-40b1-b41a-a8bd17a245a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:16.329118 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61999c20-e776-40b1-b41a-a8bd17a245a3 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:16.343256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 100/202] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:16 2022] GET /identity/v3/role_assignments?user.id=9d454c8da91947788bf9195ecb53c5e5&scope.project.id=b3ad94df1ce64d468d45f26d20103ef1&role.id=169d11e171d04c87af71475295957618 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:16.345688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61999c20-e776-40b1-b41a-a8bd17a245a3 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:16.551573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bddd5-8152-41b1-90c1-2dc825631164 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:16.589069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61999c20-e776-40b1-b41a-a8bd17a245a3 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:16.615511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918b5d-76ad-445f-9f7f-8ac2709bd828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:16.615902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918b5d-76ad-445f-9f7f-8ac2709bd828 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:16.616129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918b5d-76ad-445f-9f7f-8ac2709bd828 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:16.616409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918b5d-76ad-445f-9f7f-8ac2709bd828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:16.677036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45c881-1fca-4a2c-bdae-9af559887882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:16.677660 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c881-1fca-4a2c-bdae-9af559887882 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:16.677928 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c881-1fca-4a2c-bdae-9af559887882 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:16.678188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c881-1fca-4a2c-bdae-9af559887882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:16.720560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:16.760227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a918b5d-76ad-445f-9f7f-8ac2709bd828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:16.761714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a918b5d-76ad-445f-9f7f-8ac2709bd828 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:16.770272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:16.803622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45c881-1fca-4a2c-bdae-9af559887882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:16.805102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45c881-1fca-4a2c-bdae-9af559887882 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:16.934050 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 103/203] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:16.941683 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918b5d-76ad-445f-9f7f-8ac2709bd828 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:16.990682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 101/204] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:17.003964 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45c881-1fca-4a2c-bdae-9af559887882 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:17.125553 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:17.167564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918b5d-76ad-445f-9f7f-8ac2709bd828 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:17.171242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:17.210343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45c881-1fca-4a2c-bdae-9af559887882 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:17.241081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a34bc2-962c-4056-a760-fd3adc3a5779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:17.241721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a34bc2-962c-4056-a760-fd3adc3a5779 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:17.241991 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a34bc2-962c-4056-a760-fd3adc3a5779 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:17.242279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a34bc2-962c-4056-a760-fd3adc3a5779 None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:17.243473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a34bc2-962c-4056-a760-fd3adc3a5779 None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:17.245592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a34bc2-962c-4056-a760-fd3adc3a5779 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:17.247340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 104/205] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:16 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:17.253554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a34bc2-962c-4056-a760-fd3adc3a5779 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:17.293091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ed641-5a01-41f9-9ecc-ff54adeccd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:17.293731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ed641-5a01-41f9-9ecc-ff54adeccd9a None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:17.294001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ed641-5a01-41f9-9ecc-ff54adeccd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:17.294264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ed641-5a01-41f9-9ecc-ff54adeccd9a None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:17.299210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ed641-5a01-41f9-9ecc-ff54adeccd9a None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:17.300750 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ed641-5a01-41f9-9ecc-ff54adeccd9a None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:17.306405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 102/206] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:17 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:17.315646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ed641-5a01-41f9-9ecc-ff54adeccd9a None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:17.466644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a34bc2-962c-4056-a760-fd3adc3a5779 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:17.507101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ed641-5a01-41f9-9ecc-ff54adeccd9a None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:17.551710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991f669-0dfa-41ca-a776-60cd8ee98de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:17.552333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991f669-0dfa-41ca-a776-60cd8ee98de9 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:17.552602 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991f669-0dfa-41ca-a776-60cd8ee98de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:17.552865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991f669-0dfa-41ca-a776-60cd8ee98de9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:17.553598 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991f669-0dfa-41ca-a776-60cd8ee98de9 None admin] RBAC: Adding query filter params (role.id=b8a55f2fb9954ee99b8328fec6560de4, scope.project.id=3afdead5472b467db04217214f5e5d38, user.id=7d9a7bb4ca4446f9abfd16c363437df7) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:17.553895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991f669-0dfa-41ca-a776-60cd8ee98de9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:17.555400 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991f669-0dfa-41ca-a776-60cd8ee98de9 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:17.572182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 105/207] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:17 2022] GET /identity/v3/role_assignments?user.id=7d9a7bb4ca4446f9abfd16c363437df7&scope.project.id=3afdead5472b467db04217214f5e5d38&role.id=b8a55f2fb9954ee99b8328fec6560de4 => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:17.576794 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf228073-4a2c-4518-87ed-a73a274a95fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:17.577417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf228073-4a2c-4518-87ed-a73a274a95fa None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:17.577688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf228073-4a2c-4518-87ed-a73a274a95fa None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:17.577956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf228073-4a2c-4518-87ed-a73a274a95fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:17.578706 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf228073-4a2c-4518-87ed-a73a274a95fa None admin] RBAC: Adding query filter params (role.id=6b72aeaf7c3646bdb33b40a371cc4d44, scope.project.id=b3ad94df1ce64d468d45f26d20103ef1, user.id=9d454c8da91947788bf9195ecb53c5e5) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:17.579040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf228073-4a2c-4518-87ed-a73a274a95fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:17.580612 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf228073-4a2c-4518-87ed-a73a274a95fa None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:17.587826 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 103/208] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:17 2022] GET /identity/v3/role_assignments?user.id=9d454c8da91947788bf9195ecb53c5e5&scope.project.id=b3ad94df1ce64d468d45f26d20103ef1&role.id=6b72aeaf7c3646bdb33b40a371cc4d44 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:17.854364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13216ab-d21d-4c6d-bf61-e32ad2f736fd None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:17.854742 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13216ab-d21d-4c6d-bf61-e32ad2f736fd None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:17.855006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13216ab-d21d-4c6d-bf61-e32ad2f736fd None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:17.856557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 106/209] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:17.862973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55664475-a2cb-4de9-b894-21c4c892bdc4 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:17.863245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55664475-a2cb-4de9-b894-21c4c892bdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:17.863591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55664475-a2cb-4de9-b894-21c4c892bdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:17.887570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-55664475-a2cb-4de9-b894-21c4c892bdc4 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:17.888786 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-55664475-a2cb-4de9-b894-21c4c892bdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:17.897473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:17.972557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0123b-6f73-4397-aee5-bb147540d5fe None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:17.972829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0123b-6f73-4397-aee5-bb147540d5fe None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:17.973095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0123b-6f73-4397-aee5-bb147540d5fe None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:17.974439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 107/210] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:17.980472 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638cecb-e652-4753-8a0d-e9418de7efa0 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:17.980769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638cecb-e652-4753-8a0d-e9418de7efa0 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:17.981019 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638cecb-e652-4753-8a0d-e9418de7efa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:17.989735 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 104/211] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:18.010368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c638cecb-e652-4753-8a0d-e9418de7efa0 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:18.012518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c638cecb-e652-4753-8a0d-e9418de7efa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:18.019926 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55664475-a2cb-4de9-b894-21c4c892bdc4 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:18.023891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:18.155373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 108/212] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:18.155548 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55664475-a2cb-4de9-b894-21c4c892bdc4 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:18.174594 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638cecb-e652-4753-8a0d-e9418de7efa0 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:18.220502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00de4a-4ca1-4ab6-8d0d-02891238ef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:18.221978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00de4a-4ca1-4ab6-8d0d-02891238ef37 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:18.222536 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00de4a-4ca1-4ab6-8d0d-02891238ef37 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:18.223243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00de4a-4ca1-4ab6-8d0d-02891238ef37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:18.225072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00de4a-4ca1-4ab6-8d0d-02891238ef37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:18.226879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00de4a-4ca1-4ab6-8d0d-02891238ef37 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:18.230939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 105/213] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:18.236208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00de4a-4ca1-4ab6-8d0d-02891238ef37 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:18.257770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:18.331529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638cecb-e652-4753-8a0d-e9418de7efa0 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:18.378617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fda36-19e3-4194-8a75-5a252da765e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:18.379717 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fda36-19e3-4194-8a75-5a252da765e9 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:18.380161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fda36-19e3-4194-8a75-5a252da765e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:18.380577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fda36-19e3-4194-8a75-5a252da765e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:18.392075 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00de4a-4ca1-4ab6-8d0d-02891238ef37 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:18.392403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fda36-19e3-4194-8a75-5a252da765e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-f37fda36-19e3-4194-8a75-5a252da765e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:18.397315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:18.398254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:18.399099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:18.399099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:18.399099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:18.399099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:18.399099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:18.399099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:18.399099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:18.399099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:18.399099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:18.399099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:18.399099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:18.399099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:18.409320 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 109/214] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:18.409721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fda36-19e3-4194-8a75-5a252da765e9 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:18.413329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:18.437430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1198b4e-be7f-4189-bf3f-79f3cad4c37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:18.438436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1198b4e-be7f-4189-bf3f-79f3cad4c37d None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:18.438969 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1198b4e-be7f-4189-bf3f-79f3cad4c37d None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:18.439436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1198b4e-be7f-4189-bf3f-79f3cad4c37d None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:18.440336 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1198b4e-be7f-4189-bf3f-79f3cad4c37d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:18.442156 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1198b4e-be7f-4189-bf3f-79f3cad4c37d None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:18.469593 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 106/215] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:12:18 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:12:18.533306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fda36-19e3-4194-8a75-5a252da765e9 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:18.575328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac6ede-454c-4a26-b72e-4b4012e69bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:18.575953 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac6ede-454c-4a26-b72e-4b4012e69bea None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:18.576223 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac6ede-454c-4a26-b72e-4b4012e69bea None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:18.576482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac6ede-454c-4a26-b72e-4b4012e69bea None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:18.577162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac6ede-454c-4a26-b72e-4b4012e69bea None admin] RBAC: Adding query filter params (name=member) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:18.577544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac6ede-454c-4a26-b72e-4b4012e69bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:18.579095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac6ede-454c-4a26-b72e-4b4012e69bea None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:18.589526 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 110/216] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:18.593409 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63bb0-785f-4d44-a23c-f72962e34413 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:18.593973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63bb0-785f-4d44-a23c-f72962e34413 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:18.594216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63bb0-785f-4d44-a23c-f72962e34413 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:18.595249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac6ede-454c-4a26-b72e-4b4012e69bea None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:18.595981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 107/217] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:18.601749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c956-4c41-47da-8c7e-cdba21df3c31 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:18.602015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c956-4c41-47da-8c7e-cdba21df3c31 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:18.602333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c956-4c41-47da-8c7e-cdba21df3c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:18.636612 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-33c8c956-4c41-47da-8c7e-cdba21df3c31 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:18.639550 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-33c8c956-4c41-47da-8c7e-cdba21df3c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:18.688555 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:18.726127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:18.735699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 108/218] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:18.758099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8c956-4c41-47da-8c7e-cdba21df3c31 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:18.765047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac6ede-454c-4a26-b72e-4b4012e69bea None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:18.808724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0a5f8-f0c8-45f9-a263-4be153ea8835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:18.809366 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0a5f8-f0c8-45f9-a263-4be153ea8835 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:18.809630 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0a5f8-f0c8-45f9-a263-4be153ea8835 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:18.809901 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0a5f8-f0c8-45f9-a263-4be153ea8835 None admin] PATH_INFO: `/v3/users/509afbda39a94365b5eb36a2b39bc068` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:18.826769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0a5f8-f0c8-45f9-a263-4be153ea8835 None admin] RBAC: Authorizing `identity:get_user(user_id=509afbda39a94365b5eb36a2b39bc068)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:18.828373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0a5f8-f0c8-45f9-a263-4be153ea8835 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:18.830452 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 111/219] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:18 2022] GET /identity/v3/users/509afbda39a94365b5eb36a2b39bc068 => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:18.836286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0a5f8-f0c8-45f9-a263-4be153ea8835 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:18.896181 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8c956-4c41-47da-8c7e-cdba21df3c31 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:18.936580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646817d-b28f-430c-a638-836859f8743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:18.937227 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646817d-b28f-430c-a638-836859f8743f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:18.937507 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646817d-b28f-430c-a638-836859f8743f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:18.937776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646817d-b28f-430c-a638-836859f8743f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:18.957684 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646817d-b28f-430c-a638-836859f8743f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:18.960513 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0a5f8-f0c8-45f9-a263-4be153ea8835 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-2646817d-b28f-430c-a638-836859f8743f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:18.968840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:18.969837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:18.971796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:18.971796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:18.971796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:18.971796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:18.971796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:18.971796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:18.971796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:18.971796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:18.971796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:18.971796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:18.971796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:18.971796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:18.971796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 109/220] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:18.978175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646817d-b28f-430c-a638-836859f8743f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:19.000753 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:19.017694 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eea02e-4d0a-4c25-a0c0-0faac3db5835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:19.018324 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eea02e-4d0a-4c25-a0c0-0faac3db5835 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:19.018837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eea02e-4d0a-4c25-a0c0-0faac3db5835 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:19.019139 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eea02e-4d0a-4c25-a0c0-0faac3db5835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:19.056860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:19.107352 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646817d-b28f-430c-a638-836859f8743f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:19.146746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0622c4-c68f-4bc4-9513-31ceeda96a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:19.147756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0622c4-c68f-4bc4-9513-31ceeda96a8e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:19.148224 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0622c4-c68f-4bc4-9513-31ceeda96a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:19.148682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0622c4-c68f-4bc4-9513-31ceeda96a8e None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:19.149555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0622c4-c68f-4bc4-9513-31ceeda96a8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:19.150129 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0622c4-c68f-4bc4-9513-31ceeda96a8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:19.150231 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eea02e-4d0a-4c25-a0c0-0faac3db5835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:19.151866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0622c4-c68f-4bc4-9513-31ceeda96a8e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:19.153031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eea02e-4d0a-4c25-a0c0-0faac3db5835 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:19.162664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 110/221] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:19.182862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0622c4-c68f-4bc4-9513-31ceeda96a8e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:19.363130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0622c4-c68f-4bc4-9513-31ceeda96a8e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:19.367617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 112/222] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:19.376713 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eea02e-4d0a-4c25-a0c0-0faac3db5835 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:19.395852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:19.419404 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fc0b3-9978-4317-8ca1-0951dccb19a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:19.426852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fc0b3-9978-4317-8ca1-0951dccb19a5 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:19.426852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fc0b3-9978-4317-8ca1-0951dccb19a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:19.426852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fc0b3-9978-4317-8ca1-0951dccb19a5 None admin] PATH_INFO: `/v3/users/9d454c8da91947788bf9195ecb53c5e5` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:19.426852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fc0b3-9978-4317-8ca1-0951dccb19a5 None admin] RBAC: Authorizing `identity:get_user(user_id=9d454c8da91947788bf9195ecb53c5e5)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:19.427528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fc0b3-9978-4317-8ca1-0951dccb19a5 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:19.433112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:19.435032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 111/223] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:19 2022] GET /identity/v3/users/9d454c8da91947788bf9195ecb53c5e5 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:19.436014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fc0b3-9978-4317-8ca1-0951dccb19a5 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:19.570936 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fc0b3-9978-4317-8ca1-0951dccb19a5 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:19.612327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eea02e-4d0a-4c25-a0c0-0faac3db5835 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:19.633743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b60d54-8a6d-4f21-a4de-ba5d9b5eb4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:19.634394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60d54-8a6d-4f21-a4de-ba5d9b5eb4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:19.634566 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60d54-8a6d-4f21-a4de-ba5d9b5eb4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:19.634850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60d54-8a6d-4f21-a4de-ba5d9b5eb4a4 None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:19.637130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b60d54-8a6d-4f21-a4de-ba5d9b5eb4a4 None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:19.638588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b60d54-8a6d-4f21-a4de-ba5d9b5eb4a4 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:19.640244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 112/224] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:19 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:19.647777 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b60d54-8a6d-4f21-a4de-ba5d9b5eb4a4 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:19.685532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516ced9-414e-4bc6-94d6-9978708b70b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:19.686179 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ced9-414e-4bc6-94d6-9978708b70b8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:19.686451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ced9-414e-4bc6-94d6-9978708b70b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:19.686718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ced9-414e-4bc6-94d6-9978708b70b8 None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:19.689204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516ced9-414e-4bc6-94d6-9978708b70b8 None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:19.690768 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516ced9-414e-4bc6-94d6-9978708b70b8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:19.694617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 113/225] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:19 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:19.699164 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516ced9-414e-4bc6-94d6-9978708b70b8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:19.755711 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:19.848817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b60d54-8a6d-4f21-a4de-ba5d9b5eb4a4 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:19.855183 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:19.876202 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516ced9-414e-4bc6-94d6-9978708b70b8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:19.896245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31549b6-9f17-4ea2-a4f8-f15323a4f4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:19.896840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31549b6-9f17-4ea2-a4f8-f15323a4f4a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:19.897112 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31549b6-9f17-4ea2-a4f8-f15323a4f4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:19.897381 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31549b6-9f17-4ea2-a4f8-f15323a4f4a9 None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1/users/9d454c8da91947788bf9195ecb53c5e5/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:19.899441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31549b6-9f17-4ea2-a4f8-f15323a4f4a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3ad94df1ce64d468d45f26d20103ef1, user_id=9d454c8da91947788bf9195ecb53c5e5, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:19.900903 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31549b6-9f17-4ea2-a4f8-f15323a4f4a9 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:19.922037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 113/226] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:12:19 2022] PUT /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1/users/9d454c8da91947788bf9195ecb53c5e5/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:12:19.950532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c355e-1065-47ec-9d5d-21f93060d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:19.951241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c355e-1065-47ec-9d5d-21f93060d63a None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:19.951516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c355e-1065-47ec-9d5d-21f93060d63a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:19.951789 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c355e-1065-47ec-9d5d-21f93060d63a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:19.952550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c355e-1065-47ec-9d5d-21f93060d63a None admin] RBAC: Adding query filter params (role.id=04b89a35fc5442af92047f11f75d7b14, scope.project.id=b3ad94df1ce64d468d45f26d20103ef1, user.id=509afbda39a94365b5eb36a2b39bc068) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:19.952857 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c355e-1065-47ec-9d5d-21f93060d63a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:19.954443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c355e-1065-47ec-9d5d-21f93060d63a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:19.961524 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 114/227] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:19 2022] GET /identity/v3/role_assignments?user.id=509afbda39a94365b5eb36a2b39bc068&scope.project.id=b3ad94df1ce64d468d45f26d20103ef1&role.id=04b89a35fc5442af92047f11f75d7b14 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:20.167098 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c0e36-e113-49db-a971-04b20a97379a None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:20.167487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c0e36-e113-49db-a971-04b20a97379a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:20.167712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c0e36-e113-49db-a971-04b20a97379a None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:20.173067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 114/228] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:20.183308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1507f6-564e-4526-8ff4-64cc181b43da None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:20.183825 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1507f6-564e-4526-8ff4-64cc181b43da None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:20.184336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1507f6-564e-4526-8ff4-64cc181b43da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:20.216185 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-ca1507f6-564e-4526-8ff4-64cc181b43da None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:20.217890 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ca1507f6-564e-4526-8ff4-64cc181b43da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:20.327958 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 115/229] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:20.360730 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c0e36-e113-49db-a971-04b20a97379a None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:20.544269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c0e36-e113-49db-a971-04b20a97379a None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:20.571991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:20.612773 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea8838-6da8-4392-99a4-46b6e5874579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:20.613791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea8838-6da8-4392-99a4-46b6e5874579 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:20.614243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea8838-6da8-4392-99a4-46b6e5874579 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:20.614705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea8838-6da8-4392-99a4-46b6e5874579 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:20.633582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea8838-6da8-4392-99a4-46b6e5874579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-88ea8838-6da8-4392-99a4-46b6e5874579 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:20.643597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:20.645782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:20.646573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:20.646573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:20.646573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:20.646573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:20.646573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:20.646573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:20.646573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:20.646573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:20.646573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:20.646573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:20.646573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:20.646573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:20.646573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 115/230] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:12:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:20.657820 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1507f6-564e-4526-8ff4-64cc181b43da None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:20.818249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:20.860435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1507f6-564e-4526-8ff4-64cc181b43da None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:20.938241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28750c37-b13d-4844-8165-74824e8921ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:20.942837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28750c37-b13d-4844-8165-74824e8921ac None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:20.942837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28750c37-b13d-4844-8165-74824e8921ac None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:20.942837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28750c37-b13d-4844-8165-74824e8921ac None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:20.942837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28750c37-b13d-4844-8165-74824e8921ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:20.942837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28750c37-b13d-4844-8165-74824e8921ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:20.943819 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28750c37-b13d-4844-8165-74824e8921ac None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:20.959292 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 116/231] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:20.963856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea8838-6da8-4392-99a4-46b6e5874579 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:21.140995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea8838-6da8-4392-99a4-46b6e5874579 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:21.195181 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3115e-5572-4543-8030-a2ab6d0bc0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:21.195825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3115e-5572-4543-8030-a2ab6d0bc0ff None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:21.196098 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3115e-5572-4543-8030-a2ab6d0bc0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:21.196369 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3115e-5572-4543-8030-a2ab6d0bc0ff None admin] PATH_INFO: `/v3/users/9d454c8da91947788bf9195ecb53c5e5` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:21.197531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3115e-5572-4543-8030-a2ab6d0bc0ff None admin] RBAC: Authorizing `identity:get_user(user_id=9d454c8da91947788bf9195ecb53c5e5)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:21.199035 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3115e-5572-4543-8030-a2ab6d0bc0ff None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:21.200910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 116/232] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:20 2022] GET /identity/v3/users/9d454c8da91947788bf9195ecb53c5e5 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:21.208650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28750c37-b13d-4844-8165-74824e8921ac None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:21.356900 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28750c37-b13d-4844-8165-74824e8921ac None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:21.408568 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65e79a-1da2-43f6-b91b-d032bf61cdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:21.409041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65e79a-1da2-43f6-b91b-d032bf61cdec None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:21.409331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65e79a-1da2-43f6-b91b-d032bf61cdec None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:21.409598 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65e79a-1da2-43f6-b91b-d032bf61cdec None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:21.410757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e929774-8d98-4cab-b063-43ff0fd718cd None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:21.410906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65e79a-1da2-43f6-b91b-d032bf61cdec None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:21.411365 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e929774-8d98-4cab-b063-43ff0fd718cd None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:21.411817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e929774-8d98-4cab-b063-43ff0fd718cd None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:21.412369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65e79a-1da2-43f6-b91b-d032bf61cdec None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:21.413553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 117/233] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:21.415417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 117/234] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:21 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:21.422806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2cf17-ffb0-4d93-90d1-721258fa29b5 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:21.423768 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65e79a-1da2-43f6-b91b-d032bf61cdec None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:21.423965 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2cf17-ffb0-4d93-90d1-721258fa29b5 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:21.424474 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2cf17-ffb0-4d93-90d1-721258fa29b5 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:21.427338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 118/235] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:21.429164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701217a5-f4c4-425a-bca6-69d5e1169938 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:21.429656 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701217a5-f4c4-425a-bca6-69d5e1169938 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:21.430148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701217a5-f4c4-425a-bca6-69d5e1169938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:21.447209 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:21.476160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-701217a5-f4c4-425a-bca6-69d5e1169938 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:21.481666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-701217a5-f4c4-425a-bca6-69d5e1169938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:21.547926 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:21.561275 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65e79a-1da2-43f6-b91b-d032bf61cdec None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:21.585057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 119/236] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:21.592139 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ac30a-556d-44a2-bb54-6305bce2fecd None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:21.594352 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ac30a-556d-44a2-bb54-6305bce2fecd None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:21.596450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ac30a-556d-44a2-bb54-6305bce2fecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:21.625113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785888b-2799-495b-a008-a515c87c1111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:21.626791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785888b-2799-495b-a008-a515c87c1111 None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:21.627658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785888b-2799-495b-a008-a515c87c1111 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:21.628219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-834ac30a-556d-44a2-bb54-6305bce2fecd None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:21.628864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785888b-2799-495b-a008-a515c87c1111 None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1/users/9d454c8da91947788bf9195ecb53c5e5/roles/6b72aeaf7c3646bdb33b40a371cc4d44` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:21.629511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-834ac30a-556d-44a2-bb54-6305bce2fecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:21.633518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785888b-2799-495b-a008-a515c87c1111 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3ad94df1ce64d468d45f26d20103ef1, user_id=9d454c8da91947788bf9195ecb53c5e5, role_id=6b72aeaf7c3646bdb33b40a371cc4d44)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:21.636749 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785888b-2799-495b-a008-a515c87c1111 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:21.657563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 118/237] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:12:21 2022] PUT /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1/users/9d454c8da91947788bf9195ecb53c5e5/roles/6b72aeaf7c3646bdb33b40a371cc4d44 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:12:21.659063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785888b-2799-495b-a008-a515c87c1111 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:21.725905 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 120/238] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:21.774245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ac30a-556d-44a2-bb54-6305bce2fecd None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:21.777610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:21.807746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785888b-2799-495b-a008-a515c87c1111 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:21.859001 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cf59d-4132-4458-a6d5-9dd4bb596841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:21.860056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf59d-4132-4458-a6d5-9dd4bb596841 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:21.860528 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf59d-4132-4458-a6d5-9dd4bb596841 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:21.860978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf59d-4132-4458-a6d5-9dd4bb596841 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:21.862362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cf59d-4132-4458-a6d5-9dd4bb596841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:21.864743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cf59d-4132-4458-a6d5-9dd4bb596841 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:21.869422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 119/239] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:21.876699 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cf59d-4132-4458-a6d5-9dd4bb596841 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:21.951975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ac30a-556d-44a2-bb54-6305bce2fecd None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:21.954700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:22.016429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4009-4838-4d49-a78c-d4da6b919227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:22.017619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4009-4838-4d49-a78c-d4da6b919227 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:22.018090 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4009-4838-4d49-a78c-d4da6b919227 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:22.018630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4009-4838-4d49-a78c-d4da6b919227 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:22.023055 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cf59d-4132-4458-a6d5-9dd4bb596841 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:22.044584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b4009-4838-4d49-a78c-d4da6b919227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-1f6b4009-4838-4d49-a78c-d4da6b919227 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:22.051244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:22.052196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:22.053019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:22.053019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:22.053019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:22.053019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:22.053019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:22.053019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:22.053019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:22.053019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:22.053019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:22.053019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:22.053019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:22.053019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:22.055645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 121/240] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:22.064065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4009-4838-4d49-a78c-d4da6b919227 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:22.068309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07067ca-653d-4b08-b4cb-aa8ddddce7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:22.068923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07067ca-653d-4b08-b4cb-aa8ddddce7b2 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:22.069195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07067ca-653d-4b08-b4cb-aa8ddddce7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:22.069457 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07067ca-653d-4b08-b4cb-aa8ddddce7b2 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:22.070116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07067ca-653d-4b08-b4cb-aa8ddddce7b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:22.071629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07067ca-653d-4b08-b4cb-aa8ddddce7b2 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:22.100879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:22.122638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 120/241] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:12:21 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:12:22.206476 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4009-4838-4d49-a78c-d4da6b919227 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:22.253600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586f8c3-8139-41c4-9e87-1f95d8bb6b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:22.254621 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f8c3-8139-41c4-9e87-1f95d8bb6b93 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:22.255108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f8c3-8139-41c4-9e87-1f95d8bb6b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:22.255573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f8c3-8139-41c4-9e87-1f95d8bb6b93 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:22.256478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586f8c3-8139-41c4-9e87-1f95d8bb6b93 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:22.256986 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586f8c3-8139-41c4-9e87-1f95d8bb6b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:22.258706 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586f8c3-8139-41c4-9e87-1f95d8bb6b93 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:22.269527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 122/242] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:22.275434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07067ca-653d-4b08-b4cb-aa8ddddce7b2 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:22.432842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07067ca-653d-4b08-b4cb-aa8ddddce7b2 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:22.496086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24777b60-a25f-4e04-83af-9989d2eb685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:22.497628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24777b60-a25f-4e04-83af-9989d2eb685f None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:22.498345 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24777b60-a25f-4e04-83af-9989d2eb685f None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:22.499117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24777b60-a25f-4e04-83af-9989d2eb685f None admin] PATH_INFO: `/v3/users/50fb40ff0acf47169e0a9acb676e23ce` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:22.525664 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24777b60-a25f-4e04-83af-9989d2eb685f None admin] RBAC: Authorizing `identity:get_user(user_id=50fb40ff0acf47169e0a9acb676e23ce)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:22.528884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24777b60-a25f-4e04-83af-9989d2eb685f None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:22.532639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 121/243] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:22 2022] GET /identity/v3/users/50fb40ff0acf47169e0a9acb676e23ce => generated 297 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:22.538487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586f8c3-8139-41c4-9e87-1f95d8bb6b93 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:22.567194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:22.643619 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfce3c-e530-4902-9b2e-d76b83ad390d None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:22.644232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfce3c-e530-4902-9b2e-d76b83ad390d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:22.644894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfce3c-e530-4902-9b2e-d76b83ad390d None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:22.647185 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 122/244] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:22.654388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff081c-cf5c-4fcd-ae29-5f88110cef34 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:22.655280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff081c-cf5c-4fcd-ae29-5f88110cef34 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:22.655474 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586f8c3-8139-41c4-9e87-1f95d8bb6b93 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:22.655965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff081c-cf5c-4fcd-ae29-5f88110cef34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:22.683215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-0cff081c-cf5c-4fcd-ae29-5f88110cef34 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:22.685872 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0cff081c-cf5c-4fcd-ae29-5f88110cef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:22.712255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9d9b3-9159-40a1-a2b9-fdf2d1453dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:22.712888 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9d9b3-9159-40a1-a2b9-fdf2d1453dfb None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:22.713180 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9d9b3-9159-40a1-a2b9-fdf2d1453dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:22.713431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9d9b3-9159-40a1-a2b9-fdf2d1453dfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:22.768778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:22.787097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 123/245] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:22.788759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbec77-73b9-4e87-bac5-d907b7b45aa4 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:22.789240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbec77-73b9-4e87-bac5-d907b7b45aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:22.789721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbec77-73b9-4e87-bac5-d907b7b45aa4 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:22.791482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 124/246] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:22.800714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90833b-6bf6-479d-8ca3-6e3447d1b883 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:22.801497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90833b-6bf6-479d-8ca3-6e3447d1b883 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:22.802683 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90833b-6bf6-479d-8ca3-6e3447d1b883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:22.803080 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9d9b3-9159-40a1-a2b9-fdf2d1453dfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:22.804570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9d9b3-9159-40a1-a2b9-fdf2d1453dfb None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:22.834494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:22.835161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-5e90833b-6bf6-479d-8ca3-6e3447d1b883 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:22.836489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5e90833b-6bf6-479d-8ca3-6e3447d1b883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:22.918511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 125/247] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:22.920400 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90833b-6bf6-479d-8ca3-6e3447d1b883 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:22.940896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 123/248] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:22.945824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9d9b3-9159-40a1-a2b9-fdf2d1453dfb None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:23.039601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90833b-6bf6-479d-8ca3-6e3447d1b883 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:23.052453 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9d9b3-9159-40a1-a2b9-fdf2d1453dfb None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:23.064067 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:23.091195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:23.091606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed70586-953e-4d56-83a9-6d3fc840fce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:23.092403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed70586-953e-4d56-83a9-6d3fc840fce8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:23.092510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed70586-953e-4d56-83a9-6d3fc840fce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:23.092778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed70586-953e-4d56-83a9-6d3fc840fce8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:23.109414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f6ee2-f374-4fda-afee-5d2535685b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:23.110060 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f6ee2-f374-4fda-afee-5d2535685b38 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:23.110336 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f6ee2-f374-4fda-afee-5d2535685b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:23.110606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f6ee2-f374-4fda-afee-5d2535685b38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:23.122315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f6ee2-f374-4fda-afee-5d2535685b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-439f6ee2-f374-4fda-afee-5d2535685b38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:23.127148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:23.128198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:23.129018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:23.129018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:23.129018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:23.129018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:23.129018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:23.129018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:23.129018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:23.129018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:23.129018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:23.129018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:23.129018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:23.129018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:23.129018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 124/249] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:23.129691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f6ee2-f374-4fda-afee-5d2535685b38 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:23.135496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed70586-953e-4d56-83a9-6d3fc840fce8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-aed70586-953e-4d56-83a9-6d3fc840fce8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:23.140365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:23.141286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:23.143187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:23.143187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:23.143187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:23.143187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:23.143187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:23.143187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:23.143187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:23.143187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:23.143187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:23.143187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:23.143187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:23.143187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:23.143187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 126/250] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:12:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:23.143187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed70586-953e-4d56-83a9-6d3fc840fce8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:23.264930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f6ee2-f374-4fda-afee-5d2535685b38 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:23.304356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108821d-6662-498d-aa92-ff824540aeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:23.304916 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108821d-6662-498d-aa92-ff824540aeca None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:23.305192 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108821d-6662-498d-aa92-ff824540aeca None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:23.305464 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108821d-6662-498d-aa92-ff824540aeca None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:23.306610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108821d-6662-498d-aa92-ff824540aeca None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:23.308132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108821d-6662-498d-aa92-ff824540aeca None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:23.310113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 125/251] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:23 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:23.310844 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108821d-6662-498d-aa92-ff824540aeca None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:23.356998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed70586-953e-4d56-83a9-6d3fc840fce8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:23.367843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:23.425146 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108821d-6662-498d-aa92-ff824540aeca None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:23.447587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a45958-238a-4ec0-8dd7-d076ea8acfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:23.448211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a45958-238a-4ec0-8dd7-d076ea8acfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:23.448480 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a45958-238a-4ec0-8dd7-d076ea8acfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:23.448738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a45958-238a-4ec0-8dd7-d076ea8acfb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:23.449409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a45958-238a-4ec0-8dd7-d076ea8acfb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:23.449704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a45958-238a-4ec0-8dd7-d076ea8acfb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:23.451148 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a45958-238a-4ec0-8dd7-d076ea8acfb4 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:23.460633 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7cb40-7b72-4f02-b552-02e70ff0e341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:23.461254 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7cb40-7b72-4f02-b552-02e70ff0e341 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:23.461530 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7cb40-7b72-4f02-b552-02e70ff0e341 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:23.461803 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7cb40-7b72-4f02-b552-02e70ff0e341 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:23.462471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7cb40-7b72-4f02-b552-02e70ff0e341 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:23.462768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7cb40-7b72-4f02-b552-02e70ff0e341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:23.464349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7cb40-7b72-4f02-b552-02e70ff0e341 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:23.471673 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 127/252] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:23.472562 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a45958-238a-4ec0-8dd7-d076ea8acfb4 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:23.473163 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 126/253] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:23.487607 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7cb40-7b72-4f02-b552-02e70ff0e341 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:23.562652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:23.675116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a45958-238a-4ec0-8dd7-d076ea8acfb4 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:23.687415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7cb40-7b72-4f02-b552-02e70ff0e341 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:23.711729 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:23.743321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb279f5d-e3c1-46c7-a4bb-0d12ca7db2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:23.743968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb279f5d-e3c1-46c7-a4bb-0d12ca7db2ea None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:23.744245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb279f5d-e3c1-46c7-a4bb-0d12ca7db2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:23.744517 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb279f5d-e3c1-46c7-a4bb-0d12ca7db2ea None admin] PATH_INFO: `/v3/users/509afbda39a94365b5eb36a2b39bc068` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:23.748797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb279f5d-e3c1-46c7-a4bb-0d12ca7db2ea None admin] RBAC: Authorizing `identity:get_user(user_id=509afbda39a94365b5eb36a2b39bc068)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:23.750289 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb279f5d-e3c1-46c7-a4bb-0d12ca7db2ea None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:23.753467 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcb202-a1e8-4576-974d-1856f21a1fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:23.754084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcb202-a1e8-4576-974d-1856f21a1fcb None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:23.754362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcb202-a1e8-4576-974d-1856f21a1fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:23.754630 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcb202-a1e8-4576-974d-1856f21a1fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:23.755410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcb202-a1e8-4576-974d-1856f21a1fcb None admin] RBAC: Adding query filter params (role.id=b8a55f2fb9954ee99b8328fec6560de4, scope.project.id=b3ad94df1ce64d468d45f26d20103ef1, user.id=50fb40ff0acf47169e0a9acb676e23ce) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:23.755719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcb202-a1e8-4576-974d-1856f21a1fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:23.757200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcb202-a1e8-4576-974d-1856f21a1fcb None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:23.759328 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 127/254] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:23 2022] GET /identity/v3/users/509afbda39a94365b5eb36a2b39bc068 => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:23.760291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb279f5d-e3c1-46c7-a4bb-0d12ca7db2ea None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:23.775420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 128/255] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:23 2022] GET /identity/v3/role_assignments?user.id=50fb40ff0acf47169e0a9acb676e23ce&scope.project.id=b3ad94df1ce64d468d45f26d20103ef1&role.id=b8a55f2fb9954ee99b8328fec6560de4 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:23.776309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcb202-a1e8-4576-974d-1856f21a1fcb None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:23.965878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcb202-a1e8-4576-974d-1856f21a1fcb None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:23.967796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:23.974888 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb279f5d-e3c1-46c7-a4bb-0d12ca7db2ea None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:24.032871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef195f7-ee20-4360-b93a-ef7f0630a54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:24.033536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef195f7-ee20-4360-b93a-ef7f0630a54e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:24.033809 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef195f7-ee20-4360-b93a-ef7f0630a54e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:24.034152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef195f7-ee20-4360-b93a-ef7f0630a54e None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:24.038141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef195f7-ee20-4360-b93a-ef7f0630a54e None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:24.039671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef195f7-ee20-4360-b93a-ef7f0630a54e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:24.041412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 129/256] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:23 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:24.048120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef195f7-ee20-4360-b93a-ef7f0630a54e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:24.062043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec3644-9610-4c7d-9f8b-ec5e8b0f3156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:24.062705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3644-9610-4c7d-9f8b-ec5e8b0f3156 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:24.063008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3644-9610-4c7d-9f8b-ec5e8b0f3156 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:24.063273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3644-9610-4c7d-9f8b-ec5e8b0f3156 None admin] PATH_INFO: `/v3/users/9d454c8da91947788bf9195ecb53c5e5` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:24.064418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec3644-9610-4c7d-9f8b-ec5e8b0f3156 None admin] RBAC: Authorizing `identity:get_user(user_id=9d454c8da91947788bf9195ecb53c5e5)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:24.065983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec3644-9610-4c7d-9f8b-ec5e8b0f3156 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:24.067610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 128/257] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:23 2022] GET /identity/v3/users/9d454c8da91947788bf9195ecb53c5e5 => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:24.073767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec3644-9610-4c7d-9f8b-ec5e8b0f3156 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:24.147197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:24.201297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec3644-9610-4c7d-9f8b-ec5e8b0f3156 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:24.216646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef195f7-ee20-4360-b93a-ef7f0630a54e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:24.245907 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b920c07-fde8-4b02-8408-0c679a9b8b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:24.246537 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b920c07-fde8-4b02-8408-0c679a9b8b78 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:24.246806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b920c07-fde8-4b02-8408-0c679a9b8b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:24.247096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b920c07-fde8-4b02-8408-0c679a9b8b78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:24.256073 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c362386-56b7-4506-81f0-2133ff0af9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:24.256737 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c362386-56b7-4506-81f0-2133ff0af9ac None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:24.257008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c362386-56b7-4506-81f0-2133ff0af9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:24.257273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c362386-56b7-4506-81f0-2133ff0af9ac None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1/users/509afbda39a94365b5eb36a2b39bc068/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:24.259288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c362386-56b7-4506-81f0-2133ff0af9ac None admin] RBAC: Authorizing `identity:create_grant(project_id=b3ad94df1ce64d468d45f26d20103ef1, user_id=509afbda39a94365b5eb36a2b39bc068, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:24.260757 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c362386-56b7-4506-81f0-2133ff0af9ac None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:24.285412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 130/258] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:12:24 2022] PUT /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1/users/509afbda39a94365b5eb36a2b39bc068/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:12:24.331637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b920c07-fde8-4b02-8408-0c679a9b8b78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:24.333151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b920c07-fde8-4b02-8408-0c679a9b8b78 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:24.387477 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:24.449981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 129/259] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:24.456495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c362386-56b7-4506-81f0-2133ff0af9ac None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:24.518850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:24.573302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e905-f474-442c-abad-e4445bb88fba None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:24.577458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e905-f474-442c-abad-e4445bb88fba None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:24.578113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e905-f474-442c-abad-e4445bb88fba None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:24.579817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 130/260] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:24.586399 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba3db9-a6fd-4ff9-80d0-5bc3f51ccf6d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:24.587035 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba3db9-a6fd-4ff9-80d0-5bc3f51ccf6d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:24.587523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba3db9-a6fd-4ff9-80d0-5bc3f51ccf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:24.618915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c362386-56b7-4506-81f0-2133ff0af9ac None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:24.620222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ffba3db9-a6fd-4ff9-80d0-5bc3f51ccf6d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:24.621979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ffba3db9-a6fd-4ff9-80d0-5bc3f51ccf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:24.697051 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674002a-c20c-4f67-9b3a-b524486f9fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:24.697975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674002a-c20c-4f67-9b3a-b524486f9fec None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:24.697975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674002a-c20c-4f67-9b3a-b524486f9fec None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:24.698222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674002a-c20c-4f67-9b3a-b524486f9fec None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:24.699440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674002a-c20c-4f67-9b3a-b524486f9fec None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:24.700946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674002a-c20c-4f67-9b3a-b524486f9fec None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:24.702661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 131/261] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:24 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:24.708893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674002a-c20c-4f67-9b3a-b524486f9fec None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:24.728410 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 131/262] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:24.758200 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba3db9-a6fd-4ff9-80d0-5bc3f51ccf6d None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:24.899769 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:24.907347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:24.911472 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674002a-c20c-4f67-9b3a-b524486f9fec None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:24.957075 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba3db9-a6fd-4ff9-80d0-5bc3f51ccf6d None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:24.988617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a423d-2368-487d-9447-26c61c011a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:24.989245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a423d-2368-487d-9447-26c61c011a96 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:24.989525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a423d-2368-487d-9447-26c61c011a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:24.989800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a423d-2368-487d-9447-26c61c011a96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:24.990649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a423d-2368-487d-9447-26c61c011a96 None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=b3ad94df1ce64d468d45f26d20103ef1, user.id=9d454c8da91947788bf9195ecb53c5e5) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:24.990985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a423d-2368-487d-9447-26c61c011a96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:24.992624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a423d-2368-487d-9447-26c61c011a96 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:25.006322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 132/263] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:24 2022] GET /identity/v3/role_assignments?user.id=9d454c8da91947788bf9195ecb53c5e5&scope.project.id=b3ad94df1ce64d468d45f26d20103ef1&role.id=169d11e171d04c87af71475295957618 => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:25.032836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02aec9-3555-4d27-8f98-be8017826a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:25.033504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02aec9-3555-4d27-8f98-be8017826a8e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:25.033774 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02aec9-3555-4d27-8f98-be8017826a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:25.034083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02aec9-3555-4d27-8f98-be8017826a8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:25.060144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02aec9-3555-4d27-8f98-be8017826a8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-dd02aec9-3555-4d27-8f98-be8017826a8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:25.065020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:25.065946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:25.066754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:25.066754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:25.066754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:25.066754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:25.066754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:25.066754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:25.066754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:25.066754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:25.066754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:25.066754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:25.066754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:25.066754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:25.066754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 132/264] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:12:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:25.072823 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a423d-2368-487d-9447-26c61c011a96 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:25.210155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a423d-2368-487d-9447-26c61c011a96 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:25.258430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e16d88-fcc3-40d3-b11f-f63ad52d423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:25.259101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e16d88-fcc3-40d3-b11f-f63ad52d423a None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:25.259377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e16d88-fcc3-40d3-b11f-f63ad52d423a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:25.259646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e16d88-fcc3-40d3-b11f-f63ad52d423a None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:25.260326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e16d88-fcc3-40d3-b11f-f63ad52d423a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:25.260624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e16d88-fcc3-40d3-b11f-f63ad52d423a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:25.262059 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e16d88-fcc3-40d3-b11f-f63ad52d423a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:25.271626 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 133/265] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:25.277373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02aec9-3555-4d27-8f98-be8017826a8e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:25.374789 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcfbed-9dc0-4fdf-8743-d9f5a1558b02 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:25.375155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcfbed-9dc0-4fdf-8743-d9f5a1558b02 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:25.375364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcfbed-9dc0-4fdf-8743-d9f5a1558b02 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:25.376968 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 134/266] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:25.392342 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f7c16-fc04-45b4-b16e-04f87dcea024 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:25.392698 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f7c16-fc04-45b4-b16e-04f87dcea024 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:25.392895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f7c16-fc04-45b4-b16e-04f87dcea024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:25.436430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-186f7c16-fc04-45b4-b16e-04f87dcea024 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:25.438314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-186f7c16-fc04-45b4-b16e-04f87dcea024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:25.446750 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02aec9-3555-4d27-8f98-be8017826a8e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:25.497584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:25.516197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956c39d-4a5c-4230-9966-b32f82b1da2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:25.516851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956c39d-4a5c-4230-9966-b32f82b1da2d None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:25.517121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956c39d-4a5c-4230-9966-b32f82b1da2d None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:25.517384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956c39d-4a5c-4230-9966-b32f82b1da2d None admin] PATH_INFO: `/v3/users/9d454c8da91947788bf9195ecb53c5e5` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:25.519417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956c39d-4a5c-4230-9966-b32f82b1da2d None admin] RBAC: Authorizing `identity:get_user(user_id=9d454c8da91947788bf9195ecb53c5e5)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:25.520904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956c39d-4a5c-4230-9966-b32f82b1da2d None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:25.524607 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 133/267] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:25 2022] GET /identity/v3/users/9d454c8da91947788bf9195ecb53c5e5 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:25.528995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956c39d-4a5c-4230-9966-b32f82b1da2d None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:25.562678 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:25.605662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 135/268] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:25.623103 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68576c8e-03b0-4f89-b83a-65996cc1bace None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:25.623422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68576c8e-03b0-4f89-b83a-65996cc1bace None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:25.623647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68576c8e-03b0-4f89-b83a-65996cc1bace None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:25.625308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 136/269] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:25.636556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7293e0-0be4-4c6d-95a9-a192a95189bc None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:25.636883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7293e0-0be4-4c6d-95a9-a192a95189bc None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:25.637093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7293e0-0be4-4c6d-95a9-a192a95189bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:25.661892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-ab7293e0-0be4-4c6d-95a9-a192a95189bc None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:25.663145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ab7293e0-0be4-4c6d-95a9-a192a95189bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:25.710382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956c39d-4a5c-4230-9966-b32f82b1da2d None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:25.757004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed6200-03c5-457b-a173-7b548361fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:25.758237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed6200-03c5-457b-a173-7b548361fb1f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:25.759134 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed6200-03c5-457b-a173-7b548361fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:25.759608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed6200-03c5-457b-a173-7b548361fb1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:25.769980 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 137/270] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:25.769980 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7293e0-0be4-4c6d-95a9-a192a95189bc None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:25.856909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed6200-03c5-457b-a173-7b548361fb1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:25.859098 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed6200-03c5-457b-a173-7b548361fb1f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:25.872726 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:25.917770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:25.939357 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7293e0-0be4-4c6d-95a9-a192a95189bc None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:25.981311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b45ab9-220e-4759-87a5-c91aeb6b1c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:25.981966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b45ab9-220e-4759-87a5-c91aeb6b1c97 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:25.982240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b45ab9-220e-4759-87a5-c91aeb6b1c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:25.982513 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b45ab9-220e-4759-87a5-c91aeb6b1c97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:25.983812 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b45ab9-220e-4759-87a5-c91aeb6b1c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:25.985307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b45ab9-220e-4759-87a5-c91aeb6b1c97 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:25.987173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 138/271] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:25.988032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b45ab9-220e-4759-87a5-c91aeb6b1c97 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:26.008584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 134/272] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:26.009401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed6200-03c5-457b-a173-7b548361fb1f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:26.117218 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed6200-03c5-457b-a173-7b548361fb1f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:26.117879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b45ab9-220e-4759-87a5-c91aeb6b1c97 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:26.127832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:26.155065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459efde6-802e-43a5-b92c-633f0940e2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:26.155936 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efde6-802e-43a5-b92c-633f0940e2b2 None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:26.156392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efde6-802e-43a5-b92c-633f0940e2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:26.156803 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efde6-802e-43a5-b92c-633f0940e2b2 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:26.157602 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459efde6-802e-43a5-b92c-633f0940e2b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:26.159354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459efde6-802e-43a5-b92c-633f0940e2b2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:26.163634 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc3356-3e3f-48ff-bea6-4e61b5429fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:26.164269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc3356-3e3f-48ff-bea6-4e61b5429fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:26.164547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc3356-3e3f-48ff-bea6-4e61b5429fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:26.164799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc3356-3e3f-48ff-bea6-4e61b5429fe8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:26.180227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc3356-3e3f-48ff-bea6-4e61b5429fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-32bc3356-3e3f-48ff-bea6-4e61b5429fe8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:26.185162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:26.186308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:26.187238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:26.187238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:26.187238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:26.187238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:26.187238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:26.187238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:26.187238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:26.187238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:26.187238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:26.187238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:26.187238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:26.187238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:26.187238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 139/273] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:26.187238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc3356-3e3f-48ff-bea6-4e61b5429fe8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:26.192343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 135/274] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:12:26 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:12:26.202384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459efde6-802e-43a5-b92c-633f0940e2b2 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:26.205766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:26.321208 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc3356-3e3f-48ff-bea6-4e61b5429fe8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:26.365305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d6ff8-73fa-4626-a203-fb5cc8f219fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:26.365957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d6ff8-73fa-4626-a203-fb5cc8f219fb None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:26.366226 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d6ff8-73fa-4626-a203-fb5cc8f219fb None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:26.366488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d6ff8-73fa-4626-a203-fb5cc8f219fb None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:26.369023 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d6ff8-73fa-4626-a203-fb5cc8f219fb None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:26.370938 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d6ff8-73fa-4626-a203-fb5cc8f219fb None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:26.372936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 140/275] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:26 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:26.379001 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d6ff8-73fa-4626-a203-fb5cc8f219fb None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:26.451973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459efde6-802e-43a5-b92c-633f0940e2b2 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:26.489542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba302de7-10c1-46a5-b072-1081747a3b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:26.490514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba302de7-10c1-46a5-b072-1081747a3b86 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:26.491013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba302de7-10c1-46a5-b072-1081747a3b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:26.491504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba302de7-10c1-46a5-b072-1081747a3b86 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:26.492391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba302de7-10c1-46a5-b072-1081747a3b86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:26.492883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba302de7-10c1-46a5-b072-1081747a3b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:26.494491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba302de7-10c1-46a5-b072-1081747a3b86 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:26.503759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:26.504686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 136/276] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:26.511953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba302de7-10c1-46a5-b072-1081747a3b86 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:26.531653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d6ff8-73fa-4626-a203-fb5cc8f219fb None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:26.544256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:26.577643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b68674-93d1-4746-bea9-227a6ffc6f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:26.578607 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b68674-93d1-4746-bea9-227a6ffc6f66 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:26.579110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b68674-93d1-4746-bea9-227a6ffc6f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:26.579562 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b68674-93d1-4746-bea9-227a6ffc6f66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:26.580476 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b68674-93d1-4746-bea9-227a6ffc6f66 None admin] RBAC: Adding query filter params (role.id=6b72aeaf7c3646bdb33b40a371cc4d44, scope.project.id=b3ad94df1ce64d468d45f26d20103ef1, user.id=9d454c8da91947788bf9195ecb53c5e5) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:26.581090 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b68674-93d1-4746-bea9-227a6ffc6f66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:26.582794 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b68674-93d1-4746-bea9-227a6ffc6f66 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:26.589773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 141/277] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:26 2022] GET /identity/v3/role_assignments?user.id=9d454c8da91947788bf9195ecb53c5e5&scope.project.id=b3ad94df1ce64d468d45f26d20103ef1&role.id=6b72aeaf7c3646bdb33b40a371cc4d44 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:26.634000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba302de7-10c1-46a5-b072-1081747a3b86 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:26.673700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfffa90-36d7-4964-a0da-ae7f53882846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:26.674370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfffa90-36d7-4964-a0da-ae7f53882846 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:26.674646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfffa90-36d7-4964-a0da-ae7f53882846 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:26.675174 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfffa90-36d7-4964-a0da-ae7f53882846 None admin] PATH_INFO: `/v3/users/c313b03cc5e3472d8f8dc5537854539f` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:26.691691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfffa90-36d7-4964-a0da-ae7f53882846 None admin] RBAC: Authorizing `identity:get_user(user_id=c313b03cc5e3472d8f8dc5537854539f)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:26.693320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfffa90-36d7-4964-a0da-ae7f53882846 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:26.695400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 137/278] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:26 2022] GET /identity/v3/users/c313b03cc5e3472d8f8dc5537854539f => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:26.701538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b68674-93d1-4746-bea9-227a6ffc6f66 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:26.791500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35213550-3892-4123-9156-0be4e25ac2db None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:26.791842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35213550-3892-4123-9156-0be4e25ac2db None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:26.792047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35213550-3892-4123-9156-0be4e25ac2db None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:26.793639 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 138/279] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:26.799433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa200fa-498a-495b-ab76-521f5341f715 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:26.799787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa200fa-498a-495b-ab76-521f5341f715 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:26.800027 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa200fa-498a-495b-ab76-521f5341f715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:26.820336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b68674-93d1-4746-bea9-227a6ffc6f66 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:26.830582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-baa200fa-498a-495b-ab76-521f5341f715 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:26.832556 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-baa200fa-498a-495b-ab76-521f5341f715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:26.869282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c68c27-7c4e-4109-8e08-48373f945e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:26.870058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c68c27-7c4e-4109-8e08-48373f945e57 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:26.870713 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c68c27-7c4e-4109-8e08-48373f945e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:26.871039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c68c27-7c4e-4109-8e08-48373f945e57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:26.871805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c68c27-7c4e-4109-8e08-48373f945e57 None admin] RBAC: Adding query filter params (role.id=04b89a35fc5442af92047f11f75d7b14, user.id=c313b03cc5e3472d8f8dc5537854539f, scope.system=all) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:26.872111 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c68c27-7c4e-4109-8e08-48373f945e57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:26.874490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c68c27-7c4e-4109-8e08-48373f945e57 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:26.883170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 142/280] 10.222.0.59 () {56 vars in 1308 bytes} [Tue Aug 9 11:12:26 2022] GET /identity/v3/role_assignments?user.id=c313b03cc5e3472d8f8dc5537854539f&scope.system=all&role.id=04b89a35fc5442af92047f11f75d7b14 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:26.928776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 139/281] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:26.952112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c68c27-7c4e-4109-8e08-48373f945e57 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:26.964948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:27.071145 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b346e74-cd20-47ae-a935-2ee7c22004cf None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:27.071456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b346e74-cd20-47ae-a935-2ee7c22004cf None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:27.071688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b346e74-cd20-47ae-a935-2ee7c22004cf None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:27.072000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c68c27-7c4e-4109-8e08-48373f945e57 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:27.073461 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 140/282] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:27.079368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ff32d-91d8-452d-bf79-1cf9871a0261 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:27.079643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ff32d-91d8-452d-bf79-1cf9871a0261 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:27.079937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ff32d-91d8-452d-bf79-1cf9871a0261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:27.114317 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044e534-35aa-44f9-84d3-f158306a9f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:27.114998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044e534-35aa-44f9-84d3-f158306a9f34 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:27.115261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-298ff32d-91d8-452d-bf79-1cf9871a0261 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:27.115373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044e534-35aa-44f9-84d3-f158306a9f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:27.115527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044e534-35aa-44f9-84d3-f158306a9f34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:27.116806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-298ff32d-91d8-452d-bf79-1cf9871a0261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:27.134853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044e534-35aa-44f9-84d3-f158306a9f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:27.134853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-e044e534-35aa-44f9-84d3-f158306a9f34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:27.134853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:27.134853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:27.134853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:27.134853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:27.134853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:27.134853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:27.134853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:27.134853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:27.134853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:27.134853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:27.134853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:27.134853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:27.135877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:27.136714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 143/283] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:27.141907 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:27.142394 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044e534-35aa-44f9-84d3-f158306a9f34 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:27.216734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:27.227015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 141/284] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:27.268364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ff32d-91d8-452d-bf79-1cf9871a0261 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:27.276383 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044e534-35aa-44f9-84d3-f158306a9f34 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:27.371680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bf6d3-93d6-41a3-b76c-540b93e79814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:27.372227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf6d3-93d6-41a3-b76c-540b93e79814 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:27.372503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf6d3-93d6-41a3-b76c-540b93e79814 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:27.372770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf6d3-93d6-41a3-b76c-540b93e79814 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:27.373537 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bf6d3-93d6-41a3-b76c-540b93e79814 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:27.373841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bf6d3-93d6-41a3-b76c-540b93e79814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:27.375285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bf6d3-93d6-41a3-b76c-540b93e79814 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:27.390222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ff32d-91d8-452d-bf79-1cf9871a0261 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:27.391297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 144/285] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:27.399087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bf6d3-93d6-41a3-b76c-540b93e79814 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:27.434728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616393e-d557-4736-ae16-ba45e221ed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:27.435419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616393e-d557-4736-ae16-ba45e221ed82 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:27.435694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616393e-d557-4736-ae16-ba45e221ed82 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:27.436312 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616393e-d557-4736-ae16-ba45e221ed82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:27.450169 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616393e-d557-4736-ae16-ba45e221ed82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-1616393e-d557-4736-ae16-ba45e221ed82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:27.455292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:27.456291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:27.457560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:27.457560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:27.457560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:27.457560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:27.457560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:27.457560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:27.457560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:27.457560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:27.457560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:27.457560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:27.457560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:27.457560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:27.457560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 142/286] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:27.467220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616393e-d557-4736-ae16-ba45e221ed82 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:27.471970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:27.541086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bf6d3-93d6-41a3-b76c-540b93e79814 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:27.574009 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:27.582465 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0674777-285c-4838-ba69-f1a664b92b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:27.583282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0674777-285c-4838-ba69-f1a664b92b2d None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:27.583654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0674777-285c-4838-ba69-f1a664b92b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:27.584012 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0674777-285c-4838-ba69-f1a664b92b2d None admin] PATH_INFO: `/v3/users/50fb40ff0acf47169e0a9acb676e23ce` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:27.585275 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0674777-285c-4838-ba69-f1a664b92b2d None admin] RBAC: Authorizing `identity:get_user(user_id=50fb40ff0acf47169e0a9acb676e23ce)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:27.587435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0674777-285c-4838-ba69-f1a664b92b2d None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:27.589583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 145/287] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:27 2022] GET /identity/v3/users/50fb40ff0acf47169e0a9acb676e23ce => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:27.597559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0674777-285c-4838-ba69-f1a664b92b2d None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:27.671504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616393e-d557-4736-ae16-ba45e221ed82 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:27.722505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89780bb0-5e22-4518-b05a-93c46b9073b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:27.723301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89780bb0-5e22-4518-b05a-93c46b9073b6 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:27.723576 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89780bb0-5e22-4518-b05a-93c46b9073b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:27.723843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89780bb0-5e22-4518-b05a-93c46b9073b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:27.724514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89780bb0-5e22-4518-b05a-93c46b9073b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:27.724816 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89780bb0-5e22-4518-b05a-93c46b9073b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:27.726577 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89780bb0-5e22-4518-b05a-93c46b9073b6 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:27.736734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 143/288] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:27.743229 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89780bb0-5e22-4518-b05a-93c46b9073b6 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:27.812540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0674777-285c-4838-ba69-f1a664b92b2d None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:27.864365 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:27.881757 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a0361-0334-45b1-9cce-224d1e284ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:27.882395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a0361-0334-45b1-9cce-224d1e284ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:27.882667 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a0361-0334-45b1-9cce-224d1e284ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:27.882960 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a0361-0334-45b1-9cce-224d1e284ea6 None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:27.885674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a0361-0334-45b1-9cce-224d1e284ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:27.887165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a0361-0334-45b1-9cce-224d1e284ea6 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:27.890397 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 146/289] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:27 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:27.898333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a0361-0334-45b1-9cce-224d1e284ea6 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:27.934418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89780bb0-5e22-4518-b05a-93c46b9073b6 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:27.994149 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:27.997705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c662e8-3f37-45cf-a699-2415e82d86b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:27.998424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c662e8-3f37-45cf-a699-2415e82d86b0 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:27.998705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c662e8-3f37-45cf-a699-2415e82d86b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:27.999002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c662e8-3f37-45cf-a699-2415e82d86b0 None admin] PATH_INFO: `/v3/users/509afbda39a94365b5eb36a2b39bc068` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:28.001878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c662e8-3f37-45cf-a699-2415e82d86b0 None admin] RBAC: Authorizing `identity:get_user(user_id=509afbda39a94365b5eb36a2b39bc068)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:28.003431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c662e8-3f37-45cf-a699-2415e82d86b0 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:28.005108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 144/290] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:27 2022] GET /identity/v3/users/509afbda39a94365b5eb36a2b39bc068 => generated 297 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:28.012270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c662e8-3f37-45cf-a699-2415e82d86b0 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:28.037837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a0361-0334-45b1-9cce-224d1e284ea6 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:28.095659 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f006049-25ce-4ab1-904e-dee24906a25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:28.096339 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f006049-25ce-4ab1-904e-dee24906a25b None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:28.096702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f006049-25ce-4ab1-904e-dee24906a25b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:28.096980 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f006049-25ce-4ab1-904e-dee24906a25b None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1/users/50fb40ff0acf47169e0a9acb676e23ce/roles/b8a55f2fb9954ee99b8328fec6560de4` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:28.098982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f006049-25ce-4ab1-904e-dee24906a25b None admin] RBAC: Authorizing `identity:create_grant(project_id=b3ad94df1ce64d468d45f26d20103ef1, user_id=50fb40ff0acf47169e0a9acb676e23ce, role_id=b8a55f2fb9954ee99b8328fec6560de4)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:28.109468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f006049-25ce-4ab1-904e-dee24906a25b None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:28.137100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 147/291] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:12:27 2022] PUT /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1/users/50fb40ff0acf47169e0a9acb676e23ce/roles/b8a55f2fb9954ee99b8328fec6560de4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:12:28.167240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c662e8-3f37-45cf-a699-2415e82d86b0 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:28.206773 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a708f-e615-4c5e-a0aa-8f0fa638bc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:28.207740 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a708f-e615-4c5e-a0aa-8f0fa638bc4e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:28.208186 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a708f-e615-4c5e-a0aa-8f0fa638bc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:28.208602 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a708f-e615-4c5e-a0aa-8f0fa638bc4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:28.212099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:28.286255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a708f-e615-4c5e-a0aa-8f0fa638bc4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:28.287781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a708f-e615-4c5e-a0aa-8f0fa638bc4e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:28.396282 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 145/292] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:12:28.403943 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f006049-25ce-4ab1-904e-dee24906a25b None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:28.521906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f006049-25ce-4ab1-904e-dee24906a25b None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:28.548696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:28.560444 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae58d0-b5ca-4e3e-80cf-64fc9818eda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:28.561132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae58d0-b5ca-4e3e-80cf-64fc9818eda2 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:28.561412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae58d0-b5ca-4e3e-80cf-64fc9818eda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:28.561679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae58d0-b5ca-4e3e-80cf-64fc9818eda2 None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:28.562845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae58d0-b5ca-4e3e-80cf-64fc9818eda2 None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:28.564328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae58d0-b5ca-4e3e-80cf-64fc9818eda2 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:28.566136 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 148/293] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:28 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:28.574425 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a708f-e615-4c5e-a0aa-8f0fa638bc4e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:28.609747 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:28.679782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a708f-e615-4c5e-a0aa-8f0fa638bc4e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:28.715738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3722944-fb67-4231-9287-945b9c72c72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:28.716348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3722944-fb67-4231-9287-945b9c72c72a None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:28.716618 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3722944-fb67-4231-9287-945b9c72c72a None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:28.716887 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3722944-fb67-4231-9287-945b9c72c72a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:28.717684 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3722944-fb67-4231-9287-945b9c72c72a None admin] RBAC: Adding query filter params (role.id=04b89a35fc5442af92047f11f75d7b14, scope.project.id=b3ad94df1ce64d468d45f26d20103ef1, user.id=509afbda39a94365b5eb36a2b39bc068) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:28.718076 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3722944-fb67-4231-9287-945b9c72c72a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:28.719578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3722944-fb67-4231-9287-945b9c72c72a None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:28.726185 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 146/294] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:28 2022] GET /identity/v3/role_assignments?user.id=509afbda39a94365b5eb36a2b39bc068&scope.project.id=b3ad94df1ce64d468d45f26d20103ef1&role.id=04b89a35fc5442af92047f11f75d7b14 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:29.145236 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8276a-d46c-4fc9-8279-1da78d75d37d None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:29.145762 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8276a-d46c-4fc9-8279-1da78d75d37d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:29.145762 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8276a-d46c-4fc9-8279-1da78d75d37d None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:29.147521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 149/295] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:29.153555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57699c-35d9-4627-aabd-bec402717f96 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:29.153880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57699c-35d9-4627-aabd-bec402717f96 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:29.154097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57699c-35d9-4627-aabd-bec402717f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:29.174568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ee57699c-35d9-4627-aabd-bec402717f96 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:29.175878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ee57699c-35d9-4627-aabd-bec402717f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:29.252104 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 147/296] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:29.275852 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdfd7f-266f-4c49-9d8d-ddf1b1cb998d None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:29.276168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdfd7f-266f-4c49-9d8d-ddf1b1cb998d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:29.276405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdfd7f-266f-4c49-9d8d-ddf1b1cb998d None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:29.278047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 150/297] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:29.278173 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57699c-35d9-4627-aabd-bec402717f96 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:29.294288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adc41b-4838-45c7-ad89-18aee80533bc None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:29.294618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adc41b-4838-45c7-ad89-18aee80533bc None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:29.294835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adc41b-4838-45c7-ad89-18aee80533bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:29.319198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:29.320312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a0adc41b-4838-45c7-ad89-18aee80533bc None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:29.321676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a0adc41b-4838-45c7-ad89-18aee80533bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:29.391973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57699c-35d9-4627-aabd-bec402717f96 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:29.415176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 151/298] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:29.436070 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded1658-e9a9-436f-b2a5-c8cbf1bdaa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:29.436759 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded1658-e9a9-436f-b2a5-c8cbf1bdaa63 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:29.437032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded1658-e9a9-436f-b2a5-c8cbf1bdaa63 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:29.437297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded1658-e9a9-436f-b2a5-c8cbf1bdaa63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:29.441878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adc41b-4838-45c7-ad89-18aee80533bc None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:29.449560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded1658-e9a9-436f-b2a5-c8cbf1bdaa63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-dded1658-e9a9-436f-b2a5-c8cbf1bdaa63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:29.455427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:29.456392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:29.457361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:29.457361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:29.457361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:29.457361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:29.457361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:29.457361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:29.457361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:29.457361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:29.457361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:29.457361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:29.457361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:29.457361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:29.459767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 148/299] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:29.465785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded1658-e9a9-436f-b2a5-c8cbf1bdaa63 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:29.554252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adc41b-4838-45c7-ad89-18aee80533bc None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:29.574336 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:29.581931 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:29.589055 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded1658-e9a9-436f-b2a5-c8cbf1bdaa63 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:29.594284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e32b1-7fbe-4d1b-8dca-46b1effbe130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:29.594955 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e32b1-7fbe-4d1b-8dca-46b1effbe130 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:29.595230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e32b1-7fbe-4d1b-8dca-46b1effbe130 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:29.595497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e32b1-7fbe-4d1b-8dca-46b1effbe130 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:29.596679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e32b1-7fbe-4d1b-8dca-46b1effbe130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:29.598167 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e32b1-7fbe-4d1b-8dca-46b1effbe130 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:29.604393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 152/300] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:29.604393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835f0d0-7e9b-4c8d-99cd-3918d9f7f185 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:29.604393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835f0d0-7e9b-4c8d-99cd-3918d9f7f185 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:29.604393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835f0d0-7e9b-4c8d-99cd-3918d9f7f185 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:29.604393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 153/301] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:29.607722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835f0d0-7e9b-4c8d-99cd-3918d9f7f185 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:29.632089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0071e1-20fb-42c0-8a10-7a58c7864a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:29.632715 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0071e1-20fb-42c0-8a10-7a58c7864a6c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:29.633152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0071e1-20fb-42c0-8a10-7a58c7864a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:29.633418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0071e1-20fb-42c0-8a10-7a58c7864a6c None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:29.634097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0071e1-20fb-42c0-8a10-7a58c7864a6c None admin] RBAC: Adding query filter params (name=member) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:29.634401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0071e1-20fb-42c0-8a10-7a58c7864a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:29.635879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0071e1-20fb-42c0-8a10-7a58c7864a6c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:29.650863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 149/302] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:29.650863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de493-db5e-445e-8e42-6dcea6b1af8c None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:29.650863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de493-db5e-445e-8e42-6dcea6b1af8c None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:29.650863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de493-db5e-445e-8e42-6dcea6b1af8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:29.667931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-d15de493-db5e-445e-8e42-6dcea6b1af8c None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:29.669051 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d15de493-db5e-445e-8e42-6dcea6b1af8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:29.724939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835f0d0-7e9b-4c8d-99cd-3918d9f7f185 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:29.742214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 150/303] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:29.743446 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15de493-db5e-445e-8e42-6dcea6b1af8c None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:29.781322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04b6ae-b409-4dba-9859-a3d8f5a09724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:29.783051 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04b6ae-b409-4dba-9859-a3d8f5a09724 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:29.783507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04b6ae-b409-4dba-9859-a3d8f5a09724 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:29.783775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04b6ae-b409-4dba-9859-a3d8f5a09724 None admin] PATH_INFO: `/v3/groups` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:29.784562 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04b6ae-b409-4dba-9859-a3d8f5a09724 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:29.786013 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04b6ae-b409-4dba-9859-a3d8f5a09724 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:29.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 154/304] 10.222.0.59 () {60 vars in 1134 bytes} [Tue Aug 9 11:12:29 2022] POST /identity/v3/groups => generated 229 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:12:29.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04b6ae-b409-4dba-9859-a3d8f5a09724 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:29.850827 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:29.879169 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15de493-db5e-445e-8e42-6dcea6b1af8c None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:29.911261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:29.924656 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0378c-cd69-4747-a129-35617de277b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:29.925445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0378c-cd69-4747-a129-35617de277b2 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:29.925727 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0378c-cd69-4747-a129-35617de277b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:29.925998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0378c-cd69-4747-a129-35617de277b2 None admin] PATH_INFO: `/v3/users/c313b03cc5e3472d8f8dc5537854539f` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:29.927708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0378c-cd69-4747-a129-35617de277b2 None admin] RBAC: Authorizing `identity:get_user(user_id=c313b03cc5e3472d8f8dc5537854539f)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:29.929676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0378c-cd69-4747-a129-35617de277b2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:29.932616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 151/305] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:29 2022] GET /identity/v3/users/c313b03cc5e3472d8f8dc5537854539f => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:29.938281 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0378c-cd69-4747-a129-35617de277b2 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:29.966075 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04b6ae-b409-4dba-9859-a3d8f5a09724 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:30.014765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890a04c-932b-459e-8ba2-e35ab7276b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:30.015856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890a04c-932b-459e-8ba2-e35ab7276b8b None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:30.016258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890a04c-932b-459e-8ba2-e35ab7276b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:30.016633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890a04c-932b-459e-8ba2-e35ab7276b8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:30.032521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890a04c-932b-459e-8ba2-e35ab7276b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-c890a04c-932b-459e-8ba2-e35ab7276b8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:30.039586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:30.040716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:30.041690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:30.041690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:30.041690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:30.041690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:30.041690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:30.041690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:30.041690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:30.041690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:30.041690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:30.041690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:30.041690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:30.041690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:30.046037 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 155/306] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:30.047908 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890a04c-932b-459e-8ba2-e35ab7276b8b None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:30.072178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0378c-cd69-4747-a129-35617de277b2 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:30.116532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfad5d1-b9be-4e03-a965-b5c94d666beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:30.117750 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad5d1-b9be-4e03-a965-b5c94d666beb None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:30.118223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad5d1-b9be-4e03-a965-b5c94d666beb None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:30.119078 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad5d1-b9be-4e03-a965-b5c94d666beb None admin] PATH_INFO: `/v3/system/users/c313b03cc5e3472d8f8dc5537854539f/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:30.121673 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfad5d1-b9be-4e03-a965-b5c94d666beb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c313b03cc5e3472d8f8dc5537854539f, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:30.124172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfad5d1-b9be-4e03-a965-b5c94d666beb None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:30.139265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 152/307] 10.222.0.59 () {58 vars in 1334 bytes} [Tue Aug 9 11:12:29 2022] PUT /identity/v3/system/users/c313b03cc5e3472d8f8dc5537854539f/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:12:30.183829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890a04c-932b-459e-8ba2-e35ab7276b8b None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:30.200916 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:30.228244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61ef4-5255-4fd8-beb3-7b061ce8c9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:30.229199 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61ef4-5255-4fd8-beb3-7b061ce8c9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:30.229686 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61ef4-5255-4fd8-beb3-7b061ce8c9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:30.230133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61ef4-5255-4fd8-beb3-7b061ce8c9b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:30.231069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab61ef4-5255-4fd8-beb3-7b061ce8c9b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:30.231552 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab61ef4-5255-4fd8-beb3-7b061ce8c9b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:30.233280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab61ef4-5255-4fd8-beb3-7b061ce8c9b9 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:30.243985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 156/308] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:30.256073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfad5d1-b9be-4e03-a965-b5c94d666beb None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:30.274110 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:30.370217 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfad5d1-b9be-4e03-a965-b5c94d666beb None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:30.412637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b4258-e7b1-451e-85e0-e0bbed20424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:30.413653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b4258-e7b1-451e-85e0-e0bbed20424d None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:30.414143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b4258-e7b1-451e-85e0-e0bbed20424d None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:30.414604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b4258-e7b1-451e-85e0-e0bbed20424d None admin] PATH_INFO: `/v3/users/213353bc76a04b4db35a310ce10571d1` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:30.432883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b4258-e7b1-451e-85e0-e0bbed20424d None admin] RBAC: Authorizing `identity:get_user(user_id=213353bc76a04b4db35a310ce10571d1)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:30.435391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b4258-e7b1-451e-85e0-e0bbed20424d None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:30.442436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 153/309] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:30 2022] GET /identity/v3/users/213353bc76a04b4db35a310ce10571d1 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:30.444207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61ef4-5255-4fd8-beb3-7b061ce8c9b9 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:30.553342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d15e01-357f-435b-8e9f-cc494aa48c55 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:30.554000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d15e01-357f-435b-8e9f-cc494aa48c55 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:30.554478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d15e01-357f-435b-8e9f-cc494aa48c55 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:30.556340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 154/310] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:30.565289 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b7e8b-12df-4f48-8b79-2d3ab3765c97 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:30.565620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b7e8b-12df-4f48-8b79-2d3ab3765c97 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:30.565894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b7e8b-12df-4f48-8b79-2d3ab3765c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:30.583295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61ef4-5255-4fd8-beb3-7b061ce8c9b9 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:30.584651 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-9e7b7e8b-12df-4f48-8b79-2d3ab3765c97 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:30.585954 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9e7b7e8b-12df-4f48-8b79-2d3ab3765c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:30.628416 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dbf0b-89c4-4cbd-8766-0097b26aa9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:30.629043 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dbf0b-89c4-4cbd-8766-0097b26aa9cf None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:30.629308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dbf0b-89c4-4cbd-8766-0097b26aa9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:30.629579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dbf0b-89c4-4cbd-8766-0097b26aa9cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:30.630304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5dbf0b-89c4-4cbd-8766-0097b26aa9cf None admin] RBAC: Adding query filter params (role.id=b8a55f2fb9954ee99b8328fec6560de4, user.id=213353bc76a04b4db35a310ce10571d1, scope.system=all) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:30.630617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5dbf0b-89c4-4cbd-8766-0097b26aa9cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:30.632200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5dbf0b-89c4-4cbd-8766-0097b26aa9cf None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:30.642855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 157/311] 10.222.0.59 () {56 vars in 1308 bytes} [Tue Aug 9 11:12:30 2022] GET /identity/v3/role_assignments?user.id=213353bc76a04b4db35a310ce10571d1&scope.system=all&role.id=b8a55f2fb9954ee99b8328fec6560de4 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:30.679495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:30.683159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 155/312] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:30.702241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dbf0b-89c4-4cbd-8766-0097b26aa9cf None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:30.750943 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:30.833763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dbf0b-89c4-4cbd-8766-0097b26aa9cf None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:30.875914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe33fa-8c0c-4062-b2a3-f524b90905bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:30.876566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe33fa-8c0c-4062-b2a3-f524b90905bc None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:30.876837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe33fa-8c0c-4062-b2a3-f524b90905bc None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:30.877167 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe33fa-8c0c-4062-b2a3-f524b90905bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:30.890221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe33fa-8c0c-4062-b2a3-f524b90905bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-20fe33fa-8c0c-4062-b2a3-f524b90905bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:30.895858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:30.896813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:30.898061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:30.898061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:30.898061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:30.898061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:30.898061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:30.898061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:30.898061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:30.898061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:30.898061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:30.898061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:30.898061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:30.898061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:30.898061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 158/313] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:30.903832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b7e8b-12df-4f48-8b79-2d3ab3765c97 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:31.023768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b7e8b-12df-4f48-8b79-2d3ab3765c97 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:31.066507 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bb817-f97a-4be1-bd6b-a01be0d45a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:31.067172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bb817-f97a-4be1-bd6b-a01be0d45a4c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:31.067443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bb817-f97a-4be1-bd6b-a01be0d45a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:31.067710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bb817-f97a-4be1-bd6b-a01be0d45a4c None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:31.068473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bb817-f97a-4be1-bd6b-a01be0d45a4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:31.068839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bb817-f97a-4be1-bd6b-a01be0d45a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:31.070328 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bb817-f97a-4be1-bd6b-a01be0d45a4c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:31.080310 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 156/314] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:31.085772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe33fa-8c0c-4062-b2a3-f524b90905bc None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:31.207093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:31.212804 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe33fa-8c0c-4062-b2a3-f524b90905bc None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:31.251221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6430f0-7926-4983-988d-a34fcb54cbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:31.251868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6430f0-7926-4983-988d-a34fcb54cbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:31.252140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6430f0-7926-4983-988d-a34fcb54cbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:31.252405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6430f0-7926-4983-988d-a34fcb54cbb4 None admin] PATH_INFO: `/v3/users/50fb40ff0acf47169e0a9acb676e23ce` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:31.253642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6430f0-7926-4983-988d-a34fcb54cbb4 None admin] RBAC: Authorizing `identity:get_user(user_id=50fb40ff0acf47169e0a9acb676e23ce)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:31.255154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6430f0-7926-4983-988d-a34fcb54cbb4 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:31.257119 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 159/315] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:31 2022] GET /identity/v3/users/50fb40ff0acf47169e0a9acb676e23ce => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:31.262867 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bb817-f97a-4be1-bd6b-a01be0d45a4c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:31.330736 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:31.375970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bb817-f97a-4be1-bd6b-a01be0d45a4c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:31.411269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775c917-662b-4d70-90bb-ee700ed5d549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:31.411882 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775c917-662b-4d70-90bb-ee700ed5d549 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:31.412150 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775c917-662b-4d70-90bb-ee700ed5d549 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:31.412411 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775c917-662b-4d70-90bb-ee700ed5d549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:31.486561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775c917-662b-4d70-90bb-ee700ed5d549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:31.486561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775c917-662b-4d70-90bb-ee700ed5d549 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:31.547220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:31.586494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 157/316] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:31.592023 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6430f0-7926-4983-988d-a34fcb54cbb4 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:31.696810 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6430f0-7926-4983-988d-a34fcb54cbb4 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:31.732355 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4e03f-bda1-4aea-a16a-8b6e4112439f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:31.732998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e03f-bda1-4aea-a16a-8b6e4112439f None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:31.733270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e03f-bda1-4aea-a16a-8b6e4112439f None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:31.733536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e03f-bda1-4aea-a16a-8b6e4112439f None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:31.734681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4e03f-bda1-4aea-a16a-8b6e4112439f None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:31.736201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4e03f-bda1-4aea-a16a-8b6e4112439f None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:31.738201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 160/317] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:31 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:31.744296 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775c917-662b-4d70-90bb-ee700ed5d549 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:31.854999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775c917-662b-4d70-90bb-ee700ed5d549 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:31.897160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c650354-d467-4bd8-beef-c42fdbcd0f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:31.897774 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650354-d467-4bd8-beef-c42fdbcd0f54 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:31.898049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650354-d467-4bd8-beef-c42fdbcd0f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:31.898315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650354-d467-4bd8-beef-c42fdbcd0f54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:31.899085 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c650354-d467-4bd8-beef-c42fdbcd0f54 None admin] RBAC: Adding query filter params (role.id=b8a55f2fb9954ee99b8328fec6560de4, scope.project.id=b3ad94df1ce64d468d45f26d20103ef1, user.id=50fb40ff0acf47169e0a9acb676e23ce) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:31.899385 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c650354-d467-4bd8-beef-c42fdbcd0f54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:31.900850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c650354-d467-4bd8-beef-c42fdbcd0f54 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:31.907785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 158/318] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:31 2022] GET /identity/v3/role_assignments?user.id=50fb40ff0acf47169e0a9acb676e23ce&scope.project.id=b3ad94df1ce64d468d45f26d20103ef1&role.id=b8a55f2fb9954ee99b8328fec6560de4 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:32.112850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c95a7-7c14-4007-b367-1e9350d17be6 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:32.113192 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c95a7-7c14-4007-b367-1e9350d17be6 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:32.113305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c95a7-7c14-4007-b367-1e9350d17be6 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:32.114875 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 161/319] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:32.120802 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60d48-63d4-43f1-b38b-0525a1e4c974 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:32.121088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60d48-63d4-43f1-b38b-0525a1e4c974 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:32.121363 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60d48-63d4-43f1-b38b-0525a1e4c974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:32.140330 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-a0e60d48-63d4-43f1-b38b-0525a1e4c974 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:32.141865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a0e60d48-63d4-43f1-b38b-0525a1e4c974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:32.166733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:32.226388 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 159/320] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:32.247284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c95a7-7c14-4007-b367-1e9350d17be6 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:32.271766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58420f2b-ca22-4092-a725-b83c00aef469 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:32.272319 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58420f2b-ca22-4092-a725-b83c00aef469 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:32.272319 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58420f2b-ca22-4092-a725-b83c00aef469 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:32.273940 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 160/321] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:32.279107 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5855e-a01b-4c34-a2ef-d386b3f35705 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:32.279382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5855e-a01b-4c34-a2ef-d386b3f35705 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:32.279649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5855e-a01b-4c34-a2ef-d386b3f35705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:32.289240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:32.298086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-74d5855e-a01b-4c34-a2ef-d386b3f35705 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:32.299293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-74d5855e-a01b-4c34-a2ef-d386b3f35705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:32.362755 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c95a7-7c14-4007-b367-1e9350d17be6 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:32.368342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 161/322] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:32.391496 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5855e-a01b-4c34-a2ef-d386b3f35705 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:32.402216 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae80fd8-2b4c-47cd-bbf2-113bc76b1520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:32.403445 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae80fd8-2b4c-47cd-bbf2-113bc76b1520 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:32.404149 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae80fd8-2b4c-47cd-bbf2-113bc76b1520 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:32.404589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae80fd8-2b4c-47cd-bbf2-113bc76b1520 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:32.406030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae80fd8-2b4c-47cd-bbf2-113bc76b1520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:32.408307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae80fd8-2b4c-47cd-bbf2-113bc76b1520 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:32.410610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 162/323] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:32.416585 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae80fd8-2b4c-47cd-bbf2-113bc76b1520 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:32.488142 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:32.506067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5855e-a01b-4c34-a2ef-d386b3f35705 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:32.538267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae80fd8-2b4c-47cd-bbf2-113bc76b1520 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:32.539778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04704-a377-4f53-af90-601fe9d4fa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:32.540217 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:32.540501 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04704-a377-4f53-af90-601fe9d4fa25 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:32.540773 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04704-a377-4f53-af90-601fe9d4fa25 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:32.541047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04704-a377-4f53-af90-601fe9d4fa25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:32.552201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe04704-a377-4f53-af90-601fe9d4fa25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-cbe04704-a377-4f53-af90-601fe9d4fa25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:32.557069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:32.557981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:32.558927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:32.558927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:32.558927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:32.558927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:32.558927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:32.558927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:32.558927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:32.558927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:32.558927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:32.558927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:32.558927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:32.558927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:32.558927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 162/324] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:32.564029 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04704-a377-4f53-af90-601fe9d4fa25 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:32.585593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0329886-ecbb-458c-babf-224d814feb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:32.586316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0329886-ecbb-458c-babf-224d814feb10 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:32.586804 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0329886-ecbb-458c-babf-224d814feb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:32.586966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0329886-ecbb-458c-babf-224d814feb10 None admin] PATH_INFO: `/v3/groups` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:32.587618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0329886-ecbb-458c-babf-224d814feb10 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:32.589383 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0329886-ecbb-458c-babf-224d814feb10 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:32.607273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 163/325] 10.222.0.59 () {60 vars in 1134 bytes} [Tue Aug 9 11:12:32 2022] POST /identity/v3/groups => generated 226 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:12:32.698589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04704-a377-4f53-af90-601fe9d4fa25 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:32.738172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a87d8-6822-4e4b-85b7-213db18ea6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:32.738798 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a87d8-6822-4e4b-85b7-213db18ea6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:32.739099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a87d8-6822-4e4b-85b7-213db18ea6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:32.739380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a87d8-6822-4e4b-85b7-213db18ea6a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:32.740057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a87d8-6822-4e4b-85b7-213db18ea6a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:32.740355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a87d8-6822-4e4b-85b7-213db18ea6a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:32.741782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a87d8-6822-4e4b-85b7-213db18ea6a8 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:32.752297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 163/326] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:32.758001 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0329886-ecbb-458c-babf-224d814feb10 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:32.812027 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f513-cd3d-45aa-b84e-1b15eef8b70a None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:32.812334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f513-cd3d-45aa-b84e-1b15eef8b70a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:32.813279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f513-cd3d-45aa-b84e-1b15eef8b70a None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:32.814787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 164/327] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:32.821072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90f8ae-0913-4749-bfef-cbb5c6f15351 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:32.823315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90f8ae-0913-4749-bfef-cbb5c6f15351 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:32.823315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90f8ae-0913-4749-bfef-cbb5c6f15351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:32.841074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-7b90f8ae-0913-4749-bfef-cbb5c6f15351 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:32.842319 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7b90f8ae-0913-4749-bfef-cbb5c6f15351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:32.844532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:32.880384 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0329886-ecbb-458c-babf-224d814feb10 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:32.926455 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2253e9-753a-478f-ab23-43ad29c063c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:32.927134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2253e9-753a-478f-ab23-43ad29c063c1 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:32.927404 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2253e9-753a-478f-ab23-43ad29c063c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:32.927671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2253e9-753a-478f-ab23-43ad29c063c1 None admin] PATH_INFO: `/v3/users/c313b03cc5e3472d8f8dc5537854539f` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:32.928817 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2253e9-753a-478f-ab23-43ad29c063c1 None admin] RBAC: Authorizing `identity:get_user(user_id=c313b03cc5e3472d8f8dc5537854539f)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:32.929469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 165/328] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:32.930883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2253e9-753a-478f-ab23-43ad29c063c1 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:32.932302 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 164/329] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:32 2022] GET /identity/v3/users/c313b03cc5e3472d8f8dc5537854539f => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:32.938016 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90f8ae-0913-4749-bfef-cbb5c6f15351 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:32.951070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2253e9-753a-478f-ab23-43ad29c063c1 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:32.989885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:33.057731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90f8ae-0913-4749-bfef-cbb5c6f15351 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:33.083168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2253e9-753a-478f-ab23-43ad29c063c1 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:33.106387 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664734f1-42cb-4b39-81c4-ea91210acf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:33.107047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664734f1-42cb-4b39-81c4-ea91210acf16 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:33.107321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664734f1-42cb-4b39-81c4-ea91210acf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:33.107586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664734f1-42cb-4b39-81c4-ea91210acf16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:33.109067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664734f1-42cb-4b39-81c4-ea91210acf16 None admin] RBAC: Adding query filter params (role.id=04b89a35fc5442af92047f11f75d7b14, user.id=c313b03cc5e3472d8f8dc5537854539f, scope.system=all) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:33.109381 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664734f1-42cb-4b39-81c4-ea91210acf16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:33.111195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664734f1-42cb-4b39-81c4-ea91210acf16 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:33.127225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7928d40-700c-4352-a0fc-2e915b83607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:33.127920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 166/330] 10.222.0.59 () {56 vars in 1308 bytes} [Tue Aug 9 11:12:32 2022] GET /identity/v3/role_assignments?user.id=c313b03cc5e3472d8f8dc5537854539f&scope.system=all&role.id=04b89a35fc5442af92047f11f75d7b14 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:33.128529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7928d40-700c-4352-a0fc-2e915b83607c None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:33.128928 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7928d40-700c-4352-a0fc-2e915b83607c None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:33.129265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7928d40-700c-4352-a0fc-2e915b83607c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:33.131314 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:33.143232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7928d40-700c-4352-a0fc-2e915b83607c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-c7928d40-700c-4352-a0fc-2e915b83607c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:33.149219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:33.150171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:33.151040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:33.151040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:33.151040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:33.151040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:33.151040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:33.151040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:33.151040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:33.151040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:33.151040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:33.151040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:33.151040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:33.151040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:33.153197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 165/331] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:33.159675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664734f1-42cb-4b39-81c4-ea91210acf16 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:33.283624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664734f1-42cb-4b39-81c4-ea91210acf16 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:33.328716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46403354-e3cb-4110-a507-310fea4d46c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:33.329581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46403354-e3cb-4110-a507-310fea4d46c2 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:33.329996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46403354-e3cb-4110-a507-310fea4d46c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:33.330405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46403354-e3cb-4110-a507-310fea4d46c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:33.331442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46403354-e3cb-4110-a507-310fea4d46c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:33.331939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46403354-e3cb-4110-a507-310fea4d46c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:33.333570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46403354-e3cb-4110-a507-310fea4d46c2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:33.345767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 167/332] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:33.352764 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7928d40-700c-4352-a0fc-2e915b83607c None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:33.485360 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:33.497306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7928d40-700c-4352-a0fc-2e915b83607c None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:33.537677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e2d57-04ea-4b6c-9849-c54cd7362686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:33.538252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e2d57-04ea-4b6c-9849-c54cd7362686 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:33.538530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e2d57-04ea-4b6c-9849-c54cd7362686 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:33.538800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e2d57-04ea-4b6c-9849-c54cd7362686 None admin] PATH_INFO: `/v3/users/213353bc76a04b4db35a310ce10571d1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:33.540652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e2d57-04ea-4b6c-9849-c54cd7362686 None admin] RBAC: Authorizing `identity:get_user(user_id=213353bc76a04b4db35a310ce10571d1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:33.542147 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e2d57-04ea-4b6c-9849-c54cd7362686 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:33.543810 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 166/333] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:33 2022] GET /identity/v3/users/213353bc76a04b4db35a310ce10571d1 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:33.549778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46403354-e3cb-4110-a507-310fea4d46c2 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:33.626846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:33.677926 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46403354-e3cb-4110-a507-310fea4d46c2 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:33.720045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f7a04-7976-4c3a-b085-d23ae053f6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:33.721104 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f7a04-7976-4c3a-b085-d23ae053f6fe None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:33.721411 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f7a04-7976-4c3a-b085-d23ae053f6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:33.722418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f7a04-7976-4c3a-b085-d23ae053f6fe None admin] PATH_INFO: `/v3/system/users/213353bc76a04b4db35a310ce10571d1/roles/b8a55f2fb9954ee99b8328fec6560de4` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:33.724398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f7a04-7976-4c3a-b085-d23ae053f6fe None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=213353bc76a04b4db35a310ce10571d1, role_id=b8a55f2fb9954ee99b8328fec6560de4)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:33.726210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f7a04-7976-4c3a-b085-d23ae053f6fe None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:33.739693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 168/334] 10.222.0.59 () {58 vars in 1334 bytes} [Tue Aug 9 11:12:33 2022] PUT /identity/v3/system/users/213353bc76a04b4db35a310ce10571d1/roles/b8a55f2fb9954ee99b8328fec6560de4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:12:35.154407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19997c9d-7d45-4567-89a7-082d747ca146 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:35.155051 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19997c9d-7d45-4567-89a7-082d747ca146 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:35.155051 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19997c9d-7d45-4567-89a7-082d747ca146 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:35.156553 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 167/335] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:35.163475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3c58b-eb32-4e28-954e-d3d443e0a12b None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:35.164502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3c58b-eb32-4e28-954e-d3d443e0a12b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:35.164977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3c58b-eb32-4e28-954e-d3d443e0a12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:35.190796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-14f3c58b-eb32-4e28-954e-d3d443e0a12b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:35.192383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-14f3c58b-eb32-4e28-954e-d3d443e0a12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:35.292993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 169/336] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:35.323330 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19997c9d-7d45-4567-89a7-082d747ca146 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:35.511508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19997c9d-7d45-4567-89a7-082d747ca146 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:35.557180 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b8431-6700-4cea-b1ad-0692367a20be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:35.558204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b8431-6700-4cea-b1ad-0692367a20be None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:35.558686 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b8431-6700-4cea-b1ad-0692367a20be None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:35.559259 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b8431-6700-4cea-b1ad-0692367a20be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:35.573763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b8431-6700-4cea-b1ad-0692367a20be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-264b8431-6700-4cea-b1ad-0692367a20be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:35.579935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:35.581249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:35.582269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:35.582269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:35.582269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:35.582269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:35.582269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:35.582269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:35.582269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:35.582269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:35.582269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:35.582269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:35.582269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:35.582269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:35.587751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 168/337] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:12:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:35.595991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3c58b-eb32-4e28-954e-d3d443e0a12b None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:35.609920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b7367-cc72-4073-bbce-4b5c6f625a85 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:35.610551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b7367-cc72-4073-bbce-4b5c6f625a85 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:35.611044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b7367-cc72-4073-bbce-4b5c6f625a85 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:35.613234 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 169/338] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:35.619915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430d382-76df-4386-99f6-3d1ed9985129 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:35.620862 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430d382-76df-4386-99f6-3d1ed9985129 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:35.621332 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430d382-76df-4386-99f6-3d1ed9985129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:35.646210 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-5430d382-76df-4386-99f6-3d1ed9985129 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:35.647907 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5430d382-76df-4386-99f6-3d1ed9985129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:35.665716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:35.716216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:35.765586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 170/339] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:35.813218 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430d382-76df-4386-99f6-3d1ed9985129 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:35.813729 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3c58b-eb32-4e28-954e-d3d443e0a12b None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:35.887697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c41a4-89f9-4beb-ab04-daf6a2bfed32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:35.888328 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c41a4-89f9-4beb-ab04-daf6a2bfed32 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:35.888604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c41a4-89f9-4beb-ab04-daf6a2bfed32 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:35.888869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c41a4-89f9-4beb-ab04-daf6a2bfed32 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:35.889548 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c41a4-89f9-4beb-ab04-daf6a2bfed32 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:35.889848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c41a4-89f9-4beb-ab04-daf6a2bfed32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:35.891290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c41a4-89f9-4beb-ab04-daf6a2bfed32 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:35.910844 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 170/340] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:35.912637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2a256-620b-486a-b94d-2f8c5ac7bdf2 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:35.913120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2a256-620b-486a-b94d-2f8c5ac7bdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:35.913620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2a256-620b-486a-b94d-2f8c5ac7bdf2 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:35.915335 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 171/341] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:35.919529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2a256-620b-486a-b94d-2f8c5ac7bdf2 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:36.028417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430d382-76df-4386-99f6-3d1ed9985129 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:36.096517 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cd436-f22e-4f1f-967f-2ae1357f41a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:36.097024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cd436-f22e-4f1f-967f-2ae1357f41a0 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:36.097206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cd436-f22e-4f1f-967f-2ae1357f41a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:36.097439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cd436-f22e-4f1f-967f-2ae1357f41a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:36.117462 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cd436-f22e-4f1f-967f-2ae1357f41a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-958cd436-f22e-4f1f-967f-2ae1357f41a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:36.123512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:36.124403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:36.125577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:36.125577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:36.125577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:36.125577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:36.125577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:36.125577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:36.125577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:36.125577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:36.125577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:36.125577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:36.125577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:36.125577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:36.126207 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2a256-620b-486a-b94d-2f8c5ac7bdf2 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:36.126286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 171/342] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:36.126286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781090ea-53d7-485e-991e-b2a9fc50f673 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:36.126286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781090ea-53d7-485e-991e-b2a9fc50f673 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:36.126470 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781090ea-53d7-485e-991e-b2a9fc50f673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:36.149303 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-781090ea-53d7-485e-991e-b2a9fc50f673 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:36.150511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-781090ea-53d7-485e-991e-b2a9fc50f673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:36.153065 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:36.155998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:36.183686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9dbb7-7929-4bbe-9394-9af053aae98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:36.184308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9dbb7-7929-4bbe-9394-9af053aae98c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:36.184561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9dbb7-7929-4bbe-9394-9af053aae98c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:36.184818 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9dbb7-7929-4bbe-9394-9af053aae98c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:36.287747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 172/343] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:36.289374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781090ea-53d7-485e-991e-b2a9fc50f673 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:36.323805 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9dbb7-7929-4bbe-9394-9af053aae98c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:36.325284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9dbb7-7929-4bbe-9394-9af053aae98c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:36.445359 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781090ea-53d7-485e-991e-b2a9fc50f673 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:36.491772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa403b7-6223-4760-bd6b-25b54dbcaddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:36.492651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa403b7-6223-4760-bd6b-25b54dbcaddc None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:36.494111 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa403b7-6223-4760-bd6b-25b54dbcaddc None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:36.494561 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa403b7-6223-4760-bd6b-25b54dbcaddc None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:36.496425 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa403b7-6223-4760-bd6b-25b54dbcaddc None admin] RBAC: Adding query filter params (name=member) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:36.497038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa403b7-6223-4760-bd6b-25b54dbcaddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:36.499706 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 172/344] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:36.500877 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9dbb7-7929-4bbe-9394-9af053aae98c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:36.504482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa403b7-6223-4760-bd6b-25b54dbcaddc None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:36.516967 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:36.519483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:36.524877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 173/345] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:36.525792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa403b7-6223-4760-bd6b-25b54dbcaddc None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:36.625205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9dbb7-7929-4bbe-9394-9af053aae98c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:36.671478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b743d-24cc-4a29-8042-b1dbb5efeedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:36.672550 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b743d-24cc-4a29-8042-b1dbb5efeedf None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:36.673275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b743d-24cc-4a29-8042-b1dbb5efeedf None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:36.673785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b743d-24cc-4a29-8042-b1dbb5efeedf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:36.683143 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa403b7-6223-4760-bd6b-25b54dbcaddc None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:36.689125 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b743d-24cc-4a29-8042-b1dbb5efeedf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-5d2b743d-24cc-4a29-8042-b1dbb5efeedf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:36.695353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:36.696592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:36.697722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:36.697722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:36.697722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:36.697722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:36.697722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:36.697722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:36.697722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:36.697722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:36.697722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:36.697722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:36.697722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:36.697722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:36.702875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 173/346] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:36.702875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b743d-24cc-4a29-8042-b1dbb5efeedf None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:36.736341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc1591-59f6-4803-8b2d-43f76ce542cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:36.737097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc1591-59f6-4803-8b2d-43f76ce542cc None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:36.737503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc1591-59f6-4803-8b2d-43f76ce542cc None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:36.737843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc1591-59f6-4803-8b2d-43f76ce542cc None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:36.739203 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc1591-59f6-4803-8b2d-43f76ce542cc None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:36.740884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc1591-59f6-4803-8b2d-43f76ce542cc None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:36.742731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 174/347] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:36 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:36.744195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f1cda-2fbc-415c-a7a0-5dc41125f616 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:36.745270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f1cda-2fbc-415c-a7a0-5dc41125f616 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:36.746108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f1cda-2fbc-415c-a7a0-5dc41125f616 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:36.747732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 175/348] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:36.748705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f1cda-2fbc-415c-a7a0-5dc41125f616 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:36.808649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:36.835208 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:36.845625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b743d-24cc-4a29-8042-b1dbb5efeedf None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:36.880515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f1cda-2fbc-415c-a7a0-5dc41125f616 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:36.885562 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a5e7d-e6ae-4ceb-9d5c-286f018c56f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:36.886444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5e7d-e6ae-4ceb-9d5c-286f018c56f5 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:36.886999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5e7d-e6ae-4ceb-9d5c-286f018c56f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:36.887520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5e7d-e6ae-4ceb-9d5c-286f018c56f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:36.922929 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349d2c7-0fc1-4c14-8a43-577287767a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:36.923547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349d2c7-0fc1-4c14-8a43-577287767a3b None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:36.923815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349d2c7-0fc1-4c14-8a43-577287767a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:36.924076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349d2c7-0fc1-4c14-8a43-577287767a3b None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:36.925046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349d2c7-0fc1-4c14-8a43-577287767a3b None admin] RBAC: Adding query filter params (name=member) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:36.925340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349d2c7-0fc1-4c14-8a43-577287767a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:36.927413 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349d2c7-0fc1-4c14-8a43-577287767a3b None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:36.937869 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 176/349] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:36.937869 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349d2c7-0fc1-4c14-8a43-577287767a3b None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:36.981087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a5e7d-e6ae-4ceb-9d5c-286f018c56f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:36.983991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a5e7d-e6ae-4ceb-9d5c-286f018c56f5 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:37.076658 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:37.098218 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349d2c7-0fc1-4c14-8a43-577287767a3b None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:37.111293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 174/350] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:37.113918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7835db-780d-49df-9c64-1b53f513dc6f None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:37.114352 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7835db-780d-49df-9c64-1b53f513dc6f None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:37.114972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7835db-780d-49df-9c64-1b53f513dc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:37.142780 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-4e7835db-780d-49df-9c64-1b53f513dc6f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:37.144539 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4e7835db-780d-49df-9c64-1b53f513dc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:37.145550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:37.157052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef9101-9bc2-4146-b134-25f42e350650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:37.157701 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef9101-9bc2-4146-b134-25f42e350650 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:37.157979 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef9101-9bc2-4146-b134-25f42e350650 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:37.158248 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef9101-9bc2-4146-b134-25f42e350650 None admin] PATH_INFO: `/v3/groups/53a7ec0922784ddebf426723c10a40dd` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:37.166487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef9101-9bc2-4146-b134-25f42e350650 None admin] RBAC: Authorizing `identity:get_group(group_id=53a7ec0922784ddebf426723c10a40dd)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:37.168793 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef9101-9bc2-4146-b134-25f42e350650 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:37.169926 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 177/351] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:36 2022] GET /identity/v3/groups/53a7ec0922784ddebf426723c10a40dd => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:37.172120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef9101-9bc2-4146-b134-25f42e350650 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:37.248775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 175/352] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:37.249468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7835db-780d-49df-9c64-1b53f513dc6f None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:37.321272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef9101-9bc2-4146-b134-25f42e350650 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:37.379968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7835db-780d-49df-9c64-1b53f513dc6f None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:37.380522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c9629-6aba-42d9-a35c-34f497426478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:37.381878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c9629-6aba-42d9-a35c-34f497426478 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:37.382211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c9629-6aba-42d9-a35c-34f497426478 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:37.382516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c9629-6aba-42d9-a35c-34f497426478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:37.384173 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:37.430928 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec7158-0dc3-4c4b-8d5a-183c13989a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:37.431592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec7158-0dc3-4c4b-8d5a-183c13989a11 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:37.431864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec7158-0dc3-4c4b-8d5a-183c13989a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:37.432132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec7158-0dc3-4c4b-8d5a-183c13989a11 None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:37.433289 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec7158-0dc3-4c4b-8d5a-183c13989a11 None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:37.434755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec7158-0dc3-4c4b-8d5a-183c13989a11 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:37.436471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 176/353] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:37 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:37.437628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48205b97-e7db-4f12-94b3-8b655f564f1e None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:37.437903 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48205b97-e7db-4f12-94b3-8b655f564f1e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:37.438173 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48205b97-e7db-4f12-94b3-8b655f564f1e None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:37.441253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 177/354] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:37.441417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48205b97-e7db-4f12-94b3-8b655f564f1e None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:37.477066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:37.490909 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c9629-6aba-42d9-a35c-34f497426478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:37.492625 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c9629-6aba-42d9-a35c-34f497426478 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:37.590033 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48205b97-e7db-4f12-94b3-8b655f564f1e None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:37.624630 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 178/355] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:37.625505 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c9629-6aba-42d9-a35c-34f497426478 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:37.637803 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e680a-5ab4-4603-9f5d-7f23ee7552dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:37.638418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e680a-5ab4-4603-9f5d-7f23ee7552dd None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:37.638693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e680a-5ab4-4603-9f5d-7f23ee7552dd None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:37.638994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e680a-5ab4-4603-9f5d-7f23ee7552dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:37.639736 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e680a-5ab4-4603-9f5d-7f23ee7552dd None admin] RBAC: Adding query filter params (group.id=53a7ec0922784ddebf426723c10a40dd, role.id=6b72aeaf7c3646bdb33b40a371cc4d44, scope.project.id=3afdead5472b467db04217214f5e5d38) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:37.640042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e680a-5ab4-4603-9f5d-7f23ee7552dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:37.641507 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e680a-5ab4-4603-9f5d-7f23ee7552dd None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:37.648468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 178/356] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Aug 9 11:12:37 2022] GET /identity/v3/role_assignments?group.id=53a7ec0922784ddebf426723c10a40dd&scope.project.id=3afdead5472b467db04217214f5e5d38&role.id=6b72aeaf7c3646bdb33b40a371cc4d44 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:37.649481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1299810-a9f5-4420-940f-eabd16d14cf9 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:37.649772 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1299810-a9f5-4420-940f-eabd16d14cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:37.650030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1299810-a9f5-4420-940f-eabd16d14cf9 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:37.655642 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 179/357] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:37.656778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1299810-a9f5-4420-940f-eabd16d14cf9 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:37.718045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:37.772527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:37.780244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c9629-6aba-42d9-a35c-34f497426478 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:37.818218 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1299810-a9f5-4420-940f-eabd16d14cf9 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:37.830116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f95bac-3713-4395-9be6-74e6bcec9c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:37.830926 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95bac-3713-4395-9be6-74e6bcec9c82 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:37.831271 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95bac-3713-4395-9be6-74e6bcec9c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:37.831537 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95bac-3713-4395-9be6-74e6bcec9c82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:37.843125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f95bac-3713-4395-9be6-74e6bcec9c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-71f95bac-3713-4395-9be6-74e6bcec9c82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:37.848765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:37.849704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:37.851100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:37.851100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:37.851100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:37.851100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:37.851100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:37.851100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:37.851100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:37.851100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:37.851100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:37.851100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:37.851100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:37.851100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:37.851100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 179/358] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:12:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:37.851100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426bc0-8538-40a4-af7d-a3b665f4a655 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:37.852096 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426bc0-8538-40a4-af7d-a3b665f4a655 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:37.852364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426bc0-8538-40a4-af7d-a3b665f4a655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:37.867150 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cf92b-0d14-4bd1-8113-6c5e2ac37993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:37.867803 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf92b-0d14-4bd1-8113-6c5e2ac37993 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:37.868129 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf92b-0d14-4bd1-8113-6c5e2ac37993 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:37.868402 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf92b-0d14-4bd1-8113-6c5e2ac37993 None admin] PATH_INFO: `/v3/groups/53a7ec0922784ddebf426723c10a40dd` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:37.869628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cf92b-0d14-4bd1-8113-6c5e2ac37993 None admin] RBAC: Authorizing `identity:get_group(group_id=53a7ec0922784ddebf426723c10a40dd)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:37.871516 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cf92b-0d14-4bd1-8113-6c5e2ac37993 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:37.873237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 180/359] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:37 2022] GET /identity/v3/groups/53a7ec0922784ddebf426723c10a40dd => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:37.874165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cf92b-0d14-4bd1-8113-6c5e2ac37993 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:37.875629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-2f426bc0-8538-40a4-af7d-a3b665f4a655 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:37.876825 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-2f426bc0-8538-40a4-af7d-a3b665f4a655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:37.962290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 180/360] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:37.965315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd880f-327b-424d-af89-03f5a7531fb9 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:37.965596 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd880f-327b-424d-af89-03f5a7531fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:37.965867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd880f-327b-424d-af89-03f5a7531fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:37.985841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-5bdd880f-327b-424d-af89-03f5a7531fb9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:37.986878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5bdd880f-327b-424d-af89-03f5a7531fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:38.002704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cf92b-0d14-4bd1-8113-6c5e2ac37993 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:38.011915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:38.041058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c197d-b3b1-4598-908e-09b97dd3460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:38.042086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c197d-b3b1-4598-908e-09b97dd3460f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:38.042544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c197d-b3b1-4598-908e-09b97dd3460f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:38.043023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c197d-b3b1-4598-908e-09b97dd3460f None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:38.044703 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c197d-b3b1-4598-908e-09b97dd3460f None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:38.046965 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c197d-b3b1-4598-908e-09b97dd3460f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:38.050029 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 181/361] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:37 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:38.052400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c197d-b3b1-4598-908e-09b97dd3460f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:38.075947 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 181/362] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:38.077236 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd880f-327b-424d-af89-03f5a7531fb9 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:38.094720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:38.183954 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c197d-b3b1-4598-908e-09b97dd3460f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:38.209776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd880f-327b-424d-af89-03f5a7531fb9 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:38.230470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cddf3-bef4-464d-bf5a-521118b403bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:38.231408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cddf3-bef4-464d-bf5a-521118b403bd None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:38.231689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cddf3-bef4-464d-bf5a-521118b403bd None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:38.231947 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cddf3-bef4-464d-bf5a-521118b403bd None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:38.232800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cddf3-bef4-464d-bf5a-521118b403bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:38.233416 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cddf3-bef4-464d-bf5a-521118b403bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:38.234843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cddf3-bef4-464d-bf5a-521118b403bd None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:38.246646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 182/363] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:38.247551 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cddf3-bef4-464d-bf5a-521118b403bd None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:38.259756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6362b-daa6-47f7-a1bc-7ef0547293f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:38.260533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6362b-daa6-47f7-a1bc-7ef0547293f2 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:38.260902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6362b-daa6-47f7-a1bc-7ef0547293f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:38.261262 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6362b-daa6-47f7-a1bc-7ef0547293f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:38.262155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6362b-daa6-47f7-a1bc-7ef0547293f2 None admin] RBAC: Adding query filter params (group.id=53a7ec0922784ddebf426723c10a40dd, role.id=04b89a35fc5442af92047f11f75d7b14, scope.project.id=3afdead5472b467db04217214f5e5d38) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:38.262521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6362b-daa6-47f7-a1bc-7ef0547293f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:38.264042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6362b-daa6-47f7-a1bc-7ef0547293f2 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:38.270963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 182/364] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Aug 9 11:12:38 2022] GET /identity/v3/role_assignments?group.id=53a7ec0922784ddebf426723c10a40dd&scope.project.id=3afdead5472b467db04217214f5e5d38&role.id=04b89a35fc5442af92047f11f75d7b14 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:38.272091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6362b-daa6-47f7-a1bc-7ef0547293f2 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:38.308980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:38.394475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:38.422635 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cddf3-bef4-464d-bf5a-521118b403bd None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:38.429281 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6362b-daa6-47f7-a1bc-7ef0547293f2 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:38.464459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e66a1-e02e-4f2c-a2c8-989812f49e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:38.465226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e66a1-e02e-4f2c-a2c8-989812f49e30 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:38.465592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e66a1-e02e-4f2c-a2c8-989812f49e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:38.465872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e66a1-e02e-4f2c-a2c8-989812f49e30 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:38.469898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82ce71-9b0b-4f4e-b565-cd472aeebfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:38.470574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82ce71-9b0b-4f4e-b565-cd472aeebfba None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:38.470875 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82ce71-9b0b-4f4e-b565-cd472aeebfba None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:38.471151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82ce71-9b0b-4f4e-b565-cd472aeebfba None admin] PATH_INFO: `/v3/groups/53a7ec0922784ddebf426723c10a40dd` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:38.472394 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82ce71-9b0b-4f4e-b565-cd472aeebfba None admin] RBAC: Authorizing `identity:get_group(group_id=53a7ec0922784ddebf426723c10a40dd)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:38.474035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82ce71-9b0b-4f4e-b565-cd472aeebfba None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:38.475827 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 183/365] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:38 2022] GET /identity/v3/groups/53a7ec0922784ddebf426723c10a40dd => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:38.476638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82ce71-9b0b-4f4e-b565-cd472aeebfba None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:38.483332 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e66a1-e02e-4f2c-a2c8-989812f49e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-be0e66a1-e02e-4f2c-a2c8-989812f49e30 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:38.489000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:38.489941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:38.491009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:38.491009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:38.491009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:38.491009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:38.491009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:38.491009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:38.491009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:38.491009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:38.491009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:38.491009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:38.491009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:12:38.491009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:38.491009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 183/366] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:38.492559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e66a1-e02e-4f2c-a2c8-989812f49e30 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:38.617910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:38.625135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82ce71-9b0b-4f4e-b565-cd472aeebfba None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:38.628461 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e66a1-e02e-4f2c-a2c8-989812f49e30 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:38.666446 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd487ba2-77d2-4b26-ace4-147f2327171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:38.668434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487ba2-77d2-4b26-ace4-147f2327171c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:38.668434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487ba2-77d2-4b26-ace4-147f2327171c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:38.668434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487ba2-77d2-4b26-ace4-147f2327171c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:38.670334 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29052b-86ba-4470-9337-49fc13c43143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:38.671169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29052b-86ba-4470-9337-49fc13c43143 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:38.671769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29052b-86ba-4470-9337-49fc13c43143 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:38.672191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29052b-86ba-4470-9337-49fc13c43143 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:38.688801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29052b-86ba-4470-9337-49fc13c43143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-cd29052b-86ba-4470-9337-49fc13c43143 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:38.696617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:38.697733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:38.698744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:38.698744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:38.698744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:38.698744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:38.698744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:38.698744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:38.698744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:38.698744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:38.698744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:38.698744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:38.698744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:38.698744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:38.702230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 184/367] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:12:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:38.702230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29052b-86ba-4470-9337-49fc13c43143 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:38.713581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:38.770069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd487ba2-77d2-4b26-ace4-147f2327171c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:38.772514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd487ba2-77d2-4b26-ace4-147f2327171c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:38.862681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29052b-86ba-4470-9337-49fc13c43143 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:38.906698 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c916d0-029e-44a3-8372-29148bb7208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:38.907417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c916d0-029e-44a3-8372-29148bb7208e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:38.907714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c916d0-029e-44a3-8372-29148bb7208e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:38.907985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c916d0-029e-44a3-8372-29148bb7208e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:38.908736 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c916d0-029e-44a3-8372-29148bb7208e None admin] RBAC: Adding query filter params (group.id=53a7ec0922784ddebf426723c10a40dd, role.id=04b89a35fc5442af92047f11f75d7b14, scope.project.id=b3ad94df1ce64d468d45f26d20103ef1) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:38.909046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c916d0-029e-44a3-8372-29148bb7208e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:38.910685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c916d0-029e-44a3-8372-29148bb7208e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:38.914676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:38.919087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 185/368] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Aug 9 11:12:38 2022] GET /identity/v3/role_assignments?group.id=53a7ec0922784ddebf426723c10a40dd&scope.project.id=b3ad94df1ce64d468d45f26d20103ef1&role.id=04b89a35fc5442af92047f11f75d7b14 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:38.920362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c916d0-029e-44a3-8372-29148bb7208e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:38.925806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 184/369] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:38.927043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd487ba2-77d2-4b26-ace4-147f2327171c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:39.017271 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:39.073070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c916d0-029e-44a3-8372-29148bb7208e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:39.141964 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd487ba2-77d2-4b26-ace4-147f2327171c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:39.161275 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2841f6-076a-4c44-b5ef-b1d3dce6942f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:39.161929 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2841f6-076a-4c44-b5ef-b1d3dce6942f None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:39.162207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2841f6-076a-4c44-b5ef-b1d3dce6942f None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:39.162480 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2841f6-076a-4c44-b5ef-b1d3dce6942f None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:39.163229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2841f6-076a-4c44-b5ef-b1d3dce6942f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:39.163551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2841f6-076a-4c44-b5ef-b1d3dce6942f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:39.165093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2841f6-076a-4c44-b5ef-b1d3dce6942f None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:39.194636 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 186/370] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:39.196239 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2841f6-076a-4c44-b5ef-b1d3dce6942f None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:39.223596 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb5e5f-6716-47a8-8b48-6af5d3e0f430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:39.224646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb5e5f-6716-47a8-8b48-6af5d3e0f430 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:39.225266 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb5e5f-6716-47a8-8b48-6af5d3e0f430 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:39.225817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb5e5f-6716-47a8-8b48-6af5d3e0f430 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:39.226668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb5e5f-6716-47a8-8b48-6af5d3e0f430 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:39.227336 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb5e5f-6716-47a8-8b48-6af5d3e0f430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:39.229337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb5e5f-6716-47a8-8b48-6af5d3e0f430 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:39.240173 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 185/371] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:39.241454 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb5e5f-6716-47a8-8b48-6af5d3e0f430 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:39.347430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:39.371848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2841f6-076a-4c44-b5ef-b1d3dce6942f None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:39.419199 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:39.421182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb5e5f-6716-47a8-8b48-6af5d3e0f430 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:39.431609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd095f7-6635-401e-821a-a3efc6b2c81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:39.432275 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd095f7-6635-401e-821a-a3efc6b2c81f None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:39.432549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd095f7-6635-401e-821a-a3efc6b2c81f None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:39.432818 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd095f7-6635-401e-821a-a3efc6b2c81f None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:39.434081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd095f7-6635-401e-821a-a3efc6b2c81f None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:39.435697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd095f7-6635-401e-821a-a3efc6b2c81f None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:39.437376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 187/372] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:39 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:39.448109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd095f7-6635-401e-821a-a3efc6b2c81f None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:39.486522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5609b3-6d81-44ec-9dac-294f87bc1ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:39.487201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5609b3-6d81-44ec-9dac-294f87bc1ebf None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:39.487552 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5609b3-6d81-44ec-9dac-294f87bc1ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:39.487797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5609b3-6d81-44ec-9dac-294f87bc1ebf None admin] PATH_INFO: `/v3/users/213353bc76a04b4db35a310ce10571d1` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:39.489815 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5609b3-6d81-44ec-9dac-294f87bc1ebf None admin] RBAC: Authorizing `identity:get_user(user_id=213353bc76a04b4db35a310ce10571d1)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:39.491321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5609b3-6d81-44ec-9dac-294f87bc1ebf None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:39.493219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 186/373] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:12:39 2022] GET /identity/v3/users/213353bc76a04b4db35a310ce10571d1 => generated 293 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:39.493713 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5609b3-6d81-44ec-9dac-294f87bc1ebf None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:39.612438 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd095f7-6635-401e-821a-a3efc6b2c81f None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:39.653474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b3d52-b6ed-4baa-9303-f03f68d65bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:39.654146 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b3d52-b6ed-4baa-9303-f03f68d65bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:39.654426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b3d52-b6ed-4baa-9303-f03f68d65bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:39.654799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b3d52-b6ed-4baa-9303-f03f68d65bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:39.665741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5609b3-6d81-44ec-9dac-294f87bc1ebf None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:39.703064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:39.728210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283d01d-198e-4198-b6e8-90ef257a4247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:39.728867 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283d01d-198e-4198-b6e8-90ef257a4247 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:39.729168 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283d01d-198e-4198-b6e8-90ef257a4247 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:39.729395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283d01d-198e-4198-b6e8-90ef257a4247 None admin] PATH_INFO: `/v3/groups/53a7ec0922784ddebf426723c10a40dd` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:39.735119 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b3d52-b6ed-4baa-9303-f03f68d65bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:39.735707 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283d01d-198e-4198-b6e8-90ef257a4247 None admin] RBAC: Authorizing `identity:get_group(group_id=53a7ec0922784ddebf426723c10a40dd)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:39.736728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b3d52-b6ed-4baa-9303-f03f68d65bd3 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:39.737221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283d01d-198e-4198-b6e8-90ef257a4247 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:39.739295 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 187/374] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:39 2022] GET /identity/v3/groups/53a7ec0922784ddebf426723c10a40dd => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:39.739899 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283d01d-198e-4198-b6e8-90ef257a4247 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:39.740442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:39.862299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283d01d-198e-4198-b6e8-90ef257a4247 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:39.886664 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 188/375] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:39.887662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b3d52-b6ed-4baa-9303-f03f68d65bd3 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:39.907700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf247e0-6995-422e-bdd2-410e689073eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:39.908694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf247e0-6995-422e-bdd2-410e689073eb None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:39.909201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf247e0-6995-422e-bdd2-410e689073eb None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:39.909764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf247e0-6995-422e-bdd2-410e689073eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:39.910852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf247e0-6995-422e-bdd2-410e689073eb None admin] RBAC: Adding query filter params (role.id=b8a55f2fb9954ee99b8328fec6560de4, user.id=213353bc76a04b4db35a310ce10571d1, scope.system=all) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:39.911356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf247e0-6995-422e-bdd2-410e689073eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:39.913106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf247e0-6995-422e-bdd2-410e689073eb None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:39.928293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 188/376] 10.222.0.59 () {56 vars in 1308 bytes} [Tue Aug 9 11:12:39 2022] GET /identity/v3/role_assignments?user.id=213353bc76a04b4db35a310ce10571d1&scope.system=all&role.id=b8a55f2fb9954ee99b8328fec6560de4 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:39.929534 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf247e0-6995-422e-bdd2-410e689073eb None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:39.995235 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:40.020635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:40.024783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b3d52-b6ed-4baa-9303-f03f68d65bd3 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:40.067742 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae25d1e-4498-42f6-b80a-4b1c445a027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:40.068369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae25d1e-4498-42f6-b80a-4b1c445a027f None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:40.068643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae25d1e-4498-42f6-b80a-4b1c445a027f None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:40.068912 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae25d1e-4498-42f6-b80a-4b1c445a027f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:40.069649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae25d1e-4498-42f6-b80a-4b1c445a027f None admin] RBAC: Adding query filter params (group.id=53a7ec0922784ddebf426723c10a40dd, role.id=6b72aeaf7c3646bdb33b40a371cc4d44, scope.project.id=b3ad94df1ce64d468d45f26d20103ef1) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:40.069966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae25d1e-4498-42f6-b80a-4b1c445a027f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:40.071671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae25d1e-4498-42f6-b80a-4b1c445a027f None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:40.081761 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 189/377] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Aug 9 11:12:39 2022] GET /identity/v3/role_assignments?group.id=53a7ec0922784ddebf426723c10a40dd&scope.project.id=b3ad94df1ce64d468d45f26d20103ef1&role.id=6b72aeaf7c3646bdb33b40a371cc4d44 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:40.081761 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3db853-5b1d-431a-bb37-387ff289f475 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:40.081761 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3db853-5b1d-431a-bb37-387ff289f475 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:40.081761 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3db853-5b1d-431a-bb37-387ff289f475 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:40.081761 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 190/378] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:40.086769 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf247e0-6995-422e-bdd2-410e689073eb None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:40.087544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605ba8d-2015-4241-a862-bbe182a1be5b None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:40.087830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605ba8d-2015-4241-a862-bbe182a1be5b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:40.090980 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605ba8d-2015-4241-a862-bbe182a1be5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:40.110888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a605ba8d-2015-4241-a862-bbe182a1be5b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:40.110888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a605ba8d-2015-4241-a862-bbe182a1be5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:40.148154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9c1f4-bca9-449f-9f94-8ed7e34380fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:40.149594 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9c1f4-bca9-449f-9f94-8ed7e34380fd None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:40.150115 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9c1f4-bca9-449f-9f94-8ed7e34380fd None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:40.150675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9c1f4-bca9-449f-9f94-8ed7e34380fd None admin] PATH_INFO: `/v3/projects/3f8f671817444c358cd7614c06a172b5` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:40.152337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9c1f4-bca9-449f-9f94-8ed7e34380fd None admin] RBAC: Authorizing `identity:get_project(project_id=3f8f671817444c358cd7614c06a172b5)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:40.154272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9c1f4-bca9-449f-9f94-8ed7e34380fd None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:40.159635 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 189/379] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:39 2022] GET /identity/v3/projects/3f8f671817444c358cd7614c06a172b5 => generated 344 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:40.164269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9c1f4-bca9-449f-9f94-8ed7e34380fd None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:40.197580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 191/380] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:40.222765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605ba8d-2015-4241-a862-bbe182a1be5b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:40.320075 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9c1f4-bca9-449f-9f94-8ed7e34380fd None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:40.334806 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:40.342395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605ba8d-2015-4241-a862-bbe182a1be5b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:40.349610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:40.380731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f949705-9448-4938-b328-092f63025f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:40.381817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949705-9448-4938-b328-092f63025f6e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:40.382268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949705-9448-4938-b328-092f63025f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:40.382701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949705-9448-4938-b328-092f63025f6e None admin] PATH_INFO: `/v3/groups/5611c5f03a56417a9b00e0d8060746cd` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:40.385059 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dbc0d-b281-476e-89a6-417399283fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:40.385894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dbc0d-b281-476e-89a6-417399283fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:40.386231 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dbc0d-b281-476e-89a6-417399283fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:40.386589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dbc0d-b281-476e-89a6-417399283fa2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:40.391178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f949705-9448-4938-b328-092f63025f6e None admin] RBAC: Authorizing `identity:get_group(group_id=5611c5f03a56417a9b00e0d8060746cd)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:40.398846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f949705-9448-4938-b328-092f63025f6e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:40.399282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dbc0d-b281-476e-89a6-417399283fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:40.401752 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 190/381] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:40 2022] GET /identity/v3/groups/5611c5f03a56417a9b00e0d8060746cd => generated 229 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-300dbc0d-b281-476e-89a6-417399283fa2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:40.404807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:40.405756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:40.406563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:40.406563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:40.406563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:40.406563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:40.406563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:40.406563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:40.406563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:40.406563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:40.406563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:40.406563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:40.406563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:40.406563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:40.411294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 192/382] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:12:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:40.417297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f949705-9448-4938-b328-092f63025f6e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:40.417462 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dbc0d-b281-476e-89a6-417399283fa2 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:40.529234 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dbc0d-b281-476e-89a6-417399283fa2 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:40.568487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f0d5a-2abe-469a-b99f-4c941dcca75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:40.569111 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f0d5a-2abe-469a-b99f-4c941dcca75d None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:40.569385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f0d5a-2abe-469a-b99f-4c941dcca75d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:40.569652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f0d5a-2abe-469a-b99f-4c941dcca75d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:40.570534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f0d5a-2abe-469a-b99f-4c941dcca75d None admin] RBAC: Adding query filter params (group.id=5611c5f03a56417a9b00e0d8060746cd, role.id=169d11e171d04c87af71475295957618, scope.project.id=3f8f671817444c358cd7614c06a172b5) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:40.570707 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f0d5a-2abe-469a-b99f-4c941dcca75d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:40.572336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f0d5a-2abe-469a-b99f-4c941dcca75d None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:40.583035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 193/383] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Aug 9 11:12:40 2022] GET /identity/v3/role_assignments?group.id=5611c5f03a56417a9b00e0d8060746cd&scope.project.id=3f8f671817444c358cd7614c06a172b5&role.id=169d11e171d04c87af71475295957618 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:40.606618 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f949705-9448-4938-b328-092f63025f6e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:40.662640 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f163d07-e003-4cad-80a4-6550d4838b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:40.663692 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f163d07-e003-4cad-80a4-6550d4838b13 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:40.664172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f163d07-e003-4cad-80a4-6550d4838b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:40.664634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f163d07-e003-4cad-80a4-6550d4838b13 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:40.665556 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f163d07-e003-4cad-80a4-6550d4838b13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:40.666065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f163d07-e003-4cad-80a4-6550d4838b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:40.667787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f163d07-e003-4cad-80a4-6550d4838b13 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:40.678570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 191/384] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:40.684851 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f0d5a-2abe-469a-b99f-4c941dcca75d None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:40.716499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:40.813477 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f0d5a-2abe-469a-b99f-4c941dcca75d None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:40.857812 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5bef2-ac15-4753-be6d-99e5ba2297ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:40.858467 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5bef2-ac15-4753-be6d-99e5ba2297ac None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:40.858782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5bef2-ac15-4753-be6d-99e5ba2297ac None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:40.859084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5bef2-ac15-4753-be6d-99e5ba2297ac None admin] PATH_INFO: `/v3/groups/53a7ec0922784ddebf426723c10a40dd` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:40.860258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5bef2-ac15-4753-be6d-99e5ba2297ac None admin] RBAC: Authorizing `identity:get_group(group_id=53a7ec0922784ddebf426723c10a40dd)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:40.861732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5bef2-ac15-4753-be6d-99e5ba2297ac None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:40.863811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 194/385] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:40 2022] GET /identity/v3/groups/53a7ec0922784ddebf426723c10a40dd => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:40.869622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f163d07-e003-4cad-80a4-6550d4838b13 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:40.928087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:40.998619 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b50a-386d-40c8-9646-47ed84e92671 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:40.999317 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b50a-386d-40c8-9646-47ed84e92671 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:40.999785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b50a-386d-40c8-9646-47ed84e92671 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:41.001665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 195/386] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:41.007586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f163d07-e003-4cad-80a4-6550d4838b13 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:41.008279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc30ee6-66f1-4fc9-9adf-dd38438230c3 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:41.008789 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc30ee6-66f1-4fc9-9adf-dd38438230c3 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:41.009365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc30ee6-66f1-4fc9-9adf-dd38438230c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:41.041570 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-abc30ee6-66f1-4fc9-9adf-dd38438230c3 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:41.046868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-abc30ee6-66f1-4fc9-9adf-dd38438230c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:41.062199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1075350-8af9-4e95-80b9-ae7aec9457ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:41.062882 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1075350-8af9-4e95-80b9-ae7aec9457ed None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:41.063159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1075350-8af9-4e95-80b9-ae7aec9457ed None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:41.063428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1075350-8af9-4e95-80b9-ae7aec9457ed None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:41.064577 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1075350-8af9-4e95-80b9-ae7aec9457ed None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:41.069081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1075350-8af9-4e95-80b9-ae7aec9457ed None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:41.070828 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 192/387] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:40 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:41.077755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1075350-8af9-4e95-80b9-ae7aec9457ed None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:41.174555 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 196/388] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:41.215935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc30ee6-66f1-4fc9-9adf-dd38438230c3 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:41.250641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:41.262485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1075350-8af9-4e95-80b9-ae7aec9457ed None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:41.291443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:41.334608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb1d7a-b653-4347-adfd-9090e481a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:41.335310 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb1d7a-b653-4347-adfd-9090e481a600 None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:41.335587 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb1d7a-b653-4347-adfd-9090e481a600 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:41.335863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb1d7a-b653-4347-adfd-9090e481a600 None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38/groups/53a7ec0922784ddebf426723c10a40dd/roles/6b72aeaf7c3646bdb33b40a371cc4d44` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:41.339950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb1d7a-b653-4347-adfd-9090e481a600 None admin] RBAC: Authorizing `identity:create_grant(project_id=3afdead5472b467db04217214f5e5d38, group_id=53a7ec0922784ddebf426723c10a40dd, role_id=6b72aeaf7c3646bdb33b40a371cc4d44)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:41.342151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb1d7a-b653-4347-adfd-9090e481a600 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:41.367998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 193/389] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Aug 9 11:12:41 2022] PUT /identity/v3/projects/3afdead5472b467db04217214f5e5d38/groups/53a7ec0922784ddebf426723c10a40dd/roles/6b72aeaf7c3646bdb33b40a371cc4d44 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:12:41.420887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc30ee6-66f1-4fc9-9adf-dd38438230c3 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:41.468142 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c67e95-35da-487f-8657-7db7ef8022d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:41.468715 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c67e95-35da-487f-8657-7db7ef8022d2 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:41.468988 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c67e95-35da-487f-8657-7db7ef8022d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:41.469267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c67e95-35da-487f-8657-7db7ef8022d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:41.487204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c67e95-35da-487f-8657-7db7ef8022d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-f1c67e95-35da-487f-8657-7db7ef8022d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:41.492374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:41.493415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:41.494260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:41.494260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:41.494260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:41.494260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:41.494260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:41.494260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:41.494260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:41.494260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:41.494260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:41.494260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:41.494260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:41.494260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:41.494260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 197/390] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:41.502456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb1d7a-b653-4347-adfd-9090e481a600 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:41.655411 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb1d7a-b653-4347-adfd-9090e481a600 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:41.667686 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8b9c7-855a-482c-9c2d-e4bcd231c25c None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:41.668212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8b9c7-855a-482c-9c2d-e4bcd231c25c None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:41.668315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8b9c7-855a-482c-9c2d-e4bcd231c25c None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:41.669911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 198/391] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:41.675851 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f27925-7581-4454-befd-27a9e3ef93cf None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:41.676048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f27925-7581-4454-befd-27a9e3ef93cf None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:41.676249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f27925-7581-4454-befd-27a9e3ef93cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:41.711407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-90f27925-7581-4454-befd-27a9e3ef93cf None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:41.713330 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-90f27925-7581-4454-befd-27a9e3ef93cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:41.717657 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4680a0f-8978-48fa-8c8e-bb15d046aea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:41.718346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4680a0f-8978-48fa-8c8e-bb15d046aea7 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:41.718570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4680a0f-8978-48fa-8c8e-bb15d046aea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:41.718865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4680a0f-8978-48fa-8c8e-bb15d046aea7 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:41.719560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4680a0f-8978-48fa-8c8e-bb15d046aea7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:41.720234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4680a0f-8978-48fa-8c8e-bb15d046aea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:41.721242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4680a0f-8978-48fa-8c8e-bb15d046aea7 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:41.733121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 194/392] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:41.738966 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4680a0f-8978-48fa-8c8e-bb15d046aea7 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:41.798535 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:41.861402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 199/393] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:41.903830 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4680a0f-8978-48fa-8c8e-bb15d046aea7 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:41.907918 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f27925-7581-4454-befd-27a9e3ef93cf None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:41.924586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:41.967503 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd8d38-0280-434a-ab28-6187de6a9922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:41.968437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8d38-0280-434a-ab28-6187de6a9922 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:41.968647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8d38-0280-434a-ab28-6187de6a9922 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:41.968915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8d38-0280-434a-ab28-6187de6a9922 None admin] PATH_INFO: `/v3/groups/53a7ec0922784ddebf426723c10a40dd` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:41.972404 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd8d38-0280-434a-ab28-6187de6a9922 None admin] RBAC: Authorizing `identity:get_group(group_id=53a7ec0922784ddebf426723c10a40dd)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:41.976246 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd8d38-0280-434a-ab28-6187de6a9922 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:41.979232 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 195/394] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:41 2022] GET /identity/v3/groups/53a7ec0922784ddebf426723c10a40dd => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:41.984113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd8d38-0280-434a-ab28-6187de6a9922 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:42.097830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f27925-7581-4454-befd-27a9e3ef93cf None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:42.137840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863109c-34d0-4969-a7f4-df7aa2b6e558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:42.138484 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863109c-34d0-4969-a7f4-df7aa2b6e558 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:42.138758 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863109c-34d0-4969-a7f4-df7aa2b6e558 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:42.139056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863109c-34d0-4969-a7f4-df7aa2b6e558 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:42.165511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863109c-34d0-4969-a7f4-df7aa2b6e558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-b863109c-34d0-4969-a7f4-df7aa2b6e558 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:42.171488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:42.172479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:42.173263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:42.173263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:42.173263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:42.173263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:42.173263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:42.173263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:42.173263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:42.173263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:42.173263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:42.173263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:42.173263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:42.173263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:42.173263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 200/395] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:42.173922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd8d38-0280-434a-ab28-6187de6a9922 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:42.175148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:42.183135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863109c-34d0-4969-a7f4-df7aa2b6e558 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:42.250031 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86faf54-ade0-4b35-ab87-9f9751d3b6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:42.250904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86faf54-ade0-4b35-ab87-9f9751d3b6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:42.251232 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86faf54-ade0-4b35-ab87-9f9751d3b6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:42.251569 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86faf54-ade0-4b35-ab87-9f9751d3b6d2 None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:42.256155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86faf54-ade0-4b35-ab87-9f9751d3b6d2 None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:42.257918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86faf54-ade0-4b35-ab87-9f9751d3b6d2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:42.263335 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 196/396] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:41 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:42.267500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86faf54-ade0-4b35-ab87-9f9751d3b6d2 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:42.303450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:42.346730 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863109c-34d0-4969-a7f4-df7aa2b6e558 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:42.434955 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5f207-c1d0-4966-b799-a8750a561b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:42.435930 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5f207-c1d0-4966-b799-a8750a561b7e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:42.436419 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5f207-c1d0-4966-b799-a8750a561b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:42.436870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5f207-c1d0-4966-b799-a8750a561b7e None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:42.437738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5f207-c1d0-4966-b799-a8750a561b7e None admin] RBAC: Adding query filter params (name=member) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:42.438242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5f207-c1d0-4966-b799-a8750a561b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:42.446839 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5f207-c1d0-4966-b799-a8750a561b7e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:42.447053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86faf54-ade0-4b35-ab87-9f9751d3b6d2 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:42.466138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 201/397] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:42.471846 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5f207-c1d0-4966-b799-a8750a561b7e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:42.482975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa74fd-16b9-44c3-864f-5ba1bce014df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:42.483775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa74fd-16b9-44c3-864f-5ba1bce014df None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:42.484049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa74fd-16b9-44c3-864f-5ba1bce014df None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:42.484317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa74fd-16b9-44c3-864f-5ba1bce014df None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38/groups/53a7ec0922784ddebf426723c10a40dd/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:42.486349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa74fd-16b9-44c3-864f-5ba1bce014df None admin] RBAC: Authorizing `identity:create_grant(project_id=3afdead5472b467db04217214f5e5d38, group_id=53a7ec0922784ddebf426723c10a40dd, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:42.487968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa74fd-16b9-44c3-864f-5ba1bce014df None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:42.508129 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 197/398] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Aug 9 11:12:42 2022] PUT /identity/v3/projects/3afdead5472b467db04217214f5e5d38/groups/53a7ec0922784ddebf426723c10a40dd/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:12:42.647505 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5f207-c1d0-4966-b799-a8750a561b7e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:42.681715 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:42.692492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e29b6a-5302-45a8-bb99-01f5d853f5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:42.693143 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e29b6a-5302-45a8-bb99-01f5d853f5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:42.693415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e29b6a-5302-45a8-bb99-01f5d853f5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:42.693679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e29b6a-5302-45a8-bb99-01f5d853f5f4 None admin] PATH_INFO: `/v3/groups/53a7ec0922784ddebf426723c10a40dd` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:42.694921 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e29b6a-5302-45a8-bb99-01f5d853f5f4 None admin] RBAC: Authorizing `identity:get_group(group_id=53a7ec0922784ddebf426723c10a40dd)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:42.696432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e29b6a-5302-45a8-bb99-01f5d853f5f4 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:42.698414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 202/399] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:42 2022] GET /identity/v3/groups/53a7ec0922784ddebf426723c10a40dd => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:42.704078 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa74fd-16b9-44c3-864f-5ba1bce014df None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:42.743330 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:42.829481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa74fd-16b9-44c3-864f-5ba1bce014df None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:42.868680 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0d443-00ea-46bc-ba1f-85f74324fa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:42.869335 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d443-00ea-46bc-ba1f-85f74324fa59 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:42.869606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d443-00ea-46bc-ba1f-85f74324fa59 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:42.869875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d443-00ea-46bc-ba1f-85f74324fa59 None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:42.871439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0d443-00ea-46bc-ba1f-85f74324fa59 None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:42.872903 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0d443-00ea-46bc-ba1f-85f74324fa59 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:42.874717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 198/400] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:42 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:42.880960 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e29b6a-5302-45a8-bb99-01f5d853f5f4 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:43.000880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e29b6a-5302-45a8-bb99-01f5d853f5f4 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:43.047506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5e47e-335f-4062-8e32-275b902fe0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:43.048236 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5e47e-335f-4062-8e32-275b902fe0c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:43.048508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5e47e-335f-4062-8e32-275b902fe0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:43.048771 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5e47e-335f-4062-8e32-275b902fe0c4 None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1/groups/53a7ec0922784ddebf426723c10a40dd/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:43.050797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5e47e-335f-4062-8e32-275b902fe0c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3ad94df1ce64d468d45f26d20103ef1, group_id=53a7ec0922784ddebf426723c10a40dd, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:43.052319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5e47e-335f-4062-8e32-275b902fe0c4 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:43.075285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 203/401] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Aug 9 11:12:42 2022] PUT /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1/groups/53a7ec0922784ddebf426723c10a40dd/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:12:43.087161 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdb0b7-fb33-4b95-be64-4bd2e60076f7 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:43.087462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdb0b7-fb33-4b95-be64-4bd2e60076f7 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:43.087775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdb0b7-fb33-4b95-be64-4bd2e60076f7 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:43.089725 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 199/402] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:43.095231 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bca809-27bf-47ad-a950-955ef1f7ead4 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:43.095595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bca809-27bf-47ad-a950-955ef1f7ead4 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:43.095937 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bca809-27bf-47ad-a950-955ef1f7ead4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:43.121969 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-76bca809-27bf-47ad-a950-955ef1f7ead4 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:43.123233 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-76bca809-27bf-47ad-a950-955ef1f7ead4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:43.194391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:43.229565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 204/403] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:43.259624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdb0b7-fb33-4b95-be64-4bd2e60076f7 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:43.320818 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b5e00-cf7d-4d52-b520-521cf29fb62e None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:43.321165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b5e00-cf7d-4d52-b520-521cf29fb62e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:43.321359 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b5e00-cf7d-4d52-b520-521cf29fb62e None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:43.322773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 205/404] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:43.328091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826e74b-157c-48a2-beed-10bf511da7e1 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:43.328374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826e74b-157c-48a2-beed-10bf511da7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:43.328651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826e74b-157c-48a2-beed-10bf511da7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:43.350525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b826e74b-157c-48a2-beed-10bf511da7e1 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:43.351783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b826e74b-157c-48a2-beed-10bf511da7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:43.376196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:43.381746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdb0b7-fb33-4b95-be64-4bd2e60076f7 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:43.420616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302380c7-0939-4910-8514-c0c818bf03e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:43.421259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302380c7-0939-4910-8514-c0c818bf03e9 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:43.421527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302380c7-0939-4910-8514-c0c818bf03e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:43.421793 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302380c7-0939-4910-8514-c0c818bf03e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:43.434746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302380c7-0939-4910-8514-c0c818bf03e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-302380c7-0939-4910-8514-c0c818bf03e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:43.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:43.441533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:43.442420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:43.442420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:43.442420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:43.442420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:43.442420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:43.442420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:43.442420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:43.442420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:43.442420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:43.442420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:43.442420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:43.442420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:43.442420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 200/405] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:12:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:43.449991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302380c7-0939-4910-8514-c0c818bf03e9 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:43.500102 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 206/406] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:43.539651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826e74b-157c-48a2-beed-10bf511da7e1 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:43.658880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302380c7-0939-4910-8514-c0c818bf03e9 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:43.696497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826e74b-157c-48a2-beed-10bf511da7e1 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:43.717385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:43.737632 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477314b2-e77a-4f3f-b29c-83cb995645f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:43.738628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477314b2-e77a-4f3f-b29c-83cb995645f4 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:43.739815 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477314b2-e77a-4f3f-b29c-83cb995645f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:43.740354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477314b2-e77a-4f3f-b29c-83cb995645f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:43.741845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477314b2-e77a-4f3f-b29c-83cb995645f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:43.742450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477314b2-e77a-4f3f-b29c-83cb995645f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:43.745134 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477314b2-e77a-4f3f-b29c-83cb995645f4 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:43.757024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 201/407] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:43.757859 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f8bc3-a979-4043-9b64-3655da5dbfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:43.758510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f8bc3-a979-4043-9b64-3655da5dbfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:43.758780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f8bc3-a979-4043-9b64-3655da5dbfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:43.759128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f8bc3-a979-4043-9b64-3655da5dbfe2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:43.765646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477314b2-e77a-4f3f-b29c-83cb995645f4 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:43.788253 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f8bc3-a979-4043-9b64-3655da5dbfe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-9a9f8bc3-a979-4043-9b64-3655da5dbfe2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:43.801311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:43.802293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:43.803135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:43.803135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:43.803135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:43.803135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:43.803135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:43.803135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:43.803135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:43.803135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:43.803135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:43.803135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:43.803135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:43.803135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:43.805956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 207/408] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:12:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:43.814406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:43.815132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f8bc3-a979-4043-9b64-3655da5dbfe2 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:43.939677 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477314b2-e77a-4f3f-b29c-83cb995645f4 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:44.007613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb9bed-3514-46be-b26c-2358fbfdf7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:44.009250 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb9bed-3514-46be-b26c-2358fbfdf7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:44.009884 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb9bed-3514-46be-b26c-2358fbfdf7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:44.011444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb9bed-3514-46be-b26c-2358fbfdf7c6 None admin] PATH_INFO: `/v3/groups/53a7ec0922784ddebf426723c10a40dd` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:44.013523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb9bed-3514-46be-b26c-2358fbfdf7c6 None admin] RBAC: Authorizing `identity:get_group(group_id=53a7ec0922784ddebf426723c10a40dd)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:44.015886 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb9bed-3514-46be-b26c-2358fbfdf7c6 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:44.019103 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 202/409] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:43 2022] GET /identity/v3/groups/53a7ec0922784ddebf426723c10a40dd => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:44.023484 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f8bc3-a979-4043-9b64-3655da5dbfe2 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:44.026954 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb9bed-3514-46be-b26c-2358fbfdf7c6 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:44.072426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec02a1-90b2-460d-a15c-a4e9764e55a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:44.073653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec02a1-90b2-460d-a15c-a4e9764e55a1 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:44.074220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec02a1-90b2-460d-a15c-a4e9764e55a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:44.074495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec02a1-90b2-460d-a15c-a4e9764e55a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:44.075244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec02a1-90b2-460d-a15c-a4e9764e55a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:44.075835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec02a1-90b2-460d-a15c-a4e9764e55a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:44.078256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec02a1-90b2-460d-a15c-a4e9764e55a1 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:44.091702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 208/410] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:44.093986 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77f4a3-fe58-4583-bc48-635bbe01d373 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:44.094272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77f4a3-fe58-4583-bc48-635bbe01d373 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:44.094544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77f4a3-fe58-4583-bc48-635bbe01d373 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:44.096137 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 209/411] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:44.097556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77f4a3-fe58-4583-bc48-635bbe01d373 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:44.151984 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:44.167488 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:44.182797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb9bed-3514-46be-b26c-2358fbfdf7c6 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:44.222689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edc0c3-4a97-4ff3-be04-c43572a51cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:44.223277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edc0c3-4a97-4ff3-be04-c43572a51cbc None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:44.223551 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edc0c3-4a97-4ff3-be04-c43572a51cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:44.223974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edc0c3-4a97-4ff3-be04-c43572a51cbc None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:44.225299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71edc0c3-4a97-4ff3-be04-c43572a51cbc None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:44.227325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71edc0c3-4a97-4ff3-be04-c43572a51cbc None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:44.230969 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 203/412] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:44 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:44.232410 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afdc9b-e578-44a7-a032-873b537647e6 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:44.232881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afdc9b-e578-44a7-a032-873b537647e6 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:44.233331 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afdc9b-e578-44a7-a032-873b537647e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:44.246079 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77f4a3-fe58-4583-bc48-635bbe01d373 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:44.256198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-f6afdc9b-e578-44a7-a032-873b537647e6 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:44.257661 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f6afdc9b-e578-44a7-a032-873b537647e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:44.282478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940d054-cf78-4b80-93eb-4bf94a9220a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:44.283174 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940d054-cf78-4b80-93eb-4bf94a9220a5 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:44.283452 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940d054-cf78-4b80-93eb-4bf94a9220a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:44.283721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940d054-cf78-4b80-93eb-4bf94a9220a5 None admin] PATH_INFO: `/v3/groups/5611c5f03a56417a9b00e0d8060746cd` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:44.284902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940d054-cf78-4b80-93eb-4bf94a9220a5 None admin] RBAC: Authorizing `identity:get_group(group_id=5611c5f03a56417a9b00e0d8060746cd)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:44.286498 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940d054-cf78-4b80-93eb-4bf94a9220a5 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:44.288191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 210/413] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:44 2022] GET /identity/v3/groups/5611c5f03a56417a9b00e0d8060746cd => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:44.293544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940d054-cf78-4b80-93eb-4bf94a9220a5 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:44.332244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 204/414] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:44.333487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afdc9b-e578-44a7-a032-873b537647e6 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:44.426897 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:44.430717 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940d054-cf78-4b80-93eb-4bf94a9220a5 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:44.438741 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:44.445591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afdc9b-e578-44a7-a032-873b537647e6 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:44.470225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f0d96-0a84-4e9a-871a-4e011a39caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:44.470960 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f0d96-0a84-4e9a-871a-4e011a39caa6 None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:44.471244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f0d96-0a84-4e9a-871a-4e011a39caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:44.471521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f0d96-0a84-4e9a-871a-4e011a39caa6 None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1/groups/53a7ec0922784ddebf426723c10a40dd/roles/6b72aeaf7c3646bdb33b40a371cc4d44` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:44.474246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f0d96-0a84-4e9a-871a-4e011a39caa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3ad94df1ce64d468d45f26d20103ef1, group_id=53a7ec0922784ddebf426723c10a40dd, role_id=6b72aeaf7c3646bdb33b40a371cc4d44)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:44.475742 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f0d96-0a84-4e9a-871a-4e011a39caa6 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:44.490409 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284ffac-17d1-43e0-b1de-d0d1498f6570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:44.491964 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284ffac-17d1-43e0-b1de-d0d1498f6570 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:44.492451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284ffac-17d1-43e0-b1de-d0d1498f6570 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:44.492926 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284ffac-17d1-43e0-b1de-d0d1498f6570 None admin] PATH_INFO: `/v3/projects/3f8f671817444c358cd7614c06a172b5` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:44.494610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284ffac-17d1-43e0-b1de-d0d1498f6570 None admin] RBAC: Authorizing `identity:get_project(project_id=3f8f671817444c358cd7614c06a172b5)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:44.497279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284ffac-17d1-43e0-b1de-d0d1498f6570 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:44.504485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 205/416] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:44 2022] GET /identity/v3/projects/3f8f671817444c358cd7614c06a172b5 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:44.505950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284ffac-17d1-43e0-b1de-d0d1498f6570 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:44.506971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 211/416] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Aug 9 11:12:44 2022] PUT /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1/groups/53a7ec0922784ddebf426723c10a40dd/roles/6b72aeaf7c3646bdb33b40a371cc4d44 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:12:44.514008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f0d96-0a84-4e9a-871a-4e011a39caa6 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:44.644201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284ffac-17d1-43e0-b1de-d0d1498f6570 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:44.686253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc660523-601a-4e09-b1a0-d1b272a9b598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:44.686932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc660523-601a-4e09-b1a0-d1b272a9b598 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:44.687211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc660523-601a-4e09-b1a0-d1b272a9b598 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:44.687482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc660523-601a-4e09-b1a0-d1b272a9b598 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:44.701491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc660523-601a-4e09-b1a0-d1b272a9b598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-fc660523-601a-4e09-b1a0-d1b272a9b598 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:44.707767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:44.708749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:44.709990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:44.709990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:44.709990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:44.709990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:44.709990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:44.709990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:44.709990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:44.709990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:44.709990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:44.709990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:44.709990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:44.709990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:44.709990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 206/417] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:12:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:44.716168 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc660523-601a-4e09-b1a0-d1b272a9b598 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:44.749716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:44.773206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f0d96-0a84-4e9a-871a-4e011a39caa6 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:44.812651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71978b7e-99ba-44fd-989c-041c214c76ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:44.813335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71978b7e-99ba-44fd-989c-041c214c76ba None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:44.813620 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71978b7e-99ba-44fd-989c-041c214c76ba None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:44.813925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71978b7e-99ba-44fd-989c-041c214c76ba None admin] PATH_INFO: `/v3/projects/3f8f671817444c358cd7614c06a172b5/groups/5611c5f03a56417a9b00e0d8060746cd/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:44.816802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71978b7e-99ba-44fd-989c-041c214c76ba None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8f671817444c358cd7614c06a172b5, group_id=5611c5f03a56417a9b00e0d8060746cd, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:44.818329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71978b7e-99ba-44fd-989c-041c214c76ba None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:44.843432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 212/418] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Aug 9 11:12:44 2022] PUT /identity/v3/projects/3f8f671817444c358cd7614c06a172b5/groups/5611c5f03a56417a9b00e0d8060746cd/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:12:44.875238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc660523-601a-4e09-b1a0-d1b272a9b598 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:44.915362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f50cce-cd22-4d76-8aad-49f2961b1957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:44.916046 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f50cce-cd22-4d76-8aad-49f2961b1957 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:44.916319 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f50cce-cd22-4d76-8aad-49f2961b1957 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:44.916638 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f50cce-cd22-4d76-8aad-49f2961b1957 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:44.917416 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f50cce-cd22-4d76-8aad-49f2961b1957 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:44.917751 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f50cce-cd22-4d76-8aad-49f2961b1957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:44.919236 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f50cce-cd22-4d76-8aad-49f2961b1957 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:44.929174 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 207/419] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:44.935495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71978b7e-99ba-44fd-989c-041c214c76ba None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:44.991215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:45.002236 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219a44a-6b6e-47e2-a919-8e72071b1285 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:45.002490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219a44a-6b6e-47e2-a919-8e72071b1285 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:45.002741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219a44a-6b6e-47e2-a919-8e72071b1285 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:45.004457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 208/420] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:45.010146 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960715a2-eefe-42e3-8bad-cf558495c58c None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:45.010706 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960715a2-eefe-42e3-8bad-cf558495c58c None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:45.011247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960715a2-eefe-42e3-8bad-cf558495c58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:45.039471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-960715a2-eefe-42e3-8bad-cf558495c58c None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:45.042602 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-960715a2-eefe-42e3-8bad-cf558495c58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:45.134376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71978b7e-99ba-44fd-989c-041c214c76ba None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:45.171050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 209/421] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:45.195974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960715a2-eefe-42e3-8bad-cf558495c58c None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:45.198775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd792f8-7664-452c-9b3b-2667477d3cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:45.199431 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd792f8-7664-452c-9b3b-2667477d3cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:45.199706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd792f8-7664-452c-9b3b-2667477d3cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:45.199973 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd792f8-7664-452c-9b3b-2667477d3cb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:45.205499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:45.316938 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960715a2-eefe-42e3-8bad-cf558495c58c None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:45.336367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd792f8-7664-452c-9b3b-2667477d3cb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:45.337880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd792f8-7664-452c-9b3b-2667477d3cb6 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:45.364365 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631650c-e9dd-4d78-a58f-3358f18fbfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:45.365348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631650c-e9dd-4d78-a58f-3358f18fbfac None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:45.365759 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631650c-e9dd-4d78-a58f-3358f18fbfac None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:45.366162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631650c-e9dd-4d78-a58f-3358f18fbfac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:45.393080 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631650c-e9dd-4d78-a58f-3358f18fbfac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-8631650c-e9dd-4d78-a58f-3358f18fbfac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:45.398307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:45.399460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:45.400457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:45.400457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:45.400457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:45.400457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:45.400457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:45.400457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:45.400457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:45.400457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:45.400457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:45.400457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:45.400457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:45.400457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:45.408774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:45.411880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 210/422] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:45.414369 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631650c-e9dd-4d78-a58f-3358f18fbfac None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:45.541577 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:45.551868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 213/423] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:45.560099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b634e1-6963-4d0d-927a-a9302bb4694b None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:45.561052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b634e1-6963-4d0d-927a-a9302bb4694b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:45.561805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b634e1-6963-4d0d-927a-a9302bb4694b None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:45.565167 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 214/424] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:45.569879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b634e1-6963-4d0d-927a-a9302bb4694b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:45.586306 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631650c-e9dd-4d78-a58f-3358f18fbfac None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:45.632187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008b9c7-8d09-4538-9e72-119d9762d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:45.633052 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b9c7-8d09-4538-9e72-119d9762d3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:45.633456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b9c7-8d09-4538-9e72-119d9762d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:45.633852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b9c7-8d09-4538-9e72-119d9762d3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:45.634837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008b9c7-8d09-4538-9e72-119d9762d3b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:45.635267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008b9c7-8d09-4538-9e72-119d9762d3b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:45.637015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008b9c7-8d09-4538-9e72-119d9762d3b2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:45.647250 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 211/425] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:45.648985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265ace-a4df-478b-8723-8a1635e95575 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:45.649469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265ace-a4df-478b-8723-8a1635e95575 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:45.649941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265ace-a4df-478b-8723-8a1635e95575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:45.673609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-b1265ace-a4df-478b-8723-8a1635e95575 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:45.675695 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b1265ace-a4df-478b-8723-8a1635e95575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:45.707394 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b634e1-6963-4d0d-927a-a9302bb4694b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:45.748088 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:45.759302 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad76b2f-fca6-4229-a366-4b6f4134af0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:45.760343 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad76b2f-fca6-4229-a366-4b6f4134af0d None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:45.760783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad76b2f-fca6-4229-a366-4b6f4134af0d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:45.761209 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad76b2f-fca6-4229-a366-4b6f4134af0d None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:45.762632 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad76b2f-fca6-4229-a366-4b6f4134af0d None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:45.764302 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad76b2f-fca6-4229-a366-4b6f4134af0d None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:45.770985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 215/426] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:45 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:45.772254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad76b2f-fca6-4229-a366-4b6f4134af0d None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:45.775278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 212/427] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:45.777165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1265ace-a4df-478b-8723-8a1635e95575 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:45.882737 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad76b2f-fca6-4229-a366-4b6f4134af0d None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:45.886904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:45.940773 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1265ace-a4df-478b-8723-8a1635e95575 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:45.956393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22625150-5e24-4977-a8a6-64e0630280fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:45.957626 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22625150-5e24-4977-a8a6-64e0630280fa None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:45.958255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22625150-5e24-4977-a8a6-64e0630280fa None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:45.958735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22625150-5e24-4977-a8a6-64e0630280fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:45.992379 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82e1f0-7c07-475d-bd47-17a42aa49366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:45.993029 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e1f0-7c07-475d-bd47-17a42aa49366 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:45.993350 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e1f0-7c07-475d-bd47-17a42aa49366 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:45.993759 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e1f0-7c07-475d-bd47-17a42aa49366 None admin] PATH_INFO: `/v3/groups/53a7ec0922784ddebf426723c10a40dd` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:45.995237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82e1f0-7c07-475d-bd47-17a42aa49366 None admin] RBAC: Authorizing `identity:get_group(group_id=53a7ec0922784ddebf426723c10a40dd)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:45.997230 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82e1f0-7c07-475d-bd47-17a42aa49366 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:46.005278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 213/428] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:45 2022] GET /identity/v3/groups/53a7ec0922784ddebf426723c10a40dd => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:46.005278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82e1f0-7c07-475d-bd47-17a42aa49366 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:46.037973 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:46.047076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22625150-5e24-4977-a8a6-64e0630280fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:46.049191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22625150-5e24-4977-a8a6-64e0630280fa None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:46.111371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82e1f0-7c07-475d-bd47-17a42aa49366 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:46.138745 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:46.150169 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff681a86-feb8-4bb3-87b8-ba6ddf626f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:46.150860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff681a86-feb8-4bb3-87b8-ba6ddf626f63 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:46.151141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff681a86-feb8-4bb3-87b8-ba6ddf626f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:46.151461 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff681a86-feb8-4bb3-87b8-ba6ddf626f63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:46.170574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff681a86-feb8-4bb3-87b8-ba6ddf626f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-ff681a86-feb8-4bb3-87b8-ba6ddf626f63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:46.181613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:46.183113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:46.184630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:46.184630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:46.184630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:46.184630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:46.184630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:46.184630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:46.184630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:46.184630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:46.184630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:46.184630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:46.184630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:12:46.184630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:46.188642 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 214/429] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:46.190525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff681a86-feb8-4bb3-87b8-ba6ddf626f63 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:46.198574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 216/430] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:46.199617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22625150-5e24-4977-a8a6-64e0630280fa None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:46.328743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff681a86-feb8-4bb3-87b8-ba6ddf626f63 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:46.342460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:46.352832 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22625150-5e24-4977-a8a6-64e0630280fa None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:46.367072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29f658-2d83-4198-9f28-be941e435f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:46.367701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29f658-2d83-4198-9f28-be941e435f26 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:46.367977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29f658-2d83-4198-9f28-be941e435f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:46.368247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29f658-2d83-4198-9f28-be941e435f26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:46.369005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29f658-2d83-4198-9f28-be941e435f26 None admin] RBAC: Adding query filter params (group.id=53a7ec0922784ddebf426723c10a40dd, role.id=6b72aeaf7c3646bdb33b40a371cc4d44, scope.project.id=3afdead5472b467db04217214f5e5d38) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:46.369313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29f658-2d83-4198-9f28-be941e435f26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:46.371251 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29f658-2d83-4198-9f28-be941e435f26 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:46.378222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 215/431] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Aug 9 11:12:46 2022] GET /identity/v3/role_assignments?group.id=53a7ec0922784ddebf426723c10a40dd&scope.project.id=3afdead5472b467db04217214f5e5d38&role.id=6b72aeaf7c3646bdb33b40a371cc4d44 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:46.379156 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29f658-2d83-4198-9f28-be941e435f26 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:46.406773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba726d-6085-46c8-a3ee-923ca7679d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:46.406773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba726d-6085-46c8-a3ee-923ca7679d11 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:46.406773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba726d-6085-46c8-a3ee-923ca7679d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:46.406773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba726d-6085-46c8-a3ee-923ca7679d11 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:46.407205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba726d-6085-46c8-a3ee-923ca7679d11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:46.407274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba726d-6085-46c8-a3ee-923ca7679d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:46.408789 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba726d-6085-46c8-a3ee-923ca7679d11 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:46.419843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 217/432] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:12:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:46.432171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba726d-6085-46c8-a3ee-923ca7679d11 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:46.438480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:46.498308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29f658-2d83-4198-9f28-be941e435f26 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:46.537402 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91651a24-0be1-4fcc-bd72-fd1a8bca6ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:46.538058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91651a24-0be1-4fcc-bd72-fd1a8bca6ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:46.538334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91651a24-0be1-4fcc-bd72-fd1a8bca6ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:46.538608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91651a24-0be1-4fcc-bd72-fd1a8bca6ce2 None admin] PATH_INFO: `/v3/projects/3afdead5472b467db04217214f5e5d38` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:46.539910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91651a24-0be1-4fcc-bd72-fd1a8bca6ce2 None admin] RBAC: Authorizing `identity:get_project(project_id=3afdead5472b467db04217214f5e5d38)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:46.541412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91651a24-0be1-4fcc-bd72-fd1a8bca6ce2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:46.543524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 216/433] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:46 2022] GET /identity/v3/projects/3afdead5472b467db04217214f5e5d38 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:46.549427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91651a24-0be1-4fcc-bd72-fd1a8bca6ce2 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:46.618777 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba726d-6085-46c8-a3ee-923ca7679d11 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:46.662109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32a6de-cde5-4874-b63e-46987623ebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:46.662645 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a6de-cde5-4874-b63e-46987623ebaa None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:46.663006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a6de-cde5-4874-b63e-46987623ebaa None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:46.663277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a6de-cde5-4874-b63e-46987623ebaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:46.674096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91651a24-0be1-4fcc-bd72-fd1a8bca6ce2 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:46.702262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:46.704808 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:46.731049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712024bb-19d7-401e-9e6e-90dce3a965da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:46.731983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712024bb-19d7-401e-9e6e-90dce3a965da None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:46.732384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712024bb-19d7-401e-9e6e-90dce3a965da None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:46.732782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712024bb-19d7-401e-9e6e-90dce3a965da None admin] PATH_INFO: `/v3/groups/53a7ec0922784ddebf426723c10a40dd` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:46.734144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712024bb-19d7-401e-9e6e-90dce3a965da None admin] RBAC: Authorizing `identity:get_group(group_id=53a7ec0922784ddebf426723c10a40dd)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:46.736771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712024bb-19d7-401e-9e6e-90dce3a965da None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:46.738710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 217/434] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:46 2022] GET /identity/v3/groups/53a7ec0922784ddebf426723c10a40dd => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:46.746852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712024bb-19d7-401e-9e6e-90dce3a965da None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:46.780564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32a6de-cde5-4874-b63e-46987623ebaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:46.782405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32a6de-cde5-4874-b63e-46987623ebaa None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:46.859524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712024bb-19d7-401e-9e6e-90dce3a965da None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:46.895297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 218/435] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:46.895297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0e74a-44e1-4360-b290-63e83a39b6d9 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:46.895297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0e74a-44e1-4360-b290-63e83a39b6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:46.895297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0e74a-44e1-4360-b290-63e83a39b6d9 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:46.895297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 219/436] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:46.899199 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0e74a-44e1-4360-b290-63e83a39b6d9 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:46.906627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad900a6-1262-452e-8a84-90bfdf81b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:46.907306 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad900a6-1262-452e-8a84-90bfdf81b434 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:46.907580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad900a6-1262-452e-8a84-90bfdf81b434 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:46.907850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad900a6-1262-452e-8a84-90bfdf81b434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:46.908579 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad900a6-1262-452e-8a84-90bfdf81b434 None admin] RBAC: Adding query filter params (group.id=53a7ec0922784ddebf426723c10a40dd, role.id=04b89a35fc5442af92047f11f75d7b14, scope.project.id=3afdead5472b467db04217214f5e5d38) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:46.908883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad900a6-1262-452e-8a84-90bfdf81b434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:46.910348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad900a6-1262-452e-8a84-90bfdf81b434 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:46.916955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 218/437] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Aug 9 11:12:46 2022] GET /identity/v3/role_assignments?group.id=53a7ec0922784ddebf426723c10a40dd&scope.project.id=3afdead5472b467db04217214f5e5d38&role.id=04b89a35fc5442af92047f11f75d7b14 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:46.918200 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f102f-7dcc-4379-979d-43255a675ab9 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:46.918476 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f102f-7dcc-4379-979d-43255a675ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:46.918745 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f102f-7dcc-4379-979d-43255a675ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:46.940095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-054f102f-7dcc-4379-979d-43255a675ab9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:46.942034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-054f102f-7dcc-4379-979d-43255a675ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:46.974272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:47.006384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:47.032232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0e74a-44e1-4360-b290-63e83a39b6d9 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:47.033221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 219/438] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:47.056830 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f102f-7dcc-4379-979d-43255a675ab9 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:47.073567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498a2a4-2c36-45f1-b3ec-491c8b2efe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:47.074679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498a2a4-2c36-45f1-b3ec-491c8b2efe36 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:47.075039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498a2a4-2c36-45f1-b3ec-491c8b2efe36 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:47.075362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498a2a4-2c36-45f1-b3ec-491c8b2efe36 None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:47.076660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498a2a4-2c36-45f1-b3ec-491c8b2efe36 None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:47.078490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498a2a4-2c36-45f1-b3ec-491c8b2efe36 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:47.080800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 220/439] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:46 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:47.087100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498a2a4-2c36-45f1-b3ec-491c8b2efe36 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:47.184297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f102f-7dcc-4379-979d-43255a675ab9 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:47.221616 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498a2a4-2c36-45f1-b3ec-491c8b2efe36 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:47.228588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517eb7d-f312-4f32-85e7-05c0a8b733aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:47.229238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517eb7d-f312-4f32-85e7-05c0a8b733aa None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:47.229618 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517eb7d-f312-4f32-85e7-05c0a8b733aa None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:47.229822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517eb7d-f312-4f32-85e7-05c0a8b733aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:47.243522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517eb7d-f312-4f32-85e7-05c0a8b733aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-d517eb7d-f312-4f32-85e7-05c0a8b733aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:47.249064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:47.249992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:47.250783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:47.250783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:47.250783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:47.250783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:47.250783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:47.250783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:47.250783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:47.250783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:47.250783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:47.250783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:47.250783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:47.250783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:47.251422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:47.251494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 220/440] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:12:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:47.257672 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517eb7d-f312-4f32-85e7-05c0a8b733aa None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:47.267801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c3ffb-2a7f-41cf-b65d-7414618eda73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:47.268459 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c3ffb-2a7f-41cf-b65d-7414618eda73 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:47.268803 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c3ffb-2a7f-41cf-b65d-7414618eda73 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:47.269049 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c3ffb-2a7f-41cf-b65d-7414618eda73 None admin] PATH_INFO: `/v3/groups/53a7ec0922784ddebf426723c10a40dd` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:47.271031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c3ffb-2a7f-41cf-b65d-7414618eda73 None admin] RBAC: Authorizing `identity:get_group(group_id=53a7ec0922784ddebf426723c10a40dd)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:47.272799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c3ffb-2a7f-41cf-b65d-7414618eda73 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:47.275785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 221/441] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:47 2022] GET /identity/v3/groups/53a7ec0922784ddebf426723c10a40dd => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:47.281802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c3ffb-2a7f-41cf-b65d-7414618eda73 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:47.319469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:47.397203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517eb7d-f312-4f32-85e7-05c0a8b733aa None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:47.417896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c3ffb-2a7f-41cf-b65d-7414618eda73 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:47.445320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ff19e-7e3e-4e70-8a95-d9fe337e2eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:47.445956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ff19e-7e3e-4e70-8a95-d9fe337e2eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:47.446221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ff19e-7e3e-4e70-8a95-d9fe337e2eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:47.446482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ff19e-7e3e-4e70-8a95-d9fe337e2eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:47.447183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ff19e-7e3e-4e70-8a95-d9fe337e2eb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:47.447479 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ff19e-7e3e-4e70-8a95-d9fe337e2eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:47.448860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ff19e-7e3e-4e70-8a95-d9fe337e2eb0 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:47.459298 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07272c07-df39-4806-ba06-26e76ae20fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:47.459499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 221/442] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:47.460347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07272c07-df39-4806-ba06-26e76ae20fcc None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:47.460768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421c5d8-c174-4e8e-9fc9-e3cf64766b6e None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:47.460930 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07272c07-df39-4806-ba06-26e76ae20fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:47.461074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421c5d8-c174-4e8e-9fc9-e3cf64766b6e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:47.461307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421c5d8-c174-4e8e-9fc9-e3cf64766b6e None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:47.461397 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07272c07-df39-4806-ba06-26e76ae20fcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:47.462502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 222/443] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:47.467380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421c5d8-c174-4e8e-9fc9-e3cf64766b6e None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:47.468845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07272c07-df39-4806-ba06-26e76ae20fcc None admin] RBAC: Adding query filter params (group.id=53a7ec0922784ddebf426723c10a40dd, role.id=04b89a35fc5442af92047f11f75d7b14, scope.project.id=b3ad94df1ce64d468d45f26d20103ef1) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:47.469335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07272c07-df39-4806-ba06-26e76ae20fcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:47.472698 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07272c07-df39-4806-ba06-26e76ae20fcc None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:47.482992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 222/444] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Aug 9 11:12:47 2022] GET /identity/v3/role_assignments?group.id=53a7ec0922784ddebf426723c10a40dd&scope.project.id=b3ad94df1ce64d468d45f26d20103ef1&role.id=04b89a35fc5442af92047f11f75d7b14 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:47.484595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e05aa-d052-4c79-989f-6a43c6688639 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:47.484880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e05aa-d052-4c79-989f-6a43c6688639 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:47.485643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e05aa-d052-4c79-989f-6a43c6688639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:47.508014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-901e05aa-d052-4c79-989f-6a43c6688639 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:47.509046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-901e05aa-d052-4c79-989f-6a43c6688639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:47.589208 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:47.618544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 223/445] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:47.637034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421c5d8-c174-4e8e-9fc9-e3cf64766b6e None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:47.643234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:47.645702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e05aa-d052-4c79-989f-6a43c6688639 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:47.681024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365207d-0d29-4ba9-b4b0-e91d380b4f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:47.681639 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365207d-0d29-4ba9-b4b0-e91d380b4f62 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:47.681910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365207d-0d29-4ba9-b4b0-e91d380b4f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:47.682178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365207d-0d29-4ba9-b4b0-e91d380b4f62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:47.770263 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365207d-0d29-4ba9-b4b0-e91d380b4f62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:47.771984 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365207d-0d29-4ba9-b4b0-e91d380b4f62 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:47.783037 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e05aa-d052-4c79-989f-6a43c6688639 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:47.834233 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d533f-faca-42e8-b8a7-e56bdc7223ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:47.834948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d533f-faca-42e8-b8a7-e56bdc7223ea None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:47.837900 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d533f-faca-42e8-b8a7-e56bdc7223ea None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:47.837900 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d533f-faca-42e8-b8a7-e56bdc7223ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:47.850779 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d533f-faca-42e8-b8a7-e56bdc7223ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-f49d533f-faca-42e8-b8a7-e56bdc7223ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:47.856241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:47.857228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:47.858028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:47.858028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:47.858028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:47.858028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:47.858028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:47.858028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:47.858028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:47.858028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:47.858028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:47.858028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:47.858028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:12:47.858028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:47.858028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 224/446] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:12:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:47.863570 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d533f-faca-42e8-b8a7-e56bdc7223ea None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:47.902495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 223/447] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:47.908221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365207d-0d29-4ba9-b4b0-e91d380b4f62 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:47.910408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:47.917355 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:47.976971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d533f-faca-42e8-b8a7-e56bdc7223ea None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:48.016811 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365207d-0d29-4ba9-b4b0-e91d380b4f62 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:48.018779 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a654e-5ddb-41e8-abbe-37875751a529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:48.019424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a654e-5ddb-41e8-abbe-37875751a529 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:48.019707 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a654e-5ddb-41e8-abbe-37875751a529 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:48.019963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a654e-5ddb-41e8-abbe-37875751a529 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:48.020737 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a654e-5ddb-41e8-abbe-37875751a529 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:48.020972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a654e-5ddb-41e8-abbe-37875751a529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:48.022410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a654e-5ddb-41e8-abbe-37875751a529 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:48.032888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 225/448] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:48.038559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a654e-5ddb-41e8-abbe-37875751a529 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:48.059512 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504e92e-ab08-429f-a5b0-ce7c1e4bfc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:48.060351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504e92e-ab08-429f-a5b0-ce7c1e4bfc54 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:48.060749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504e92e-ab08-429f-a5b0-ce7c1e4bfc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:48.061141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504e92e-ab08-429f-a5b0-ce7c1e4bfc54 None admin] PATH_INFO: `/v3/projects/b3ad94df1ce64d468d45f26d20103ef1` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:48.062631 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504e92e-ab08-429f-a5b0-ce7c1e4bfc54 None admin] RBAC: Authorizing `identity:get_project(project_id=b3ad94df1ce64d468d45f26d20103ef1)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:48.064302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504e92e-ab08-429f-a5b0-ce7c1e4bfc54 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:48.066071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 224/449] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:47 2022] GET /identity/v3/projects/b3ad94df1ce64d468d45f26d20103ef1 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:48.072204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504e92e-ab08-429f-a5b0-ce7c1e4bfc54 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:48.148522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:48.158258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a654e-5ddb-41e8-abbe-37875751a529 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:48.168121 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:48.180482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504e92e-ab08-429f-a5b0-ce7c1e4bfc54 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:48.194325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400d41a-3ef7-4a2f-a390-5424217f663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:48.195004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400d41a-3ef7-4a2f-a390-5424217f663d None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:48.195240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400d41a-3ef7-4a2f-a390-5424217f663d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:48.195508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400d41a-3ef7-4a2f-a390-5424217f663d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:48.215993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddb687-0fe5-4b8c-a42e-55b663b57f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:48.216626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddb687-0fe5-4b8c-a42e-55b663b57f07 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:48.216897 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddb687-0fe5-4b8c-a42e-55b663b57f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:48.217171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddb687-0fe5-4b8c-a42e-55b663b57f07 None admin] PATH_INFO: `/v3/groups/53a7ec0922784ddebf426723c10a40dd` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:48.218344 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddb687-0fe5-4b8c-a42e-55b663b57f07 None admin] RBAC: Authorizing `identity:get_group(group_id=53a7ec0922784ddebf426723c10a40dd)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:48.219914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddb687-0fe5-4b8c-a42e-55b663b57f07 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:48.221623 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 225/450] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:48 2022] GET /identity/v3/groups/53a7ec0922784ddebf426723c10a40dd => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:48.228117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddb687-0fe5-4b8c-a42e-55b663b57f07 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:48.265091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400d41a-3ef7-4a2f-a390-5424217f663d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:48.266561 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400d41a-3ef7-4a2f-a390-5424217f663d None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:48.337389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddb687-0fe5-4b8c-a42e-55b663b57f07 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:48.367343 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 226/451] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:12:48.372401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e502f3-32ff-4801-9874-9a104068e8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:48.373020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e502f3-32ff-4801-9874-9a104068e8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:48.373144 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400d41a-3ef7-4a2f-a390-5424217f663d None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:48.373250 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e502f3-32ff-4801-9874-9a104068e8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:48.373518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e502f3-32ff-4801-9874-9a104068e8a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:48.374275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e502f3-32ff-4801-9874-9a104068e8a0 None admin] RBAC: Adding query filter params (group.id=53a7ec0922784ddebf426723c10a40dd, role.id=6b72aeaf7c3646bdb33b40a371cc4d44, scope.project.id=b3ad94df1ce64d468d45f26d20103ef1) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:48.374576 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e502f3-32ff-4801-9874-9a104068e8a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:48.376003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e502f3-32ff-4801-9874-9a104068e8a0 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:48.382423 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 226/452] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Aug 9 11:12:48 2022] GET /identity/v3/role_assignments?group.id=53a7ec0922784ddebf426723c10a40dd&scope.project.id=b3ad94df1ce64d468d45f26d20103ef1&role.id=6b72aeaf7c3646bdb33b40a371cc4d44 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:48.382936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:48.502484 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400d41a-3ef7-4a2f-a390-5424217f663d None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:48.543481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213aa876-488b-4046-96a2-f53ce252167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:48.544149 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aa876-488b-4046-96a2-f53ce252167b None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:48.544773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aa876-488b-4046-96a2-f53ce252167b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:48.544773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aa876-488b-4046-96a2-f53ce252167b None admin] PATH_INFO: `/v3/projects/3f8f671817444c358cd7614c06a172b5` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:48.545796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213aa876-488b-4046-96a2-f53ce252167b None admin] RBAC: Authorizing `identity:get_project(project_id=3f8f671817444c358cd7614c06a172b5)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:48.547288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213aa876-488b-4046-96a2-f53ce252167b None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:48.548889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 227/453] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:12:48 2022] GET /identity/v3/projects/3f8f671817444c358cd7614c06a172b5 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:48.554694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e502f3-32ff-4801-9874-9a104068e8a0 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:48.557660 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:48.664921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e502f3-32ff-4801-9874-9a104068e8a0 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:48.700894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f938c-fac9-4de9-aafe-52a948ebac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:48.701518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f938c-fac9-4de9-aafe-52a948ebac13 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:48.701786 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f938c-fac9-4de9-aafe-52a948ebac13 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:48.702048 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f938c-fac9-4de9-aafe-52a948ebac13 None admin] PATH_INFO: `/v3/groups/5611c5f03a56417a9b00e0d8060746cd` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:48.703203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f938c-fac9-4de9-aafe-52a948ebac13 None admin] RBAC: Authorizing `identity:get_group(group_id=5611c5f03a56417a9b00e0d8060746cd)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:48.704651 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f938c-fac9-4de9-aafe-52a948ebac13 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:48.706218 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 227/454] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Aug 9 11:12:48 2022] GET /identity/v3/groups/5611c5f03a56417a9b00e0d8060746cd => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:48.712205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213aa876-488b-4046-96a2-f53ce252167b None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:48.790285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:48.821828 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213aa876-488b-4046-96a2-f53ce252167b None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:48.855573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d6a03-d50e-4b4d-b344-e1ed5debc354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:48.856176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d6a03-d50e-4b4d-b344-e1ed5debc354 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:48.856450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d6a03-d50e-4b4d-b344-e1ed5debc354 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:48.856714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d6a03-d50e-4b4d-b344-e1ed5debc354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:48.857439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d6a03-d50e-4b4d-b344-e1ed5debc354 None admin] RBAC: Adding query filter params (group.id=5611c5f03a56417a9b00e0d8060746cd, role.id=169d11e171d04c87af71475295957618, scope.project.id=3f8f671817444c358cd7614c06a172b5) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:48.857743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d6a03-d50e-4b4d-b344-e1ed5debc354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:48.859217 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d6a03-d50e-4b4d-b344-e1ed5debc354 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:48.865091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 228/455] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Aug 9 11:12:48 2022] GET /identity/v3/role_assignments?group.id=5611c5f03a56417a9b00e0d8060746cd&scope.project.id=3f8f671817444c358cd7614c06a172b5&role.id=169d11e171d04c87af71475295957618 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:51.448145 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ddb3-bdca-407d-a92a-bd48bb2fb8d5 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:51.448705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ddb3-bdca-407d-a92a-bd48bb2fb8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:51.448705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ddb3-bdca-407d-a92a-bd48bb2fb8d5 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:51.450204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 228/456] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:51.455602 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe180a-27fd-4ab6-839c-7f56e5025103 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:51.456003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe180a-27fd-4ab6-839c-7f56e5025103 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:51.456254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe180a-27fd-4ab6-839c-7f56e5025103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:51.486848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-54fe180a-27fd-4ab6-839c-7f56e5025103 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:51.486848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-54fe180a-27fd-4ab6-839c-7f56e5025103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:51.568119 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 229/457] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:51.574690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002abdb-4a1c-4d44-97a2-2c9929bdf1a0 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:51.574690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002abdb-4a1c-4d44-97a2-2c9929bdf1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:51.574690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002abdb-4a1c-4d44-97a2-2c9929bdf1a0 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:51.575289 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 229/458] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:51.580627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1806ee-cc53-4c29-80ff-9c0a0525c218 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:51.581100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1806ee-cc53-4c29-80ff-9c0a0525c218 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:51.581504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1806ee-cc53-4c29-80ff-9c0a0525c218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:51.600793 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-4a1806ee-cc53-4c29-80ff-9c0a0525c218 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:51.602200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-4a1806ee-cc53-4c29-80ff-9c0a0525c218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:51.609674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002abdb-4a1c-4d44-97a2-2c9929bdf1a0 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:51.707011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:51.715025 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 230/459] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:51.716406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db6004-bb6f-4e4c-8c72-2f307d672c6b None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:51.716843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db6004-bb6f-4e4c-8c72-2f307d672c6b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:51.717249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db6004-bb6f-4e4c-8c72-2f307d672c6b None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:51.718997 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 231/460] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:51.728695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f3f4-6e97-4ec7-b572-03a8ddd246fa None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:51.729166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f3f4-6e97-4ec7-b572-03a8ddd246fa None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:51.729602 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f3f4-6e97-4ec7-b572-03a8ddd246fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:51.744470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:51.750689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-ad84f3f4-6e97-4ec7-b572-03a8ddd246fa None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:51.752123 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ad84f3f4-6e97-4ec7-b572-03a8ddd246fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:51.785250 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002abdb-4a1c-4d44-97a2-2c9929bdf1a0 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:51.831082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00781c-8ac9-4fa5-959a-a6aa22836796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:51.832195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00781c-8ac9-4fa5-959a-a6aa22836796 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:51.832724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00781c-8ac9-4fa5-959a-a6aa22836796 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:51.833160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00781c-8ac9-4fa5-959a-a6aa22836796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:51.838836 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 232/461] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:51.838836 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f3f4-6e97-4ec7-b572-03a8ddd246fa None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:51.857918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00781c-8ac9-4fa5-959a-a6aa22836796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:51.859423 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00781c-8ac9-4fa5-959a-a6aa22836796 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-0d00781c-8ac9-4fa5-959a-a6aa22836796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:12:51.878378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:51.879389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:12:51.880756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:12:51.880756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:51.880756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:51.880756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 230/462] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:51.880756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00781c-8ac9-4fa5-959a-a6aa22836796 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:51.965539 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f3f4-6e97-4ec7-b572-03a8ddd246fa None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:51.988236 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00781c-8ac9-4fa5-959a-a6aa22836796 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:52.000216 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:52.008465 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2208886-2dea-4c02-899b-438bb697513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:52.009545 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2208886-2dea-4c02-899b-438bb697513c None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.010044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2208886-2dea-4c02-899b-438bb697513c None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.010506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2208886-2dea-4c02-899b-438bb697513c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:52.012117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:52.024072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e754d-ea89-4126-851a-70bb8acc61bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:52.024787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e754d-ea89-4126-851a-70bb8acc61bd None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.024990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e754d-ea89-4126-851a-70bb8acc61bd None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.025245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e754d-ea89-4126-851a-70bb8acc61bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:52.026309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2208886-2dea-4c02-899b-438bb697513c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:52.028274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2208886-2dea-4c02-899b-438bb697513c None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:52.036320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e754d-ea89-4126-851a-70bb8acc61bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:52.037782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e754d-ea89-4126-851a-70bb8acc61bd None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-b2208886-2dea-4c02-899b-438bb697513c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:12:52.045104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:52.046042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:12:52.047044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:12:52.047044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:52.047044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:52.049210 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 233/463] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:52.050275 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2208886-2dea-4c02-899b-438bb697513c None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-a95e754d-ea89-4126-851a-70bb8acc61bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:12:52.057920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:52.058855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:12:52.059742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:12:52.059742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:52.059742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:52.059742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 231/464] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:52.059968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e754d-ea89-4126-851a-70bb8acc61bd None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:52.165088 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2208886-2dea-4c02-899b-438bb697513c None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:52.165317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e754d-ea89-4126-851a-70bb8acc61bd None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:52.199607 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f836ff3-53c1-4d06-9abe-00b003212803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:52.200216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f836ff3-53c1-4d06-9abe-00b003212803 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.200487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f836ff3-53c1-4d06-9abe-00b003212803 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.200754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f836ff3-53c1-4d06-9abe-00b003212803 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:52.201395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f836ff3-53c1-4d06-9abe-00b003212803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:52.201691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f836ff3-53c1-4d06-9abe-00b003212803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:52.203102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f836ff3-53c1-4d06-9abe-00b003212803 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:52.205215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cd2a1-e994-4a24-b758-45adb36b03ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:52.206192 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cd2a1-e994-4a24-b758-45adb36b03ce None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.206663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cd2a1-e994-4a24-b758-45adb36b03ce None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.207153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cd2a1-e994-4a24-b758-45adb36b03ce None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:52.207993 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cd2a1-e994-4a24-b758-45adb36b03ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:52.208515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cd2a1-e994-4a24-b758-45adb36b03ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:52.210169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cd2a1-e994-4a24-b758-45adb36b03ce None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:52.220760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 232/465] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:52.221484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f836ff3-53c1-4d06-9abe-00b003212803 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:52.224779 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 234/466] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:52.225897 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cd2a1-e994-4a24-b758-45adb36b03ce None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:52.261177 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:52.274009 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:52.328723 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f836ff3-53c1-4d06-9abe-00b003212803 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:52.335271 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cd2a1-e994-4a24-b758-45adb36b03ce None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:52.368288 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1905d9-3d3b-4b44-9b14-b66f6ffda5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:52.368890 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1905d9-3d3b-4b44-9b14-b66f6ffda5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.369162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1905d9-3d3b-4b44-9b14-b66f6ffda5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.369425 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1905d9-3d3b-4b44-9b14-b66f6ffda5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:52.370061 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1905d9-3d3b-4b44-9b14-b66f6ffda5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:52.370356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1905d9-3d3b-4b44-9b14-b66f6ffda5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:52.371300 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4fb91-a96f-46d5-8de6-a1ffb700dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:52.371989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4fb91-a96f-46d5-8de6-a1ffb700dae0 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.372177 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1905d9-3d3b-4b44-9b14-b66f6ffda5b3 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:52.372270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4fb91-a96f-46d5-8de6-a1ffb700dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.372440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4fb91-a96f-46d5-8de6-a1ffb700dae0 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:52.373169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4fb91-a96f-46d5-8de6-a1ffb700dae0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:52.374613 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4fb91-a96f-46d5-8de6-a1ffb700dae0 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:52.389020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 233/467] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:52.389020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1905d9-3d3b-4b44-9b14-b66f6ffda5b3 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:52.404235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 235/468] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:12:52 2022] POST /identity/v3/users => generated 248 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:12:52.404235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eb189-8c78-42ba-9084-1490765b2912 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.404523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eb189-8c78-42ba-9084-1490765b2912 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.404749 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eb189-8c78-42ba-9084-1490765b2912 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:52.405989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 236/469] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:52.410494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725eb189-8c78-42ba-9084-1490765b2912 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:52.519415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:52.528205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1905d9-3d3b-4b44-9b14-b66f6ffda5b3 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:52.529559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:52.535030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725eb189-8c78-42ba-9084-1490765b2912 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:52.573468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfa704-1bd1-451b-bebc-9537494fad8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:52.574548 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48e8dd-63a4-4fb4-a574-0b1865c56678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:52.574670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa704-1bd1-451b-bebc-9537494fad8d None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.575161 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa704-1bd1-451b-bebc-9537494fad8d None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.575261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e8dd-63a4-4fb4-a574-0b1865c56678 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.575458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e8dd-63a4-4fb4-a574-0b1865c56678 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.575728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e8dd-63a4-4fb4-a574-0b1865c56678 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:52.576109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfa704-1bd1-451b-bebc-9537494fad8d None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:52.576452 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48e8dd-63a4-4fb4-a574-0b1865c56678 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:52.577177 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfa704-1bd1-451b-bebc-9537494fad8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:52.577888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48e8dd-63a4-4fb4-a574-0b1865c56678 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:52.578613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfa704-1bd1-451b-bebc-9537494fad8d None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:52.604375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 237/470] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:12:52 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:12:52.604925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 234/471] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:12:52 2022] POST /identity/v3/users => generated 246 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:12:52.605376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8921-02b3-4a77-a07e-7654eaf3c1f4 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.605656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8921-02b3-4a77-a07e-7654eaf3c1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.606031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8921-02b3-4a77-a07e-7654eaf3c1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:52.632494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-d6ab8921-02b3-4a77-a07e-7654eaf3c1f4 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:52.634252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d6ab8921-02b3-4a77-a07e-7654eaf3c1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:52.709964 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f4ba-266b-490f-8e0c-c5fd77fe7013 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.710641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f4ba-266b-490f-8e0c-c5fd77fe7013 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.711189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f4ba-266b-490f-8e0c-c5fd77fe7013 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:52.714182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 235/472] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:52.719095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16abf00-2ce0-4e23-bf64-97ded432debe None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.719393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16abf00-2ce0-4e23-bf64-97ded432debe None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.719647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16abf00-2ce0-4e23-bf64-97ded432debe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:52.729431 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 238/473] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:52.742689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c16abf00-2ce0-4e23-bf64-97ded432debe None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:52.744021 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c16abf00-2ce0-4e23-bf64-97ded432debe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:52.755796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab8921-02b3-4a77-a07e-7654eaf3c1f4 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:52.851498 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 236/474] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:12:52.873502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:52.874949 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16abf00-2ce0-4e23-bf64-97ded432debe None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:52.896466 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab8921-02b3-4a77-a07e-7654eaf3c1f4 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:52.955763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cea96-d4af-4975-ace7-f6284a748f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:52.957923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cea96-d4af-4975-ace7-f6284a748f18 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.958402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cea96-d4af-4975-ace7-f6284a748f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.958932 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cea96-d4af-4975-ace7-f6284a748f18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:52.981708 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cea96-d4af-4975-ace7-f6284a748f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:52.981708 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cea96-d4af-4975-ace7-f6284a748f18 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-1c4cea96-d4af-4975-ace7-f6284a748f18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:12:53.001141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:53.002214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:12:53.003315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:12:53.003315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:53.003315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:53.005751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 239/475] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:53.012152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cea96-d4af-4975-ace7-f6284a748f18 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:53.096582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:53.124704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16abf00-2ce0-4e23-bf64-97ded432debe None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:53.197835 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fd38b-5028-4707-ae6b-2b98ce0b7eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:53.198452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd38b-5028-4707-ae6b-2b98ce0b7eaf None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:53.198722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd38b-5028-4707-ae6b-2b98ce0b7eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:53.199008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd38b-5028-4707-ae6b-2b98ce0b7eaf None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:53.199903 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fd38b-5028-4707-ae6b-2b98ce0b7eaf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:53.206425 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fd38b-5028-4707-ae6b-2b98ce0b7eaf None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:53.222462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.sql.core [None req-123fd38b-5028-4707-ae6b-2b98ce0b7eaf None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 11:12:53.222462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 11:12:53.222462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [parameters: {'id': '75a87bf003e6407ebeb9c81ae1890ce9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 11:12:53.222462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80054) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-123fd38b-5028-4707-ae6b-2b98ce0b7eaf None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application conn.query(q) Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application result.read() Aug 09 11:12:53.244760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return ref.to_dict() Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 11:12:53.246087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application next(self.gen) Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application yield resource Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application next(self.gen) Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise self.value Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application session.commit() Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 11:12:53.247099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.session.flush() Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application compat.raise_( Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 11:12:53.247972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 11:12:53.248842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application conn.query(q) Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application result.read() Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 11:12:53.249662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [parameters: {'id': '75a87bf003e6407ebeb9c81ae1890ce9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:53.250465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 11:12:53.257191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:53.259186 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 237/476] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Aug 9 11:12:52 2022] POST /identity/v3/roles => generated 144 bytes in 373 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:53.263595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fd38b-5028-4707-ae6b-2b98ce0b7eaf None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:53.265749 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cea96-d4af-4975-ace7-f6284a748f18 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:53.346175 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1a800-a19f-43c0-abdd-acfa33c0f0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:53.347320 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1a800-a19f-43c0-abdd-acfa33c0f0fd None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:53.347790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1a800-a19f-43c0-abdd-acfa33c0f0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:53.348791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1a800-a19f-43c0-abdd-acfa33c0f0fd None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:53.349800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1a800-a19f-43c0-abdd-acfa33c0f0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:53.351772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1a800-a19f-43c0-abdd-acfa33c0f0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:53.354054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1a800-a19f-43c0-abdd-acfa33c0f0fd None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:53.365333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:53.397362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 240/477] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:53.406840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1a800-a19f-43c0-abdd-acfa33c0f0fd None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:53.521444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fd38b-5028-4707-ae6b-2b98ce0b7eaf None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:53.607433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d736b-a45a-4c90-9157-282194dc84b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:53.608158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d736b-a45a-4c90-9157-282194dc84b6 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:53.608434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d736b-a45a-4c90-9157-282194dc84b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:53.608701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d736b-a45a-4c90-9157-282194dc84b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:53.622499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d736b-a45a-4c90-9157-282194dc84b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-aa9d736b-a45a-4c90-9157-282194dc84b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:53.627284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:53.628234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:53.629480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:53.629480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:53.629480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:53.629480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:53.629480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:53.629480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:53.629480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:53.629480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:53.629480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:53.629480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:53.629480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:12:53.629480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:53.629480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 238/478] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:12:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:53.634628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d736b-a45a-4c90-9157-282194dc84b6 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:53.639163 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:53.655248 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1a800-a19f-43c0-abdd-acfa33c0f0fd None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:53.740667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d736b-a45a-4c90-9157-282194dc84b6 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:53.776702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82c587-827d-4bd0-bc31-590f68d2630a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:53.777325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c587-827d-4bd0-bc31-590f68d2630a None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:53.777599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c587-827d-4bd0-bc31-590f68d2630a None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:53.778201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c587-827d-4bd0-bc31-590f68d2630a None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:53.779007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82c587-827d-4bd0-bc31-590f68d2630a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:53.779412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82c587-827d-4bd0-bc31-590f68d2630a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:53.780955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82c587-827d-4bd0-bc31-590f68d2630a None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:53.787579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60226f5f-c85d-43e1-a338-745aa301834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:53.788209 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226f5f-c85d-43e1-a338-745aa301834a None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:53.788485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226f5f-c85d-43e1-a338-745aa301834a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:53.788734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226f5f-c85d-43e1-a338-745aa301834a None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:53.789382 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60226f5f-c85d-43e1-a338-745aa301834a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:53.790519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 239/479] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:12:53.791308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60226f5f-c85d-43e1-a338-745aa301834a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:53.836341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 241/480] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:12:53 2022] POST /identity/v3/users => generated 249 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:12:55.090758 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939f3e0-5fa2-48a2-b0d7-ad686ea002e5 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:55.091495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939f3e0-5fa2-48a2-b0d7-ad686ea002e5 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:55.091495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939f3e0-5fa2-48a2-b0d7-ad686ea002e5 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:55.092953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 240/481] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:55.098627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d024-2377-49ff-a4bb-661c099813b2 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:55.099567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d024-2377-49ff-a4bb-661c099813b2 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:55.100028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d024-2377-49ff-a4bb-661c099813b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:55.119080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-1da0d024-2377-49ff-a4bb-661c099813b2 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:55.120966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1da0d024-2377-49ff-a4bb-661c099813b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:55.174362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:55.203281 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 242/482] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:55.235654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939f3e0-5fa2-48a2-b0d7-ad686ea002e5 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:55.339883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:55.392078 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939f3e0-5fa2-48a2-b0d7-ad686ea002e5 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:55.432015 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96369ab6-2206-4bec-a079-2edf5526bac8 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:55.432524 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96369ab6-2206-4bec-a079-2edf5526bac8 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:55.432925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96369ab6-2206-4bec-a079-2edf5526bac8 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:55.434655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 243/483] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:55.441920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fd607-119e-4014-bac8-de49c1a7e965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:55.442572 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fd607-119e-4014-bac8-de49c1a7e965 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:55.442863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fd607-119e-4014-bac8-de49c1a7e965 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:55.443139 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fd607-119e-4014-bac8-de49c1a7e965 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:55.444056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56796019-5242-4ad9-b389-582964dab652 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:55.444501 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56796019-5242-4ad9-b389-582964dab652 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:55.444900 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56796019-5242-4ad9-b389-582964dab652 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:55.446428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 244/484] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:55.452331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a78ec1-22a3-4837-963d-2a71183d9c6b None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:55.452841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a78ec1-22a3-4837-963d-2a71183d9c6b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:55.453275 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a78ec1-22a3-4837-963d-2a71183d9c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:55.457683 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fd607-119e-4014-bac8-de49c1a7e965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-1e5fd607-119e-4014-bac8-de49c1a7e965 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:55.460549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:55.461481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:55.467532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:55.467532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:55.467532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:55.467532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:55.467532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:55.467532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:55.467532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:55.467532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:55.467532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:55.467532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:55.467532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:12:55.467532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:55.467532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 241/485] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:12:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:12:55.467532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae8191-b3f3-4ecb-8f51-f8c4db9b4a17 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:55.468261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae8191-b3f3-4ecb-8f51-f8c4db9b4a17 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:55.468261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae8191-b3f3-4ecb-8f51-f8c4db9b4a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:55.484357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-5fae8191-b3f3-4ecb-8f51-f8c4db9b4a17 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:55.485739 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-5fae8191-b3f3-4ecb-8f51-f8c4db9b4a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:55.486801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-e1a78ec1-22a3-4837-963d-2a71183d9c6b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:55.488273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e1a78ec1-22a3-4837-963d-2a71183d9c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:55.559681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 245/486] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:55.567989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a78ec1-22a3-4837-963d-2a71183d9c6b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:55.576165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 242/487] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:55.594650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae8191-b3f3-4ecb-8f51-f8c4db9b4a17 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:55.687285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:55.698648 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a78ec1-22a3-4837-963d-2a71183d9c6b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:55.713777 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:55.726119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae8191-b3f3-4ecb-8f51-f8c4db9b4a17 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:55.738508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf85d2f-b6d9-408f-9184-94046af54ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:55.739655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85d2f-b6d9-408f-9184-94046af54ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:55.740132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85d2f-b6d9-408f-9184-94046af54ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:55.740582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85d2f-b6d9-408f-9184-94046af54ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:55.741434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf85d2f-b6d9-408f-9184-94046af54ef1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:55.742007 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf85d2f-b6d9-408f-9184-94046af54ef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:55.743729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf85d2f-b6d9-408f-9184-94046af54ef1 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:55.758455 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 246/488] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:12:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:55.759934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf85d2f-b6d9-408f-9184-94046af54ef1 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:55.766423 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df083a4-1875-42ca-9717-c8aaf493f2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:55.767081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df083a4-1875-42ca-9717-c8aaf493f2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:55.767352 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df083a4-1875-42ca-9717-c8aaf493f2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:55.767616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df083a4-1875-42ca-9717-c8aaf493f2e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:55.780920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df083a4-1875-42ca-9717-c8aaf493f2e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-1df083a4-1875-42ca-9717-c8aaf493f2e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:55.787297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:55.788264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:55.789071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:55.789071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:55.789071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:55.789071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:55.789071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:55.789071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:55.789071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:55.789071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:55.789071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:55.789071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:55.789071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:12:55.789071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:55.791900 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 243/489] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:12:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:55.793096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df083a4-1875-42ca-9717-c8aaf493f2e5 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:55.892066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf85d2f-b6d9-408f-9184-94046af54ef1 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:55.910371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df083a4-1875-42ca-9717-c8aaf493f2e5 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:55.933998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:55.937719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a311ae-a809-4e6d-a59e-f2148a5ecccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:55.938685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a311ae-a809-4e6d-a59e-f2148a5ecccf None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:55.939177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a311ae-a809-4e6d-a59e-f2148a5ecccf None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:55.939674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a311ae-a809-4e6d-a59e-f2148a5ecccf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:55.952459 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a311ae-a809-4e6d-a59e-f2148a5ecccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:55.954519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731e93c-8511-40ec-9aa0-51a07346a1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:55.955179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731e93c-8511-40ec-9aa0-51a07346a1be None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:55.955447 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731e93c-8511-40ec-9aa0-51a07346a1be None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:55.955708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731e93c-8511-40ec-9aa0-51a07346a1be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-f4a311ae-a809-4e6d-a59e-f2148a5ecccf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:55.959448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:55.960363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:55.961171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:55.961171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:55.961171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:55.961171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:55.961171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:55.961171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:55.961171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:55.961171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:55.961171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:55.961171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:55.961171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:12:55.961171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:55.963674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 247/490] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:12:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:55.964710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a311ae-a809-4e6d-a59e-f2148a5ecccf None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:55.967538 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731e93c-8511-40ec-9aa0-51a07346a1be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:55.969242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731e93c-8511-40ec-9aa0-51a07346a1be None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-1731e93c-8511-40ec-9aa0-51a07346a1be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:12:55.989482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:55.990469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:12:55.991357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:12:55.991357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:55.991357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:55.993393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 244/491] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:55.998342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731e93c-8511-40ec-9aa0-51a07346a1be None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:56.020228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:56.105795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a311ae-a809-4e6d-a59e-f2148a5ecccf None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:56.129637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731e93c-8511-40ec-9aa0-51a07346a1be None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:56.153455 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc2098-21df-4823-94c4-55033f895a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:56.154085 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc2098-21df-4823-94c4-55033f895a07 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:56.154347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc2098-21df-4823-94c4-55033f895a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:56.154609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc2098-21df-4823-94c4-55033f895a07 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.155291 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc2098-21df-4823-94c4-55033f895a07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:56.155589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc2098-21df-4823-94c4-55033f895a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:56.157777 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc2098-21df-4823-94c4-55033f895a07 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:56.169620 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 248/492] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:12:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:56.171126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc2098-21df-4823-94c4-55033f895a07 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:56.177295 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5a23-a49e-42f8-8eb5-e0cf6a648fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:56.178315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5a23-a49e-42f8-8eb5-e0cf6a648fcf None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:56.178926 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5a23-a49e-42f8-8eb5-e0cf6a648fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:56.179405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5a23-a49e-42f8-8eb5-e0cf6a648fcf None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.180315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee5a23-a49e-42f8-8eb5-e0cf6a648fcf None admin] RBAC: Adding query filter params (name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:56.180805 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee5a23-a49e-42f8-8eb5-e0cf6a648fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:56.182507 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee5a23-a49e-42f8-8eb5-e0cf6a648fcf None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:56.193214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 245/493] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:12:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:56.194514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5a23-a49e-42f8-8eb5-e0cf6a648fcf None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:56.234087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:56.285524 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:56.296006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc2098-21df-4823-94c4-55033f895a07 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:56.316304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5a23-a49e-42f8-8eb5-e0cf6a648fcf None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:56.336078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eefa06-0da7-4036-bf8d-ef18fb94a7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:56.336923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eefa06-0da7-4036-bf8d-ef18fb94a7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:56.337197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eefa06-0da7-4036-bf8d-ef18fb94a7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:56.337463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eefa06-0da7-4036-bf8d-ef18fb94a7a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.338130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eefa06-0da7-4036-bf8d-ef18fb94a7a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:56.338424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eefa06-0da7-4036-bf8d-ef18fb94a7a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:56.339893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eefa06-0da7-4036-bf8d-ef18fb94a7a3 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:56.354921 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 249/494] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:56.356338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eefa06-0da7-4036-bf8d-ef18fb94a7a3 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:56.361395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033946f-5053-463c-aaff-f430d67eb2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:56.362074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033946f-5053-463c-aaff-f430d67eb2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:56.362406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033946f-5053-463c-aaff-f430d67eb2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:56.362679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033946f-5053-463c-aaff-f430d67eb2e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.375212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033946f-5053-463c-aaff-f430d67eb2e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:56.376733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033946f-5053-463c-aaff-f430d67eb2e2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-1033946f-5053-463c-aaff-f430d67eb2e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:12:56.392679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:56.393775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:12:56.394639 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:12:56.394639 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:56.394639 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:56.394639 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 246/495] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:56.395331 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe98a-fa53-4b20-b4a1-11b533db34e1 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:56.395331 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe98a-fa53-4b20-b4a1-11b533db34e1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:56.395579 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe98a-fa53-4b20-b4a1-11b533db34e1 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.396948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 247/496] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:56.397514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfe98a-fa53-4b20-b4a1-11b533db34e1 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:56.469068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eefa06-0da7-4036-bf8d-ef18fb94a7a3 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:56.491121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:56.511988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfe98a-fa53-4b20-b4a1-11b533db34e1 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:56.513041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc8d65-7188-46ad-ad54-3726ca65703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:56.513677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc8d65-7188-46ad-ad54-3726ca65703c None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:56.513944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc8d65-7188-46ad-ad54-3726ca65703c None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:56.514205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc8d65-7188-46ad-ad54-3726ca65703c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.524561 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc8d65-7188-46ad-ad54-3726ca65703c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:56.526046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc8d65-7188-46ad-ad54-3726ca65703c None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-92bc8d65-7188-46ad-ad54-3726ca65703c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:12:56.541242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:56.542311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:12:56.543201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:12:56.543201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:56.543201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:56.543201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 250/497] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:56.543644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5b57e-2778-48e8-8ea0-fa1cb2655afe None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:56.543816 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5b57e-2778-48e8-8ea0-fa1cb2655afe None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:56.544060 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5b57e-2778-48e8-8ea0-fa1cb2655afe None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.549504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 251/498] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:12:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:56.549504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5b57e-2778-48e8-8ea0-fa1cb2655afe None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:56.556132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1f50b-cb5a-4ab6-8a47-7440e81e2702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:56.556802 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1f50b-cb5a-4ab6-8a47-7440e81e2702 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:56.557052 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1f50b-cb5a-4ab6-8a47-7440e81e2702 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:56.557341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1f50b-cb5a-4ab6-8a47-7440e81e2702 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.558542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:56.566843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1f50b-cb5a-4ab6-8a47-7440e81e2702 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:56.568297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1f50b-cb5a-4ab6-8a47-7440e81e2702 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-96b1f50b-cb5a-4ab6-8a47-7440e81e2702 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:12:56.581701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:56.582881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:56.583775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:56.583775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:56.583775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:12:56.583775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:12:56.583775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:12:56.583775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:12:56.583775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:12:56.583775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:12:56.583775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 11:12:56.583775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:56.583775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 248/499] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:56.584367 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5a96-864d-4a86-a4c6-f248760292d1 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:56.584367 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5a96-864d-4a86-a4c6-f248760292d1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:56.584608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5a96-864d-4a86-a4c6-f248760292d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.602863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c39a5a96-864d-4a86-a4c6-f248760292d1 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:56.604068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c39a5a96-864d-4a86-a4c6-f248760292d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:56.655845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5b57e-2778-48e8-8ea0-fa1cb2655afe None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:56.680593 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 249/500] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:56.681605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a5a96-864d-4a86-a4c6-f248760292d1 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:56.691914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f830f-b1ea-4f18-90a1-78d6a080df00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:56.692523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f830f-b1ea-4f18-90a1-78d6a080df00 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:56.692796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f830f-b1ea-4f18-90a1-78d6a080df00 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:56.693067 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f830f-b1ea-4f18-90a1-78d6a080df00 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.693749 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f830f-b1ea-4f18-90a1-78d6a080df00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:56.694034 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f830f-b1ea-4f18-90a1-78d6a080df00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:56.695429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f830f-b1ea-4f18-90a1-78d6a080df00 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:56.707796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 252/501] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:56.709054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bbc1a-a192-4bfb-9beb-16df692c8839 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:56.713712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bbc1a-a192-4bfb-9beb-16df692c8839 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:56.713712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bbc1a-a192-4bfb-9beb-16df692c8839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.728722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a69bbc1a-a192-4bfb-9beb-16df692c8839 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:56.729839 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a69bbc1a-a192-4bfb-9beb-16df692c8839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:56.771167 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:56.799214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:56.804291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a5a96-864d-4a86-a4c6-f248760292d1 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:56.805182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 253/502] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:12:56.806057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bbc1a-a192-4bfb-9beb-16df692c8839 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:56.842630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218eb50-29cd-4f7e-8847-ac17402a1906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:56.843284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218eb50-29cd-4f7e-8847-ac17402a1906 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:56.843559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218eb50-29cd-4f7e-8847-ac17402a1906 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:56.843831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218eb50-29cd-4f7e-8847-ac17402a1906 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.844485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218eb50-29cd-4f7e-8847-ac17402a1906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:56.844787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218eb50-29cd-4f7e-8847-ac17402a1906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:56.846213 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218eb50-29cd-4f7e-8847-ac17402a1906 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:56.858679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 250/503] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:56.859603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218eb50-29cd-4f7e-8847-ac17402a1906 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:56.920798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bbc1a-a192-4bfb-9beb-16df692c8839 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:56.955898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd694d4-02db-448e-9aca-6cec573829e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:56.956534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd694d4-02db-448e-9aca-6cec573829e3 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:56.956801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd694d4-02db-448e-9aca-6cec573829e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:56.957069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd694d4-02db-448e-9aca-6cec573829e3 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.957819 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd694d4-02db-448e-9aca-6cec573829e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:56.958109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd694d4-02db-448e-9aca-6cec573829e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:56.959598 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd694d4-02db-448e-9aca-6cec573829e3 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:56.980474 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218eb50-29cd-4f7e-8847-ac17402a1906 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:56.996970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 254/504] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Aug 9 11:12:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:56.997798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd694d4-02db-448e-9aca-6cec573829e3 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:57.021555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:57.027672 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea761022-db4c-46dc-88bd-3e947dad58ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:57.028373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761022-db4c-46dc-88bd-3e947dad58ce None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:57.028710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761022-db4c-46dc-88bd-3e947dad58ce None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:57.029045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761022-db4c-46dc-88bd-3e947dad58ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:57.040195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea761022-db4c-46dc-88bd-3e947dad58ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:57.041822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea761022-db4c-46dc-88bd-3e947dad58ce None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-ea761022-db4c-46dc-88bd-3e947dad58ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:12:57.056248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:57.057383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:12:57.058404 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:12:57.058404 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:57.058404 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:57.061192 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:57.062408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 251/505] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:57.063335 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea761022-db4c-46dc-88bd-3e947dad58ce None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:57.106793 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd694d4-02db-448e-9aca-6cec573829e3 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:57.142128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187687f2-6051-4e96-a688-8ac7b8d7f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:57.142758 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187687f2-6051-4e96-a688-8ac7b8d7f679 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:57.143062 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187687f2-6051-4e96-a688-8ac7b8d7f679 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:57.143330 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187687f2-6051-4e96-a688-8ac7b8d7f679 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:57.152872 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187687f2-6051-4e96-a688-8ac7b8d7f679 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:57.154340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187687f2-6051-4e96-a688-8ac7b8d7f679 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:57.166716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea761022-db4c-46dc-88bd-3e947dad58ce None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-187687f2-6051-4e96-a688-8ac7b8d7f679 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:12:57.167323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:57.168256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:57.169315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:57.169315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:57.169315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:12:57.169315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:12:57.169315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:12:57.169315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:12:57.169315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:12:57.169315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:12:57.169315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:12:57.169315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:57.169315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 255/506] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Aug 9 11:12:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:57.169315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187687f2-6051-4e96-a688-8ac7b8d7f679 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:57.203400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950b3f-ca56-45f8-926a-e9bb4410cd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:57.204026 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950b3f-ca56-45f8-926a-e9bb4410cd62 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:57.204271 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950b3f-ca56-45f8-926a-e9bb4410cd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:57.204535 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950b3f-ca56-45f8-926a-e9bb4410cd62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:57.215011 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56950b3f-ca56-45f8-926a-e9bb4410cd62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-56950b3f-ca56-45f8-926a-e9bb4410cd62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:12:57.220428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:57.221443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:57.222347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:57.222347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:57.222347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:57.222347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:57.222347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:12:57.222347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:12:57.222347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:12:57.222347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:12:57.222347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:12:57.222347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:12:57.222347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:12:57.222347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:57.222347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 252/507] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:12:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:57.222347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950b3f-ca56-45f8-926a-e9bb4410cd62 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:57.268748 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:57.278984 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187687f2-6051-4e96-a688-8ac7b8d7f679 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:57.307435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:57.329103 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950b3f-ca56-45f8-926a-e9bb4410cd62 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:57.331911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab225209-2d95-4616-abd0-beaee67e61fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:57.332534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab225209-2d95-4616-abd0-beaee67e61fe None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:57.332815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab225209-2d95-4616-abd0-beaee67e61fe None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:57.333080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab225209-2d95-4616-abd0-beaee67e61fe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:57.341053 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab225209-2d95-4616-abd0-beaee67e61fe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:57.342545 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab225209-2d95-4616-abd0-beaee67e61fe None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-ab225209-2d95-4616-abd0-beaee67e61fe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:12:57.358523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:57.359763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:57.361032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:57.361032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:57.361032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:12:57.361032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:12:57.361032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:12:57.361032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:12:57.361032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:12:57.361032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:12:57.361032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:12:57.361032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:57.361032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 256/508] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:12:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:57.362010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab225209-2d95-4616-abd0-beaee67e61fe None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:57.367046 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566ec80-95b4-4aee-bd0c-681314aa3dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:57.367663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566ec80-95b4-4aee-bd0c-681314aa3dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:57.367937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566ec80-95b4-4aee-bd0c-681314aa3dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:57.368202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566ec80-95b4-4aee-bd0c-681314aa3dd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:57.439341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566ec80-95b4-4aee-bd0c-681314aa3dd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:57.441046 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566ec80-95b4-4aee-bd0c-681314aa3dd2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:57.465760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab225209-2d95-4616-abd0-beaee67e61fe None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:57.490316 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:57.502302 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ac15f-10ed-46d0-91d7-4f6c5a244929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:57.502948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ac15f-10ed-46d0-91d7-4f6c5a244929 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:57.503246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ac15f-10ed-46d0-91d7-4f6c5a244929 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:57.503605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ac15f-10ed-46d0-91d7-4f6c5a244929 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:57.504142 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ac15f-10ed-46d0-91d7-4f6c5a244929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:57.504436 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ac15f-10ed-46d0-91d7-4f6c5a244929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:57.505829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ac15f-10ed-46d0-91d7-4f6c5a244929 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:57.517890 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 257/509] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:57.518953 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ac15f-10ed-46d0-91d7-4f6c5a244929 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:57.549124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 253/510] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:57.550146 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566ec80-95b4-4aee-bd0c-681314aa3dd2 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:57.553719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:57.623889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ac15f-10ed-46d0-91d7-4f6c5a244929 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:57.657376 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566ec80-95b4-4aee-bd0c-681314aa3dd2 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:57.659498 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b14f6-45c2-4a50-b5b8-cb07c7cfca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:57.660109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b14f6-45c2-4a50-b5b8-cb07c7cfca52 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:57.660380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b14f6-45c2-4a50-b5b8-cb07c7cfca52 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:57.660642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b14f6-45c2-4a50-b5b8-cb07c7cfca52 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:57.661375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b14f6-45c2-4a50-b5b8-cb07c7cfca52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:57.661666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b14f6-45c2-4a50-b5b8-cb07c7cfca52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:57.663129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b14f6-45c2-4a50-b5b8-cb07c7cfca52 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:57.680739 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 258/511] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Aug 9 11:12:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:57.681662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b14f6-45c2-4a50-b5b8-cb07c7cfca52 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:57.693475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6142933-5745-4406-85f9-4e9e6ca5862f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:57.694074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6142933-5745-4406-85f9-4e9e6ca5862f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:57.694347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6142933-5745-4406-85f9-4e9e6ca5862f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:57.694613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6142933-5745-4406-85f9-4e9e6ca5862f None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:57.695301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6142933-5745-4406-85f9-4e9e6ca5862f None admin] RBAC: Adding query filter params (name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:57.695603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6142933-5745-4406-85f9-4e9e6ca5862f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:57.696992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6142933-5745-4406-85f9-4e9e6ca5862f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:57.704892 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 254/512] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:12:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:57.705680 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6142933-5745-4406-85f9-4e9e6ca5862f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:57.716341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:57.789935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:57.797711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b14f6-45c2-4a50-b5b8-cb07c7cfca52 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:57.815166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6142933-5745-4406-85f9-4e9e6ca5862f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:57.834167 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f172a-8df5-4d00-959e-79588a6a8b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:57.834775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f172a-8df5-4d00-959e-79588a6a8b27 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:57.835079 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f172a-8df5-4d00-959e-79588a6a8b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:57.835347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f172a-8df5-4d00-959e-79588a6a8b27 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:57.836085 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f172a-8df5-4d00-959e-79588a6a8b27 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:57.836385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f172a-8df5-4d00-959e-79588a6a8b27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:57.837829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f172a-8df5-4d00-959e-79588a6a8b27 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:57.850611 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f25e4e-e7ac-466d-9a7e-6e97f3ffe84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:57.851256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f25e4e-e7ac-466d-9a7e-6e97f3ffe84f None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:57.851530 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f25e4e-e7ac-466d-9a7e-6e97f3ffe84f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:57.851797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f25e4e-e7ac-466d-9a7e-6e97f3ffe84f None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:57.852431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f25e4e-e7ac-466d-9a7e-6e97f3ffe84f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:57.853841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f25e4e-e7ac-466d-9a7e-6e97f3ffe84f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:57.855909 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 259/513] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Aug 9 11:12:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:57.856738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f172a-8df5-4d00-959e-79588a6a8b27 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:57.876286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 255/514] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:12:57 2022] POST /identity/v3/users => generated 247 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:12:57.877131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f25e4e-e7ac-466d-9a7e-6e97f3ffe84f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:57.963998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:57.972120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f172a-8df5-4d00-959e-79588a6a8b27 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:58.012489 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f25e4e-e7ac-466d-9a7e-6e97f3ffe84f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:58.013686 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31339b6e-6985-451f-8977-bb51e3ab02d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:58.014362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31339b6e-6985-451f-8977-bb51e3ab02d8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:58.014632 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31339b6e-6985-451f-8977-bb51e3ab02d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:58.014937 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31339b6e-6985-451f-8977-bb51e3ab02d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:58.027385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31339b6e-6985-451f-8977-bb51e3ab02d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:58.029263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31339b6e-6985-451f-8977-bb51e3ab02d8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-31339b6e-6985-451f-8977-bb51e3ab02d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:12:58.048829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:58.050005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:12:58.051109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:12:58.051109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:58.051109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:58.051109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 260/515] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:58.052038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31339b6e-6985-451f-8977-bb51e3ab02d8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:58.057785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:58.062517 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62896122-cb71-4592-947e-4a3f1b6c11fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:58.063233 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62896122-cb71-4592-947e-4a3f1b6c11fd None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:58.064343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62896122-cb71-4592-947e-4a3f1b6c11fd None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:58.064343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62896122-cb71-4592-947e-4a3f1b6c11fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:58.144637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62896122-cb71-4592-947e-4a3f1b6c11fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:58.146152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62896122-cb71-4592-947e-4a3f1b6c11fd None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:58.168919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31339b6e-6985-451f-8977-bb51e3ab02d8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:58.205594 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a31db-7331-41db-b816-213fd71c7089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:58.206561 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a31db-7331-41db-b816-213fd71c7089 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:58.206868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a31db-7331-41db-b816-213fd71c7089 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:58.207324 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a31db-7331-41db-b816-213fd71c7089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:58.208125 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:58.219851 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a31db-7331-41db-b816-213fd71c7089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:58.222388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a31db-7331-41db-b816-213fd71c7089 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-4f3a31db-7331-41db-b816-213fd71c7089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:12:58.237724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:58.238721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:12:58.240003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:12:58.240003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:58.240003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:58.243695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 261/516] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:58.244609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a31db-7331-41db-b816-213fd71c7089 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:58.254073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 256/517] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:58.254741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62896122-cb71-4592-947e-4a3f1b6c11fd None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:58.310746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:58.358461 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a31db-7331-41db-b816-213fd71c7089 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:58.361683 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62896122-cb71-4592-947e-4a3f1b6c11fd None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:58.398529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2185f-e6ee-4e12-96b7-30a5c3bd9327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:58.399221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2185f-e6ee-4e12-96b7-30a5c3bd9327 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:58.399501 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2185f-e6ee-4e12-96b7-30a5c3bd9327 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:58.399768 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2185f-e6ee-4e12-96b7-30a5c3bd9327 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:58.406353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785304b9-1e37-4c14-a1d6-c62ed7047748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:58.407011 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785304b9-1e37-4c14-a1d6-c62ed7047748 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:58.407382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785304b9-1e37-4c14-a1d6-c62ed7047748 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:58.407747 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785304b9-1e37-4c14-a1d6-c62ed7047748 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:58.408512 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785304b9-1e37-4c14-a1d6-c62ed7047748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:58.408908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785304b9-1e37-4c14-a1d6-c62ed7047748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:58.410458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785304b9-1e37-4c14-a1d6-c62ed7047748 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:58.427842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 257/518] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:58.427842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785304b9-1e37-4c14-a1d6-c62ed7047748 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:58.454783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:58.479490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2185f-e6ee-4e12-96b7-30a5c3bd9327 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:58.482460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2185f-e6ee-4e12-96b7-30a5c3bd9327 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:58.541943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785304b9-1e37-4c14-a1d6-c62ed7047748 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:58.544666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:58.580570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf3c35-2bbf-402f-b606-82840267b166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:58.581300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf3c35-2bbf-402f-b606-82840267b166 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:58.581647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf3c35-2bbf-402f-b606-82840267b166 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:58.581985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf3c35-2bbf-402f-b606-82840267b166 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:58.582835 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf3c35-2bbf-402f-b606-82840267b166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:58.583210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf3c35-2bbf-402f-b606-82840267b166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:58.584790 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf3c35-2bbf-402f-b606-82840267b166 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:58.593155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 262/519] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:58.594095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2185f-e6ee-4e12-96b7-30a5c3bd9327 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:58.604527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 258/520] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:58.606108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf3c35-2bbf-402f-b606-82840267b166 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:58.695912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:58.709887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2185f-e6ee-4e12-96b7-30a5c3bd9327 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:58.717561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf3c35-2bbf-402f-b606-82840267b166 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:58.749743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dc29a-be4a-46b3-a8ee-a65a56ea0119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:58.750481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dc29a-be4a-46b3-a8ee-a65a56ea0119 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:58.750835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dc29a-be4a-46b3-a8ee-a65a56ea0119 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:58.751189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dc29a-be4a-46b3-a8ee-a65a56ea0119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:58.758213 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b56ac7-3b1f-4484-9065-9005c5863ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:58.758975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b56ac7-3b1f-4484-9065-9005c5863ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:58.759385 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b56ac7-3b1f-4484-9065-9005c5863ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:58.759749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b56ac7-3b1f-4484-9065-9005c5863ca3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:58.762244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dc29a-be4a-46b3-a8ee-a65a56ea0119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:58.764275 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dc29a-be4a-46b3-a8ee-a65a56ea0119 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:58.767455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b56ac7-3b1f-4484-9065-9005c5863ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:58.769088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b56ac7-3b1f-4484-9065-9005c5863ca3 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-727dc29a-be4a-46b3-a8ee-a65a56ea0119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:12:58.780892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:58.782169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:12:58.783508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:12:58.783508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:58.783508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:58.784068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 263/521] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:58.784880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dc29a-be4a-46b3-a8ee-a65a56ea0119 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-c8b56ac7-3b1f-4484-9065-9005c5863ca3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:12:58.785494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:58.786342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:58.787262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:12:58.787262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:12:58.787262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:12:58.787262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:12:58.787262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:12:58.787262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:12:58.787262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:12:58.787262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:58.791293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 259/522] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:58.792196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b56ac7-3b1f-4484-9065-9005c5863ca3 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:58.802891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:58.910021 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b56ac7-3b1f-4484-9065-9005c5863ca3 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:58.910980 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dc29a-be4a-46b3-a8ee-a65a56ea0119 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:58.952759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f02266-5a7b-40b2-8292-b5686b1f3a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:58.953047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af1f3f-eb64-444e-8f1d-0a214cc0ef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:58.953407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f02266-5a7b-40b2-8292-b5686b1f3a9e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:58.953679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f02266-5a7b-40b2-8292-b5686b1f3a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:58.953919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af1f3f-eb64-444e-8f1d-0a214cc0ef1c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:58.954061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f02266-5a7b-40b2-8292-b5686b1f3a9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:58.954392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af1f3f-eb64-444e-8f1d-0a214cc0ef1c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:58.954756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af1f3f-eb64-444e-8f1d-0a214cc0ef1c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:58.967069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f02266-5a7b-40b2-8292-b5686b1f3a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:58.968576 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f02266-5a7b-40b2-8292-b5686b1f3a9e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:58.972748 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af1f3f-eb64-444e-8f1d-0a214cc0ef1c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:58.974373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af1f3f-eb64-444e-8f1d-0a214cc0ef1c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-f2af1f3f-eb64-444e-8f1d-0a214cc0ef1c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:12:58.988979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:58.990096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:58.999456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:58.999456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:58.999456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:12:58.999456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:12:58.999456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:12:58.999456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:12:58.999456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:12:58.999456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:12:58.999456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 11:12:58.999456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-73f02266-5a7b-40b2-8292-b5686b1f3a9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:12:59.000305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:59.004573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:12:59.005752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:12:59.005752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:12:59.005752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:59.006143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 260/523] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:12:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:59.006143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af1f3f-eb64-444e-8f1d-0a214cc0ef1c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:59.006316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 264/524] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:59.006316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f02266-5a7b-40b2-8292-b5686b1f3a9e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:59.011702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:59.084649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:59.133027 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af1f3f-eb64-444e-8f1d-0a214cc0ef1c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:59.133506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f02266-5a7b-40b2-8292-b5686b1f3a9e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:59.170467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caae73-dde1-4757-b54f-9da89314a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:59.170683 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add07fdc-138c-486f-b6a1-743b0039f390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:59.171136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caae73-dde1-4757-b54f-9da89314a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:59.171213 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add07fdc-138c-486f-b6a1-743b0039f390 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:59.171299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caae73-dde1-4757-b54f-9da89314a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:59.171370 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add07fdc-138c-486f-b6a1-743b0039f390 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:59.171646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caae73-dde1-4757-b54f-9da89314a3d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:59.171746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add07fdc-138c-486f-b6a1-743b0039f390 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:59.172171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49caae73-dde1-4757-b54f-9da89314a3d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:59.172340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add07fdc-138c-486f-b6a1-743b0039f390 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:59.172486 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49caae73-dde1-4757-b54f-9da89314a3d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:59.172640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add07fdc-138c-486f-b6a1-743b0039f390 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:59.173828 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49caae73-dde1-4757-b54f-9da89314a3d8 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:59.174127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add07fdc-138c-486f-b6a1-743b0039f390 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:59.191811 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 261/525] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:59.193164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caae73-dde1-4757-b54f-9da89314a3d8 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:59.194870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 265/526] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:59.202577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add07fdc-138c-486f-b6a1-743b0039f390 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:59.256570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:59.298171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caae73-dde1-4757-b54f-9da89314a3d8 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:59.327503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add07fdc-138c-486f-b6a1-743b0039f390 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:59.341847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce257a80-bda8-40c8-bb31-84646977a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:59.342936 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce257a80-bda8-40c8-bb31-84646977a95e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:59.343374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce257a80-bda8-40c8-bb31-84646977a95e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:59.344019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce257a80-bda8-40c8-bb31-84646977a95e None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:59.345162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce257a80-bda8-40c8-bb31-84646977a95e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:59.345608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce257a80-bda8-40c8-bb31-84646977a95e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:59.347587 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce257a80-bda8-40c8-bb31-84646977a95e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:59.349941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:59.364673 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a6bd4-bcad-4694-951e-46eb76a1488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:59.365385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a6bd4-bcad-4694-951e-46eb76a1488f None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:59.365719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a6bd4-bcad-4694-951e-46eb76a1488f None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:59.366163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a6bd4-bcad-4694-951e-46eb76a1488f None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:59.366911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a6bd4-bcad-4694-951e-46eb76a1488f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:59.367266 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a6bd4-bcad-4694-951e-46eb76a1488f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:59.368728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a6bd4-bcad-4694-951e-46eb76a1488f None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:59.381904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 266/527] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:59.382847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a6bd4-bcad-4694-951e-46eb76a1488f None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:59.390487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 262/528] 10.222.0.59 () {56 vars in 1139 bytes} [Tue Aug 9 11:12:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:59.391588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce257a80-bda8-40c8-bb31-84646977a95e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:59.514673 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce257a80-bda8-40c8-bb31-84646977a95e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:59.518274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a6bd4-bcad-4694-951e-46eb76a1488f None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:59.537870 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:59.555369 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4f1a6-a1ac-4a31-9319-04d1a87ce69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:59.556095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4f1a6-a1ac-4a31-9319-04d1a87ce69b None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:59.556369 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4f1a6-a1ac-4a31-9319-04d1a87ce69b None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:59.556638 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4f1a6-a1ac-4a31-9319-04d1a87ce69b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:59.557482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4f1a6-a1ac-4a31-9319-04d1a87ce69b None admin] RBAC: Adding query filter params (role.id=9f750e14956d482c8757564559516c7a, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=a7f8976306ff477592c6c5b62af60f9a) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:59.557921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4f1a6-a1ac-4a31-9319-04d1a87ce69b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:59.559140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fb7ba-dba5-4d8e-b683-f447371c7698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:59.559448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4f1a6-a1ac-4a31-9319-04d1a87ce69b None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:59.559977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fb7ba-dba5-4d8e-b683-f447371c7698 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:59.560358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fb7ba-dba5-4d8e-b683-f447371c7698 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:59.560718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fb7ba-dba5-4d8e-b683-f447371c7698 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:59.568337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 263/529] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:12:59 2022] GET /identity/v3/role_assignments?user.id=a7f8976306ff477592c6c5b62af60f9a&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=9f750e14956d482c8757564559516c7a => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:59.568719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fb7ba-dba5-4d8e-b683-f447371c7698 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:59.569685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4f1a6-a1ac-4a31-9319-04d1a87ce69b None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:59.570321 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fb7ba-dba5-4d8e-b683-f447371c7698 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-751fb7ba-dba5-4d8e-b683-f447371c7698 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:12:59.591697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:59.592799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:59.593863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:12:59.593863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:12:59.593863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:12:59.593863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:12:59.593863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:12:59.593863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:12:59.593863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:12:59.593863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:12:59.598340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 267/530] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:59.599235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fb7ba-dba5-4d8e-b683-f447371c7698 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:59.652776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:59.709456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4f1a6-a1ac-4a31-9319-04d1a87ce69b None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:59.735537 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fb7ba-dba5-4d8e-b683-f447371c7698 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:59.750480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d8123-5262-42c7-b4ac-a98e237134aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:59.751172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d8123-5262-42c7-b4ac-a98e237134aa None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:59.751445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d8123-5262-42c7-b4ac-a98e237134aa None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:59.751716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d8123-5262-42c7-b4ac-a98e237134aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:59.759946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d8123-5262-42c7-b4ac-a98e237134aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:59.761400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d8123-5262-42c7-b4ac-a98e237134aa None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:59.777780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49bce4-b808-4f72-9a89-3c7967f8a780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:59.778732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49bce4-b808-4f72-9a89-3c7967f8a780 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:59.779294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49bce4-b808-4f72-9a89-3c7967f8a780 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:59.779759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49bce4-b808-4f72-9a89-3c7967f8a780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-344d8123-5262-42c7-b4ac-a98e237134aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:12:59.780943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:12:59.781800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:12:59.782650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:12:59.782650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:12:59.782650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:12:59.782650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:12:59.782650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:12:59.782650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:12:59.782650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:12:59.782650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:12:59.782650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 264/531] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:12:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:12:59.788257 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d8123-5262-42c7-b4ac-a98e237134aa None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:59.836771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:59.882728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49bce4-b808-4f72-9a89-3c7967f8a780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:59.884669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49bce4-b808-4f72-9a89-3c7967f8a780 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:59.903870 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d8123-5262-42c7-b4ac-a98e237134aa None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:59.937783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:59.951044 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e272be-1440-40ca-835c-f08e53fe6b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:59.952132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e272be-1440-40ca-835c-f08e53fe6b36 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:59.952545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e272be-1440-40ca-835c-f08e53fe6b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:59.952947 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e272be-1440-40ca-835c-f08e53fe6b36 None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:59.953650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e272be-1440-40ca-835c-f08e53fe6b36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:12:59.954103 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e272be-1440-40ca-835c-f08e53fe6b36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:59.955922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e272be-1440-40ca-835c-f08e53fe6b36 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:59.975317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 265/532] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:12:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:12:59.975317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e272be-1440-40ca-835c-f08e53fe6b36 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:00.005221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 268/533] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:13:00.005853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfdcb4-83fd-4a8d-972b-da7773d82981 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:00.006298 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfdcb4-83fd-4a8d-972b-da7773d82981 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:00.006681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfdcb4-83fd-4a8d-972b-da7773d82981 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:00.010969 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 269/534] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:00.012552 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfdcb4-83fd-4a8d-972b-da7773d82981 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:00.098519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e272be-1440-40ca-835c-f08e53fe6b36 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:00.103062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:00.131693 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfdcb4-83fd-4a8d-972b-da7773d82981 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:00.139915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8974fd-d3f5-42e7-b001-f5e9a9dcd24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:00.141003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8974fd-d3f5-42e7-b001-f5e9a9dcd24f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:00.141280 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8974fd-d3f5-42e7-b001-f5e9a9dcd24f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:00.141554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8974fd-d3f5-42e7-b001-f5e9a9dcd24f None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:00.142605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8974fd-d3f5-42e7-b001-f5e9a9dcd24f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:00.142941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8974fd-d3f5-42e7-b001-f5e9a9dcd24f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:00.144720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8974fd-d3f5-42e7-b001-f5e9a9dcd24f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:00.161898 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 266/535] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:12:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:00.161898 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8974fd-d3f5-42e7-b001-f5e9a9dcd24f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:00.176999 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3434bf-c967-437f-a19d-ee60addb7af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:00.177697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3434bf-c967-437f-a19d-ee60addb7af5 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:00.178032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3434bf-c967-437f-a19d-ee60addb7af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:00.178299 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3434bf-c967-437f-a19d-ee60addb7af5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:00.179064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3434bf-c967-437f-a19d-ee60addb7af5 None admin] RBAC: Adding query filter params (role.id=9f750e14956d482c8757564559516c7a, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=2136cf1160a64951ad780424cb28403b) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:00.179373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3434bf-c967-437f-a19d-ee60addb7af5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:00.180814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3434bf-c967-437f-a19d-ee60addb7af5 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:00.186328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 270/536] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:00 2022] GET /identity/v3/role_assignments?user.id=2136cf1160a64951ad780424cb28403b&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=9f750e14956d482c8757564559516c7a => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:00.187500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066188d-1f40-4cb9-af4d-dbc77f7cc73e None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:00.187774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066188d-1f40-4cb9-af4d-dbc77f7cc73e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:00.188040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066188d-1f40-4cb9-af4d-dbc77f7cc73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:00.196482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:00.211488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-1066188d-1f40-4cb9-af4d-dbc77f7cc73e None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:00.213047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1066188d-1f40-4cb9-af4d-dbc77f7cc73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:00.297426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 271/537] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:00.298694 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066188d-1f40-4cb9-af4d-dbc77f7cc73e None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:00.320345 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8974fd-d3f5-42e7-b001-f5e9a9dcd24f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:00.361387 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab9cbc-1f2a-42e1-bff1-2b2eb4d95cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:00.362363 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab9cbc-1f2a-42e1-bff1-2b2eb4d95cbf None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:00.362912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab9cbc-1f2a-42e1-bff1-2b2eb4d95cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:00.363387 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab9cbc-1f2a-42e1-bff1-2b2eb4d95cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:00.378302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab9cbc-1f2a-42e1-bff1-2b2eb4d95cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:00.388620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab9cbc-1f2a-42e1-bff1-2b2eb4d95cbf None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-a5ab9cbc-1f2a-42e1-bff1-2b2eb4d95cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:00.419484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:00.420469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:00.421453 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:00.421453 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:00.421453 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:00.423860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 267/538] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:00.425102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab9cbc-1f2a-42e1-bff1-2b2eb4d95cbf None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:00.429691 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066188d-1f40-4cb9-af4d-dbc77f7cc73e None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:00.455478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:00.477711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30168353-b660-4d22-bc3e-a650ee7b38e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:00.478851 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30168353-b660-4d22-bc3e-a650ee7b38e0 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:00.479393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30168353-b660-4d22-bc3e-a650ee7b38e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:00.479890 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30168353-b660-4d22-bc3e-a650ee7b38e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:00.480848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30168353-b660-4d22-bc3e-a650ee7b38e0 None admin] RBAC: Adding query filter params (role.id=9f750e14956d482c8757564559516c7a, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=a8bcbc6393d341a7be009f3b8c329e21) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:00.481383 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30168353-b660-4d22-bc3e-a650ee7b38e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:00.483096 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30168353-b660-4d22-bc3e-a650ee7b38e0 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:00.487165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:00.498998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 272/539] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:00 2022] GET /identity/v3/role_assignments?user.id=a8bcbc6393d341a7be009f3b8c329e21&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=9f750e14956d482c8757564559516c7a => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:00.500569 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30168353-b660-4d22-bc3e-a650ee7b38e0 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:00.587289 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab9cbc-1f2a-42e1-bff1-2b2eb4d95cbf None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:00.627060 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e270d-7311-458b-b62d-1216ef7c7f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:00.627624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e270d-7311-458b-b62d-1216ef7c7f05 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:00.627901 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e270d-7311-458b-b62d-1216ef7c7f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:00.628244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e270d-7311-458b-b62d-1216ef7c7f05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:00.640555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e270d-7311-458b-b62d-1216ef7c7f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-cb3e270d-7311-458b-b62d-1216ef7c7f05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:00.646445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:00.647437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:00.648691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:00.648691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:00.648691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:00.648691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:00.648691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:00.648691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:00.648691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:00.648691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:00.648691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:00.648691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:00.648691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:00.648691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:00.648691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 268/540] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:00.656082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e270d-7311-458b-b62d-1216ef7c7f05 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:00.716844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30168353-b660-4d22-bc3e-a650ee7b38e0 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:00.767325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839d761-0a92-4297-8640-802a63d2e2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:00.768366 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839d761-0a92-4297-8640-802a63d2e2bd None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:00.768856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839d761-0a92-4297-8640-802a63d2e2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:00.769363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839d761-0a92-4297-8640-802a63d2e2bd None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:00.770232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839d761-0a92-4297-8640-802a63d2e2bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:00.770541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839d761-0a92-4297-8640-802a63d2e2bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:00.772185 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839d761-0a92-4297-8640-802a63d2e2bd None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:00.787906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 273/541] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:00.798700 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839d761-0a92-4297-8640-802a63d2e2bd None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:00.809965 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:00.835451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e270d-7311-458b-b62d-1216ef7c7f05 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:00.879944 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a636-9e1b-40ed-b991-f6b27ddcf8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:00.880484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a636-9e1b-40ed-b991-f6b27ddcf8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:00.880754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a636-9e1b-40ed-b991-f6b27ddcf8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:00.881021 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a636-9e1b-40ed-b991-f6b27ddcf8b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:00.881693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320a636-9e1b-40ed-b991-f6b27ddcf8b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:00.882014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320a636-9e1b-40ed-b991-f6b27ddcf8b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:00.883648 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320a636-9e1b-40ed-b991-f6b27ddcf8b9 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:00.905033 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 269/542] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:13:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:00.907284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:00.912186 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a636-9e1b-40ed-b991-f6b27ddcf8b9 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:01.012823 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839d761-0a92-4297-8640-802a63d2e2bd None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:01.028673 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a636-9e1b-40ed-b991-f6b27ddcf8b9 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:01.065141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dcf4a-0c84-4208-82a0-a6d8acb600d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:01.065824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dcf4a-0c84-4208-82a0-a6d8acb600d6 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:01.066098 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dcf4a-0c84-4208-82a0-a6d8acb600d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:01.066366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dcf4a-0c84-4208-82a0-a6d8acb600d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:01.074502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:01.079861 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dcf4a-0c84-4208-82a0-a6d8acb600d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:01.081464 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dcf4a-0c84-4208-82a0-a6d8acb600d6 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:01.088587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f4b71-8e51-4c44-8388-2787bc2b16f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:01.089242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f4b71-8e51-4c44-8388-2787bc2b16f1 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:01.089514 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f4b71-8e51-4c44-8388-2787bc2b16f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:01.089773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f4b71-8e51-4c44-8388-2787bc2b16f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-eb4dcf4a-0c84-4208-82a0-a6d8acb600d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:01.097106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:01.098037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:01.098935 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:01.098935 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:01.098935 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:01.101975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f4b71-8e51-4c44-8388-2787bc2b16f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:01.102949 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 270/543] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:01.103492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f4b71-8e51-4c44-8388-2787bc2b16f1 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:01.104377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dcf4a-0c84-4208-82a0-a6d8acb600d6 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-b78f4b71-8e51-4c44-8388-2787bc2b16f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:01.134680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:01.135622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:01.136483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:01.136483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:01.136483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:01.136483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:01.136483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:01.136483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:01.136483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:01.136483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:01.136483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 274/544] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:01.143862 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f4b71-8e51-4c44-8388-2787bc2b16f1 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:01.213329 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dcf4a-0c84-4208-82a0-a6d8acb600d6 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:01.249333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883e4c7-e4ae-4585-8e21-e0fc24c6beb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:01.249953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883e4c7-e4ae-4585-8e21-e0fc24c6beb4 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:01.250227 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883e4c7-e4ae-4585-8e21-e0fc24c6beb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:01.250499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883e4c7-e4ae-4585-8e21-e0fc24c6beb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:01.254836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883e4c7-e4ae-4585-8e21-e0fc24c6beb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:01.254836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883e4c7-e4ae-4585-8e21-e0fc24c6beb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:01.254836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883e4c7-e4ae-4585-8e21-e0fc24c6beb4 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:01.270522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 271/545] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:01.271868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883e4c7-e4ae-4585-8e21-e0fc24c6beb4 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:01.325040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:01.363198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f4b71-8e51-4c44-8388-2787bc2b16f1 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:01.380043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883e4c7-e4ae-4585-8e21-e0fc24c6beb4 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:01.399300 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:01.419473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c0f52-ae9b-4292-9514-d50adcc1d2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:01.420114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c0f52-ae9b-4292-9514-d50adcc1d2ad None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:01.420391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c0f52-ae9b-4292-9514-d50adcc1d2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:01.420765 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c0f52-ae9b-4292-9514-d50adcc1d2ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:01.428799 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c0f52-ae9b-4292-9514-d50adcc1d2ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:01.430274 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c0f52-ae9b-4292-9514-d50adcc1d2ad None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:01.438946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab1567-2ed4-42bb-b07e-f2017ad979fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:01.439570 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1567-2ed4-42bb-b07e-f2017ad979fb None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:01.439844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1567-2ed4-42bb-b07e-f2017ad979fb None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:01.440130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1567-2ed4-42bb-b07e-f2017ad979fb None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:01.440915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab1567-2ed4-42bb-b07e-f2017ad979fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:01.441220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab1567-2ed4-42bb-b07e-f2017ad979fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:01.442697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab1567-2ed4-42bb-b07e-f2017ad979fb None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-f41c0f52-ae9b-4292-9514-d50adcc1d2ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:01.460483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:01.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:01.462952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:01.462952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:01.462952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:01.462952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:01.462952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:01.462952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:01.462952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:01.462952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:01.462952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:13:01.462952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:01.462952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 272/546] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:13:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:01.467550 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c0f52-ae9b-4292-9514-d50adcc1d2ad None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:01.471082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 275/547] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:01.481967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab1567-2ed4-42bb-b07e-f2017ad979fb None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:01.587647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab1567-2ed4-42bb-b07e-f2017ad979fb None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:01.630755 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a0ca7-a2dd-46a5-a38a-647dc87625df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:01.631405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a0ca7-a2dd-46a5-a38a-647dc87625df None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:01.631678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a0ca7-a2dd-46a5-a38a-647dc87625df None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:01.631940 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a0ca7-a2dd-46a5-a38a-647dc87625df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:01.632678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a0ca7-a2dd-46a5-a38a-647dc87625df None admin] RBAC: Adding query filter params (role.id=9f750e14956d482c8757564559516c7a, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=54cdc076295642bf945fe63a972b8aa4) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:01.632978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a0ca7-a2dd-46a5-a38a-647dc87625df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:01.635511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a0ca7-a2dd-46a5-a38a-647dc87625df None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:01.649685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 276/548] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:01 2022] GET /identity/v3/role_assignments?user.id=54cdc076295642bf945fe63a972b8aa4&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=9f750e14956d482c8757564559516c7a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:01.668349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c0f52-ae9b-4292-9514-d50adcc1d2ad None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:01.682535 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:01.718206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e9de3-1242-435c-b475-d5f1fb318eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:01.718860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e9de3-1242-435c-b475-d5f1fb318eff None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:01.719137 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e9de3-1242-435c-b475-d5f1fb318eff None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:01.719399 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e9de3-1242-435c-b475-d5f1fb318eff None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:01.720150 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e9de3-1242-435c-b475-d5f1fb318eff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:01.720451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e9de3-1242-435c-b475-d5f1fb318eff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:01.721963 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e9de3-1242-435c-b475-d5f1fb318eff None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:01.753524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 273/549] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Aug 9 11:13:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:01.759296 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a0ca7-a2dd-46a5-a38a-647dc87625df None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:01.827137 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:01.902375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a0ca7-a2dd-46a5-a38a-647dc87625df None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:01.941199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782277fa-06c5-4585-a3ed-b5d9c44dea5c None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:01.941915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782277fa-06c5-4585-a3ed-b5d9c44dea5c None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:01.942336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc983b-368c-44ad-8357-4f962c2ef224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:01.942629 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782277fa-06c5-4585-a3ed-b5d9c44dea5c None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:01.942983 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc983b-368c-44ad-8357-4f962c2ef224 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:01.943262 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc983b-368c-44ad-8357-4f962c2ef224 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:01.943530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc983b-368c-44ad-8357-4f962c2ef224 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:01.944921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 274/550] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:13:01.951790 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bfacc-5775-4ada-9ad4-e6260b48fccb None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:01.952367 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bfacc-5775-4ada-9ad4-e6260b48fccb None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:01.952824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bfacc-5775-4ada-9ad4-e6260b48fccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:01.974865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ab5bfacc-5775-4ada-9ad4-e6260b48fccb None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:01.976705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ab5bfacc-5775-4ada-9ad4-e6260b48fccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:02.060640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc983b-368c-44ad-8357-4f962c2ef224 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:02.062577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc983b-368c-44ad-8357-4f962c2ef224 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:02.105167 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 275/551] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:13:02.123697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:02.142507 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bfacc-5775-4ada-9ad4-e6260b48fccb None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:02.190530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 277/552] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:13:02.200159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc983b-368c-44ad-8357-4f962c2ef224 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:02.344856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:02.350468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bfacc-5775-4ada-9ad4-e6260b48fccb None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:02.387895 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db83b13-9b38-4913-9b47-e131407fa6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:02.388522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db83b13-9b38-4913-9b47-e131407fa6be None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:02.388791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db83b13-9b38-4913-9b47-e131407fa6be None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:02.389053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db83b13-9b38-4913-9b47-e131407fa6be None admin] PATH_INFO: `/v3/roles/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:02.399949 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db83b13-9b38-4913-9b47-e131407fa6be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-1db83b13-9b38-4913-9b47-e131407fa6be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:02.404872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:02.406124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:02.407699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:02.407699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:02.407699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:02.407699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:02.407699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:02.407699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:02.407699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:02.407699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:02.407699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:02.407699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:02.407699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:02.407699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:02.407699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 276/553] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:02.414636 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db83b13-9b38-4913-9b47-e131407fa6be None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:02.442044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc983b-368c-44ad-8357-4f962c2ef224 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:02.520915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2b3f7-63cd-40b9-9046-c6b308a382da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:02.521950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2b3f7-63cd-40b9-9046-c6b308a382da None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:02.522417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2b3f7-63cd-40b9-9046-c6b308a382da None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:02.522896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2b3f7-63cd-40b9-9046-c6b308a382da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:02.545831 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2b3f7-63cd-40b9-9046-c6b308a382da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:02.547737 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2b3f7-63cd-40b9-9046-c6b308a382da None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:02.551607 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-d3a2b3f7-63cd-40b9-9046-c6b308a382da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:02.580285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:02.581469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:02.582337 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:02.582337 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:02.582337 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:02.582337 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 278/554] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:02.587133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2b3f7-63cd-40b9-9046-c6b308a382da None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:02.606961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db83b13-9b38-4913-9b47-e131407fa6be None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:02.650256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f504f-65dd-4c56-9a14-7a715bf259ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:02.650910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f504f-65dd-4c56-9a14-7a715bf259ea None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:02.651176 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f504f-65dd-4c56-9a14-7a715bf259ea None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:02.651438 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f504f-65dd-4c56-9a14-7a715bf259ea None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:02.652121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f504f-65dd-4c56-9a14-7a715bf259ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:02.652498 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f504f-65dd-4c56-9a14-7a715bf259ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:02.653927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f504f-65dd-4c56-9a14-7a715bf259ea None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:02.680983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 277/555] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:13:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:02.686748 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f504f-65dd-4c56-9a14-7a715bf259ea None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:02.728784 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:02.770566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2b3f7-63cd-40b9-9046-c6b308a382da None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:02.804669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40602787-1bed-4eee-856a-9420c39b9c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:02.805348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40602787-1bed-4eee-856a-9420c39b9c3e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:02.805617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40602787-1bed-4eee-856a-9420c39b9c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:02.805883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40602787-1bed-4eee-856a-9420c39b9c3e None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:02.806524 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40602787-1bed-4eee-856a-9420c39b9c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:02.806844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40602787-1bed-4eee-856a-9420c39b9c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:02.808467 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40602787-1bed-4eee-856a-9420c39b9c3e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:02.814387 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f504f-65dd-4c56-9a14-7a715bf259ea None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:02.821295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 279/556] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:02.822570 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dccf4-d7aa-4b66-92f7-fa26ff6b4ef9 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:02.822865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dccf4-d7aa-4b66-92f7-fa26ff6b4ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:02.823138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dccf4-d7aa-4b66-92f7-fa26ff6b4ef9 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:02.824613 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 280/557] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:02.827729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dccf4-d7aa-4b66-92f7-fa26ff6b4ef9 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:02.855329 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18997da-b294-4a4d-93d9-2e09912c2525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:02.856029 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18997da-b294-4a4d-93d9-2e09912c2525 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:02.856305 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18997da-b294-4a4d-93d9-2e09912c2525 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:02.856571 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18997da-b294-4a4d-93d9-2e09912c2525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:02.868478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18997da-b294-4a4d-93d9-2e09912c2525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:02.870022 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18997da-b294-4a4d-93d9-2e09912c2525 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-e18997da-b294-4a4d-93d9-2e09912c2525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:02.886561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:02.889116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:02.891114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:02.891114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:02.891114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:02.897189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 278/558] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:02.897189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b18b0-6a3a-4c09-b40f-0eb7a6ee947d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:02.897189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b18b0-6a3a-4c09-b40f-0eb7a6ee947d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:02.897189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b18b0-6a3a-4c09-b40f-0eb7a6ee947d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:02.902038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:02.916441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-7c3b18b0-6a3a-4c09-b40f-0eb7a6ee947d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:02.918649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7c3b18b0-6a3a-4c09-b40f-0eb7a6ee947d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:02.949618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dccf4-d7aa-4b66-92f7-fa26ff6b4ef9 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:02.990934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 279/559] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:02.991492 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b18b0-6a3a-4c09-b40f-0eb7a6ee947d None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:02.993853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:03.000286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c53698-043e-47b0-bcee-51ba0667fb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:03.002438 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53698-043e-47b0-bcee-51ba0667fb89 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:03.003249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53698-043e-47b0-bcee-51ba0667fb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:03.003924 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53698-043e-47b0-bcee-51ba0667fb89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:03.016791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c53698-043e-47b0-bcee-51ba0667fb89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:03.019491 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c53698-043e-47b0-bcee-51ba0667fb89 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-c1c53698-043e-47b0-bcee-51ba0667fb89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:03.036110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:03.037141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:03.038011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:03.038011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:03.038011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:03.038011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:03.038011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:03.038011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:03.038011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:03.038011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:03.045747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 281/560] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:03.045747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc4f12-23ae-441e-a158-2e1365293131 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:03.045747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc4f12-23ae-441e-a158-2e1365293131 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:03.045747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc4f12-23ae-441e-a158-2e1365293131 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:03.045747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 282/561] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:03.045747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc4f12-23ae-441e-a158-2e1365293131 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:03.111343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b18b0-6a3a-4c09-b40f-0eb7a6ee947d None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:03.147670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a2679-7d79-4438-b108-32607d1a0dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:03.148665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a2679-7d79-4438-b108-32607d1a0dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:03.148940 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a2679-7d79-4438-b108-32607d1a0dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:03.149440 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a2679-7d79-4438-b108-32607d1a0dc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:03.150573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a2679-7d79-4438-b108-32607d1a0dc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:03.150980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a2679-7d79-4438-b108-32607d1a0dc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:03.152380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a2679-7d79-4438-b108-32607d1a0dc5 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:03.156635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc4f12-23ae-441e-a158-2e1365293131 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:03.165768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 280/562] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:03.167249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a2679-7d79-4438-b108-32607d1a0dc5 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:03.171203 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:03.193856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552515c-73d1-4de7-9f3b-401c46d17830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:03.194486 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552515c-73d1-4de7-9f3b-401c46d17830 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:03.194758 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552515c-73d1-4de7-9f3b-401c46d17830 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:03.195050 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552515c-73d1-4de7-9f3b-401c46d17830 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:03.205468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552515c-73d1-4de7-9f3b-401c46d17830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-a552515c-73d1-4de7-9f3b-401c46d17830 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:03.210220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:03.211443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:03.212335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:03.212335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:03.212335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:03.212335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:03.212335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:03.212335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:03.212335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:03.212335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:03.212335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:03.212335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:03.212335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:03.212335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:03.216402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 283/563] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:03.217681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3af5ea-fda9-4251-85e1-419a1c20c60e None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:03.217955 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3af5ea-fda9-4251-85e1-419a1c20c60e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:03.218220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3af5ea-fda9-4251-85e1-419a1c20c60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:03.236145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-cd3af5ea-fda9-4251-85e1-419a1c20c60e None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:03.236339 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:03.237584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cd3af5ea-fda9-4251-85e1-419a1c20c60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:03.277481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a2679-7d79-4438-b108-32607d1a0dc5 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:03.313555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e602dd-9726-4e5b-8f39-bbfc073b02d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:03.314389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 284/564] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:03.314499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e602dd-9726-4e5b-8f39-bbfc073b02d5 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:03.314601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e602dd-9726-4e5b-8f39-bbfc073b02d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:03.314828 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e602dd-9726-4e5b-8f39-bbfc073b02d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:03.315732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e602dd-9726-4e5b-8f39-bbfc073b02d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:03.316030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e602dd-9726-4e5b-8f39-bbfc073b02d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:03.317640 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e602dd-9726-4e5b-8f39-bbfc073b02d5 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:03.320843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3af5ea-fda9-4251-85e1-419a1c20c60e None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:03.335751 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 281/565] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:03.336788 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e602dd-9726-4e5b-8f39-bbfc073b02d5 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:03.430354 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3af5ea-fda9-4251-85e1-419a1c20c60e None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:03.434038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:03.452186 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e602dd-9726-4e5b-8f39-bbfc073b02d5 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:03.468278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfe42a-a493-4d15-aa4a-c5820f2a1bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:03.468953 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfe42a-a493-4d15-aa4a-c5820f2a1bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:03.469211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfe42a-a493-4d15-aa4a-c5820f2a1bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:03.469471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfe42a-a493-4d15-aa4a-c5820f2a1bb1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:03.477457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:03.477669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfe42a-a493-4d15-aa4a-c5820f2a1bb1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:03.479272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfe42a-a493-4d15-aa4a-c5820f2a1bb1 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-68dfe42a-a493-4d15-aa4a-c5820f2a1bb1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:03.494006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:03.495110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:03.496420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:03.496420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:03.496420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:03.496420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:03.496420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:03.496420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:03.496420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:03.496420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:03.496420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 11:13:03.496420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:03.496420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 285/566] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:13:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:03.496420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfe42a-a493-4d15-aa4a-c5820f2a1bb1 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:03.502283 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6b0b1-4228-4a89-951e-9f3d5f2dcc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:03.502572 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6b0b1-4228-4a89-951e-9f3d5f2dcc70 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:03.502890 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6b0b1-4228-4a89-951e-9f3d5f2dcc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:03.503158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6b0b1-4228-4a89-951e-9f3d5f2dcc70 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:03.503832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6b0b1-4228-4a89-951e-9f3d5f2dcc70 None admin] RBAC: Adding query filter params (name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:03.504134 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6b0b1-4228-4a89-951e-9f3d5f2dcc70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:03.505514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6b0b1-4228-4a89-951e-9f3d5f2dcc70 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:03.515240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 282/567] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:13:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:03.516042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6b0b1-4228-4a89-951e-9f3d5f2dcc70 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:03.613720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfe42a-a493-4d15-aa4a-c5820f2a1bb1 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:03.625802 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6b0b1-4228-4a89-951e-9f3d5f2dcc70 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:03.650583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7718f75-3c83-4e0e-ac95-a4d2db8137eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:03.652071 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7718f75-3c83-4e0e-ac95-a4d2db8137eb None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:03.652494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7718f75-3c83-4e0e-ac95-a4d2db8137eb None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:03.652917 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7718f75-3c83-4e0e-ac95-a4d2db8137eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:03.662150 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9e090-2c5e-4221-8053-65c6a1fa09ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:03.662917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9e090-2c5e-4221-8053-65c6a1fa09ed None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:03.663196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9e090-2c5e-4221-8053-65c6a1fa09ed None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:03.663463 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9e090-2c5e-4221-8053-65c6a1fa09ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:03.664233 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9e090-2c5e-4221-8053-65c6a1fa09ed None admin] RBAC: Adding query filter params (role.id=9f750e14956d482c8757564559516c7a, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=913447120a2e42d8affdf50bb74dc5aa) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:03.664624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9e090-2c5e-4221-8053-65c6a1fa09ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:03.665407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7718f75-3c83-4e0e-ac95-a4d2db8137eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:03.665984 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9e090-2c5e-4221-8053-65c6a1fa09ed None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-c7718f75-3c83-4e0e-ac95-a4d2db8137eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:03.670641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:03.671605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:03.672611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:03.672611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:03.672611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:03.672611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:03.672611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:03.672611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:03.672611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:03.672611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:03.672611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:03.672611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:03.672611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:03.672611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:03.672611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 286/568] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:03.672611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7718f75-3c83-4e0e-ac95-a4d2db8137eb None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:03.686979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 283/569] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:03 2022] GET /identity/v3/role_assignments?user.id=913447120a2e42d8affdf50bb74dc5aa&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=9f750e14956d482c8757564559516c7a => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:03.686979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9e090-2c5e-4221-8053-65c6a1fa09ed None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:03.714470 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:03.745798 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:03.805585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9e090-2c5e-4221-8053-65c6a1fa09ed None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:03.812956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7718f75-3c83-4e0e-ac95-a4d2db8137eb None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:03.852994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5efe6-ba11-4f1c-b9a5-c8bb4e86441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:03.853637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5efe6-ba11-4f1c-b9a5-c8bb4e86441f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:03.853906 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5efe6-ba11-4f1c-b9a5-c8bb4e86441f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:03.854170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5efe6-ba11-4f1c-b9a5-c8bb4e86441f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:03.867942 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70a478-2aee-45fd-829c-24ba90db4eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:03.869294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a478-2aee-45fd-829c-24ba90db4eaf None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:03.869467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5efe6-ba11-4f1c-b9a5-c8bb4e86441f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:03.870158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a478-2aee-45fd-829c-24ba90db4eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:03.871244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5efe6-ba11-4f1c-b9a5-c8bb4e86441f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:03.871741 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a478-2aee-45fd-829c-24ba90db4eaf None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:03.873454 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70a478-2aee-45fd-829c-24ba90db4eaf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:03.874393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70a478-2aee-45fd-829c-24ba90db4eaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:03.877111 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70a478-2aee-45fd-829c-24ba90db4eaf None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-53b5efe6-ba11-4f1c-b9a5-c8bb4e86441f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:03.889832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:03.891368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:03.892276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:03.892276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:03.892276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:03.894993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 284/570] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:03.896082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5efe6-ba11-4f1c-b9a5-c8bb4e86441f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:03.917556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 287/571] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Aug 9 11:13:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:03.919008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70a478-2aee-45fd-829c-24ba90db4eaf None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:04.005781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:04.011770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:04.017455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5efe6-ba11-4f1c-b9a5-c8bb4e86441f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:04.029494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70a478-2aee-45fd-829c-24ba90db4eaf None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:04.059465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589022bd-91b9-40ac-84f6-16409d3cf3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:04.060068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589022bd-91b9-40ac-84f6-16409d3cf3ea None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.060360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589022bd-91b9-40ac-84f6-16409d3cf3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.060606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589022bd-91b9-40ac-84f6-16409d3cf3ea None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.061264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589022bd-91b9-40ac-84f6-16409d3cf3ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:04.061567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589022bd-91b9-40ac-84f6-16409d3cf3ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:04.062984 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589022bd-91b9-40ac-84f6-16409d3cf3ea None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:04.068832 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b1286-240c-4e0c-bef9-4170d494f821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:04.069417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b1286-240c-4e0c-bef9-4170d494f821 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.069685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b1286-240c-4e0c-bef9-4170d494f821 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.069953 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b1286-240c-4e0c-bef9-4170d494f821 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.070602 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b1286-240c-4e0c-bef9-4170d494f821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:04.070932 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b1286-240c-4e0c-bef9-4170d494f821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:04.072320 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b1286-240c-4e0c-bef9-4170d494f821 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:04.073446 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 285/572] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:13:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:04.074450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589022bd-91b9-40ac-84f6-16409d3cf3ea None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:04.089568 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 288/573] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:04.090844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33527dd-11c4-41d5-aa9c-d4bf91f69b46 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.091135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33527dd-11c4-41d5-aa9c-d4bf91f69b46 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.091397 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33527dd-11c4-41d5-aa9c-d4bf91f69b46 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.096826 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 289/574] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:04.096826 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33527dd-11c4-41d5-aa9c-d4bf91f69b46 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:04.208491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589022bd-91b9-40ac-84f6-16409d3cf3ea None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:04.208911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33527dd-11c4-41d5-aa9c-d4bf91f69b46 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:04.252650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d777af-ae71-462b-b239-9573e41bcd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:04.253680 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d777af-ae71-462b-b239-9573e41bcd22 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.254145 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d777af-ae71-462b-b239-9573e41bcd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.254247 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068c89b-b7db-4740-a4ee-81c39d942e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:04.254601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d777af-ae71-462b-b239-9573e41bcd22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.254833 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068c89b-b7db-4740-a4ee-81c39d942e5a None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.255117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068c89b-b7db-4740-a4ee-81c39d942e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.255443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068c89b-b7db-4740-a4ee-81c39d942e5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.269053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d777af-ae71-462b-b239-9573e41bcd22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:04.270574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d777af-ae71-462b-b239-9573e41bcd22 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:04.277733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068c89b-b7db-4740-a4ee-81c39d942e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:04.279898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068c89b-b7db-4740-a4ee-81c39d942e5a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:04.282364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-c8d777af-ae71-462b-b239-9573e41bcd22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:04.287586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:04.288622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:04.289527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:04.289527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:04.289527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:04.298858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 286/575] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:04.299877 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d777af-ae71-462b-b239-9573e41bcd22 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-f068c89b-b7db-4740-a4ee-81c39d942e5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:04.300866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:04.301787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:04.302675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:04.302675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:04.302675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:04.306654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 290/576] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:04.308069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd6e9d-e414-4208-95cc-684ea6a49609 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.308350 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd6e9d-e414-4208-95cc-684ea6a49609 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.308626 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd6e9d-e414-4208-95cc-684ea6a49609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.321219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:04.327702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-edfd6e9d-e414-4208-95cc-684ea6a49609 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:04.328925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-edfd6e9d-e414-4208-95cc-684ea6a49609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:04.412035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 291/577] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:04.412035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd6e9d-e414-4208-95cc-684ea6a49609 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:04.433586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d777af-ae71-462b-b239-9573e41bcd22 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:04.473330 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e2d6e-2c93-457c-8b40-38e369368132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:04.474075 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e2d6e-2c93-457c-8b40-38e369368132 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.474367 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e2d6e-2c93-457c-8b40-38e369368132 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.474638 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e2d6e-2c93-457c-8b40-38e369368132 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.483369 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e2d6e-2c93-457c-8b40-38e369368132 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:04.484845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e2d6e-2c93-457c-8b40-38e369368132 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-be8e2d6e-2c93-457c-8b40-38e369368132 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:04.498578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:04.499641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:04.500595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:04.500595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:04.500595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:04.500595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:04.500595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:04.500595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:04.500595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:04.500595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:04.500595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:13:04.500595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:04.500595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 287/578] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Aug 9 11:13:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:04.500595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e2d6e-2c93-457c-8b40-38e369368132 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:04.548037 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd6e9d-e414-4208-95cc-684ea6a49609 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:04.575481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:04.588508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2ba9d-29db-4cdd-8b30-4f1666fc5f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:04.590460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2ba9d-29db-4cdd-8b30-4f1666fc5f29 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.590460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2ba9d-29db-4cdd-8b30-4f1666fc5f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.590460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2ba9d-29db-4cdd-8b30-4f1666fc5f29 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.590460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2ba9d-29db-4cdd-8b30-4f1666fc5f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:04.590775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2ba9d-29db-4cdd-8b30-4f1666fc5f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:04.592173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2ba9d-29db-4cdd-8b30-4f1666fc5f29 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:04.607400 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 292/579] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:04.611173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2ba9d-29db-4cdd-8b30-4f1666fc5f29 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:04.617191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:04.647915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e2d6e-2c93-457c-8b40-38e369368132 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:04.693565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94aa19-dcea-454d-a3bf-0cd559fab3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:04.694291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94aa19-dcea-454d-a3bf-0cd559fab3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.694639 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94aa19-dcea-454d-a3bf-0cd559fab3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.695029 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94aa19-dcea-454d-a3bf-0cd559fab3b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.695744 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94aa19-dcea-454d-a3bf-0cd559fab3b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:04.696109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94aa19-dcea-454d-a3bf-0cd559fab3b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:04.698234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94aa19-dcea-454d-a3bf-0cd559fab3b0 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:04.713736 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 288/580] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:04.713736 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94aa19-dcea-454d-a3bf-0cd559fab3b0 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:04.729641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2ba9d-29db-4cdd-8b30-4f1666fc5f29 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:04.769188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af9dc7-ace3-43cb-ab96-c55519ee3c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:04.769826 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af9dc7-ace3-43cb-ab96-c55519ee3c35 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.770101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af9dc7-ace3-43cb-ab96-c55519ee3c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.770663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af9dc7-ace3-43cb-ab96-c55519ee3c35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.785087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af9dc7-ace3-43cb-ab96-c55519ee3c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-91af9dc7-ace3-43cb-ab96-c55519ee3c35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:04.790871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:04.791871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:04.792781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:04.792781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:04.792781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:04.792781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:04.792781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:04.792781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:04.792781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:04.792781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:04.792781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:04.792781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:04.792781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:04.792781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:04.792781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 293/581] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:04.792781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af9dc7-ace3-43cb-ab96-c55519ee3c35 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:04.834188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94aa19-dcea-454d-a3bf-0cd559fab3b0 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:04.855046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:04.875053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa03a-8dd1-4004-bce6-9cf123007cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:04.875664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa03a-8dd1-4004-bce6-9cf123007cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.875956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa03a-8dd1-4004-bce6-9cf123007cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.876209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa03a-8dd1-4004-bce6-9cf123007cf6 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.877097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaa03a-8dd1-4004-bce6-9cf123007cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:04.877214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaa03a-8dd1-4004-bce6-9cf123007cf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:04.878681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaa03a-8dd1-4004-bce6-9cf123007cf6 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:04.880843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:04.899694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 289/582] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Aug 9 11:13:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:04.900562 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa03a-8dd1-4004-bce6-9cf123007cf6 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:04.932793 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af9dc7-ace3-43cb-ab96-c55519ee3c35 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:04.970715 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e324b1-3580-4844-9e07-efdd371f286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:04.971395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e324b1-3580-4844-9e07-efdd371f286e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.971671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e324b1-3580-4844-9e07-efdd371f286e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.971937 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e324b1-3580-4844-9e07-efdd371f286e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.979852 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e324b1-3580-4844-9e07-efdd371f286e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:04.981287 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e324b1-3580-4844-9e07-efdd371f286e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-00e324b1-3580-4844-9e07-efdd371f286e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:04.994241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:04.996098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:04.997391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:04.997391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:04.997391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:04.997391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:04.997391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:04.997391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:04.997391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:04.997391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:05.000785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 294/583] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:05.001504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e324b1-3580-4844-9e07-efdd371f286e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:05.023042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa03a-8dd1-4004-bce6-9cf123007cf6 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:05.062704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf9883-3d83-4efe-905e-f48d470adc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:05.063391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf9883-3d83-4efe-905e-f48d470adc0a None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:05.063656 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf9883-3d83-4efe-905e-f48d470adc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:05.063922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf9883-3d83-4efe-905e-f48d470adc0a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:05.071974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf9883-3d83-4efe-905e-f48d470adc0a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:05.073435 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf9883-3d83-4efe-905e-f48d470adc0a None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-efaf9883-3d83-4efe-905e-f48d470adc0a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:05.086505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:05.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:05.089175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:05.089175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:05.089175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:05.089175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:05.089175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:05.089175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:05.089175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:05.089175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:05.089175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:13:05.089175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:05.092623 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 290/584] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:13:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:05.093697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf9883-3d83-4efe-905e-f48d470adc0a None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:05.117674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e324b1-3580-4844-9e07-efdd371f286e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:05.120044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:05.149956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:05.157578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5697a-b903-465b-8ee5-0ba07ebcd132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:05.158188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5697a-b903-465b-8ee5-0ba07ebcd132 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:05.158456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5697a-b903-465b-8ee5-0ba07ebcd132 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:05.158718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5697a-b903-465b-8ee5-0ba07ebcd132 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:05.159483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5697a-b903-465b-8ee5-0ba07ebcd132 None admin] RBAC: Adding query filter params (name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:05.159773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5697a-b903-465b-8ee5-0ba07ebcd132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:05.161151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5697a-b903-465b-8ee5-0ba07ebcd132 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:05.170202 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 295/585] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:13:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:05.170879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5697a-b903-465b-8ee5-0ba07ebcd132 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:05.208229 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf9883-3d83-4efe-905e-f48d470adc0a None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:05.246183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d9586-75d4-4892-95cf-0a0f4ea3bac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:05.246844 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9586-75d4-4892-95cf-0a0f4ea3bac3 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:05.247145 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9586-75d4-4892-95cf-0a0f4ea3bac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:05.247414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9586-75d4-4892-95cf-0a0f4ea3bac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:05.258756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d9586-75d4-4892-95cf-0a0f4ea3bac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:05.260256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d9586-75d4-4892-95cf-0a0f4ea3bac3 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-583d9586-75d4-4892-95cf-0a0f4ea3bac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:05.274738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:05.275782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:05.276817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:05.276817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:05.276817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:05.276817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 291/586] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:05.276817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d9586-75d4-4892-95cf-0a0f4ea3bac3 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:05.291512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5697a-b903-465b-8ee5-0ba07ebcd132 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:05.329110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f960c-0f07-4d77-b78b-9fa19c8afa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:05.329734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f960c-0f07-4d77-b78b-9fa19c8afa73 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:05.330002 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f960c-0f07-4d77-b78b-9fa19c8afa73 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:05.330272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f960c-0f07-4d77-b78b-9fa19c8afa73 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:05.331007 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f960c-0f07-4d77-b78b-9fa19c8afa73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:05.331336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f960c-0f07-4d77-b78b-9fa19c8afa73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:05.332777 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f960c-0f07-4d77-b78b-9fa19c8afa73 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:05.345946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 296/587] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:05.346901 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f960c-0f07-4d77-b78b-9fa19c8afa73 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:05.378472 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:05.391024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d9586-75d4-4892-95cf-0a0f4ea3bac3 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:05.393406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:05.437228 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073dea3-2697-4689-b139-d7d5642bf459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:05.437842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073dea3-2697-4689-b139-d7d5642bf459 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:05.438117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073dea3-2697-4689-b139-d7d5642bf459 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:05.438807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073dea3-2697-4689-b139-d7d5642bf459 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:05.440125 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073dea3-2697-4689-b139-d7d5642bf459 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:05.440125 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073dea3-2697-4689-b139-d7d5642bf459 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:05.441723 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073dea3-2697-4689-b139-d7d5642bf459 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:05.461309 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 292/588] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Aug 9 11:13:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:05.461963 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073dea3-2697-4689-b139-d7d5642bf459 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:05.469355 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f960c-0f07-4d77-b78b-9fa19c8afa73 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:05.509206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f9c2a-2429-42c4-ad61-3fcee2fc1acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:05.509844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f9c2a-2429-42c4-ad61-3fcee2fc1acf None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:05.510131 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f9c2a-2429-42c4-ad61-3fcee2fc1acf None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:05.510502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f9c2a-2429-42c4-ad61-3fcee2fc1acf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:05.521831 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f9c2a-2429-42c4-ad61-3fcee2fc1acf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:05.523405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f9c2a-2429-42c4-ad61-3fcee2fc1acf None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-9e3f9c2a-2429-42c4-ad61-3fcee2fc1acf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:05.538509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:05.539612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:05.540674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:05.540674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:05.540674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:05.540674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 297/589] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:05.540935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f9c2a-2429-42c4-ad61-3fcee2fc1acf None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:05.583197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073dea3-2697-4689-b139-d7d5642bf459 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:05.620392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b673304-1421-4d98-bba8-e50d0cd18b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:05.621759 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b673304-1421-4d98-bba8-e50d0cd18b79 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:05.622032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b673304-1421-4d98-bba8-e50d0cd18b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:05.622316 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b673304-1421-4d98-bba8-e50d0cd18b79 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:05.622990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b673304-1421-4d98-bba8-e50d0cd18b79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:05.623296 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b673304-1421-4d98-bba8-e50d0cd18b79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:05.624693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b673304-1421-4d98-bba8-e50d0cd18b79 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:05.625271 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:05.642765 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 293/590] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:05.644143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b673304-1421-4d98-bba8-e50d0cd18b79 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:05.658558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f9c2a-2429-42c4-ad61-3fcee2fc1acf None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:05.678163 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:05.695956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596592e-f4f6-4f11-b197-d84fc8036f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:05.696708 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596592e-f4f6-4f11-b197-d84fc8036f85 None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:05.697047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596592e-f4f6-4f11-b197-d84fc8036f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:05.697435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596592e-f4f6-4f11-b197-d84fc8036f85 None admin] PATH_INFO: `/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/a7f8976306ff477592c6c5b62af60f9a/roles/9f750e14956d482c8757564559516c7a` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:05.712773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596592e-f4f6-4f11-b197-d84fc8036f85 None admin] RBAC: Authorizing `identity:create_grant(project_id=f53fb3d6b68b4654ae7247c9b74015e7, user_id=a7f8976306ff477592c6c5b62af60f9a, role_id=9f750e14956d482c8757564559516c7a)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:05.714237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596592e-f4f6-4f11-b197-d84fc8036f85 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:05.728680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 298/591] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:13:05 2022] PUT /identity/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/a7f8976306ff477592c6c5b62af60f9a/roles/9f750e14956d482c8757564559516c7a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:13:05.731721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596592e-f4f6-4f11-b197-d84fc8036f85 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:05.766235 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b673304-1421-4d98-bba8-e50d0cd18b79 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:05.804601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1ef6f-3b74-44ba-9611-4eed31e8378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:05.805238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1ef6f-3b74-44ba-9611-4eed31e8378c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:05.805509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1ef6f-3b74-44ba-9611-4eed31e8378c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:05.805769 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1ef6f-3b74-44ba-9611-4eed31e8378c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:05.818061 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1ef6f-3b74-44ba-9611-4eed31e8378c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:05.819591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1ef6f-3b74-44ba-9611-4eed31e8378c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-14c1ef6f-3b74-44ba-9611-4eed31e8378c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:05.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:05.836226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:05.837117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:05.837117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:05.837117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:05.837117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 294/592] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:05.837117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1ef6f-3b74-44ba-9611-4eed31e8378c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:05.847118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596592e-f4f6-4f11-b197-d84fc8036f85 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:05.879457 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:05.894944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c15008-7898-44b1-82f3-9d75dbba50fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:05.895562 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15008-7898-44b1-82f3-9d75dbba50fe None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:05.895830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15008-7898-44b1-82f3-9d75dbba50fe None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:05.896094 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15008-7898-44b1-82f3-9d75dbba50fe None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:05.896749 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c15008-7898-44b1-82f3-9d75dbba50fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:05.897347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c15008-7898-44b1-82f3-9d75dbba50fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:05.899686 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c15008-7898-44b1-82f3-9d75dbba50fe None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:05.912685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 299/593] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:05.914000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d01e-cb5b-4520-a3dc-7fc22a2d8872 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:05.914345 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d01e-cb5b-4520-a3dc-7fc22a2d8872 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:05.914669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d01e-cb5b-4520-a3dc-7fc22a2d8872 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:05.916109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 300/594] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:05.916691 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4d01e-cb5b-4520-a3dc-7fc22a2d8872 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:05.933933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:05.971300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1ef6f-3b74-44ba-9611-4eed31e8378c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:06.029553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347a666-f9fc-4a97-bfee-0eb4471cc198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:06.030222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347a666-f9fc-4a97-bfee-0eb4471cc198 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:06.030578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347a666-f9fc-4a97-bfee-0eb4471cc198 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:06.030862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347a666-f9fc-4a97-bfee-0eb4471cc198 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:06.038838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347a666-f9fc-4a97-bfee-0eb4471cc198 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:06.040324 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347a666-f9fc-4a97-bfee-0eb4471cc198 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:06.042295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4d01e-cb5b-4520-a3dc-7fc22a2d8872 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-0347a666-f9fc-4a97-bfee-0eb4471cc198 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:06.052325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:06.053619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:06.054852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:06.054852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:06.054852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:06.054852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:06.054852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:06.054852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:06.054852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:06.054852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:06.057899 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 295/595] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:06.058996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347a666-f9fc-4a97-bfee-0eb4471cc198 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:06.082217 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31917b-9670-46b6-814f-e88195b16ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:06.083005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31917b-9670-46b6-814f-e88195b16ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:06.083390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31917b-9670-46b6-814f-e88195b16ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:06.083747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31917b-9670-46b6-814f-e88195b16ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:06.084711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31917b-9670-46b6-814f-e88195b16ac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:06.085326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31917b-9670-46b6-814f-e88195b16ac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:06.086833 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31917b-9670-46b6-814f-e88195b16ac7 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:06.104072 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 301/596] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:06.105363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35dee5-134e-4100-a283-4ee54cacdd57 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:06.105739 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35dee5-134e-4100-a283-4ee54cacdd57 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:06.106098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35dee5-134e-4100-a283-4ee54cacdd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:06.124574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-6e35dee5-134e-4100-a283-4ee54cacdd57 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:06.125781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6e35dee5-134e-4100-a283-4ee54cacdd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:06.172282 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347a666-f9fc-4a97-bfee-0eb4471cc198 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:06.174479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:06.202891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 302/597] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:06.202891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35dee5-134e-4100-a283-4ee54cacdd57 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:06.216276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9dcca-6b6b-45d9-a231-df5d843c9994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:06.217009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9dcca-6b6b-45d9-a231-df5d843c9994 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:06.217717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9dcca-6b6b-45d9-a231-df5d843c9994 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:06.218065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9dcca-6b6b-45d9-a231-df5d843c9994 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:06.220914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:06.229100 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9dcca-6b6b-45d9-a231-df5d843c9994 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:06.230650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9dcca-6b6b-45d9-a231-df5d843c9994 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-7ef9dcca-6b6b-45d9-a231-df5d843c9994 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:06.242313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:06.243554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:06.244732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:06.244732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:06.244732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:06.244732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:06.244732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:06.244732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:06.244732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:06.244732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:06.244732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 11:13:06.244732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:06.246248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 296/598] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:06.247108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9dcca-6b6b-45d9-a231-df5d843c9994 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:06.322475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35dee5-134e-4100-a283-4ee54cacdd57 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:06.360024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9dcca-6b6b-45d9-a231-df5d843c9994 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:06.361488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab61a82-8055-4c1d-b092-48457d9ce135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:06.362104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab61a82-8055-4c1d-b092-48457d9ce135 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:06.362437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab61a82-8055-4c1d-b092-48457d9ce135 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:06.362709 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab61a82-8055-4c1d-b092-48457d9ce135 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:06.363428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab61a82-8055-4c1d-b092-48457d9ce135 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:06.363727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab61a82-8055-4c1d-b092-48457d9ce135 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:06.365201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab61a82-8055-4c1d-b092-48457d9ce135 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:06.383000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 303/599] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:06.383000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab61a82-8055-4c1d-b092-48457d9ce135 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:06.402940 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703412f9-7472-4f63-9800-89129d03cb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:06.403583 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703412f9-7472-4f63-9800-89129d03cb0d None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:06.403854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703412f9-7472-4f63-9800-89129d03cb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:06.404121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703412f9-7472-4f63-9800-89129d03cb0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:06.413324 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703412f9-7472-4f63-9800-89129d03cb0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:06.414806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703412f9-7472-4f63-9800-89129d03cb0d None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-703412f9-7472-4f63-9800-89129d03cb0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:06.426422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:06.427354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:06.433853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:06.433853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:06.433853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:06.433853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:06.433853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:06.433853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:06.433853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:06.433853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:06.433853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 297/600] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:06.433853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703412f9-7472-4f63-9800-89129d03cb0d None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:06.435698 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:06.496607 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:06.504432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab61a82-8055-4c1d-b092-48457d9ce135 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:06.541587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80193d38-cc49-403e-8209-696b760c8d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:06.542354 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80193d38-cc49-403e-8209-696b760c8d24 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:06.542710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80193d38-cc49-403e-8209-696b760c8d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:06.543094 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80193d38-cc49-403e-8209-696b760c8d24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:06.546982 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703412f9-7472-4f63-9800-89129d03cb0d None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:06.554158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80193d38-cc49-403e-8209-696b760c8d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-80193d38-cc49-403e-8209-696b760c8d24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:06.559538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:06.560665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:06.561722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:06.561722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:06.561722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:06.561722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:06.561722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:06.561722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:06.561722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:06.561722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:06.561722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:06.561722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:06.561722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:06.561722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:06.562433 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 304/601] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:06.563339 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80193d38-cc49-403e-8209-696b760c8d24 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:06.590456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6b7e5-c5ff-496c-ba01-6f652b501e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:06.591067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6b7e5-c5ff-496c-ba01-6f652b501e30 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:06.591267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6b7e5-c5ff-496c-ba01-6f652b501e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:06.591529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6b7e5-c5ff-496c-ba01-6f652b501e30 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:06.592254 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6b7e5-c5ff-496c-ba01-6f652b501e30 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:06.592572 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6b7e5-c5ff-496c-ba01-6f652b501e30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:06.593970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6b7e5-c5ff-496c-ba01-6f652b501e30 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:06.612130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 298/602] 10.222.0.59 () {56 vars in 1139 bytes} [Tue Aug 9 11:13:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:06.613036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6b7e5-c5ff-496c-ba01-6f652b501e30 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:06.681706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:06.686025 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80193d38-cc49-403e-8209-696b760c8d24 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:06.720668 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6dbd5-468d-4d5e-9776-cc63fba47034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:06.721307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6dbd5-468d-4d5e-9776-cc63fba47034 None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:06.721608 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6dbd5-468d-4d5e-9776-cc63fba47034 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:06.721949 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6dbd5-468d-4d5e-9776-cc63fba47034 None admin] PATH_INFO: `/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/2136cf1160a64951ad780424cb28403b/roles/9f750e14956d482c8757564559516c7a` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:06.725595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6b7e5-c5ff-496c-ba01-6f652b501e30 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:06.739233 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6dbd5-468d-4d5e-9776-cc63fba47034 None admin] RBAC: Authorizing `identity:create_grant(project_id=f53fb3d6b68b4654ae7247c9b74015e7, user_id=2136cf1160a64951ad780424cb28403b, role_id=9f750e14956d482c8757564559516c7a)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:06.740442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:06.740690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6dbd5-468d-4d5e-9776-cc63fba47034 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:06.755219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 305/603] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:13:06 2022] PUT /identity/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/2136cf1160a64951ad780424cb28403b/roles/9f750e14956d482c8757564559516c7a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:13:06.756360 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6dbd5-468d-4d5e-9776-cc63fba47034 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:06.776799 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6f782-70ab-4899-8867-3ffa3e423283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:06.777428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6f782-70ab-4899-8867-3ffa3e423283 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:06.777699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6f782-70ab-4899-8867-3ffa3e423283 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:06.777960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6f782-70ab-4899-8867-3ffa3e423283 None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:06.778661 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6f782-70ab-4899-8867-3ffa3e423283 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:06.778993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6f782-70ab-4899-8867-3ffa3e423283 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:06.780539 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6f782-70ab-4899-8867-3ffa3e423283 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:06.801604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 299/604] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:06.801604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6f782-70ab-4899-8867-3ffa3e423283 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:06.936937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6f782-70ab-4899-8867-3ffa3e423283 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:06.952156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6dbd5-468d-4d5e-9776-cc63fba47034 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:06.985563 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19048e8c-6ae7-40f7-845c-e31f7e7b50ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:06.986993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19048e8c-6ae7-40f7-845c-e31f7e7b50ee None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:06.987645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19048e8c-6ae7-40f7-845c-e31f7e7b50ee None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:06.988159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19048e8c-6ae7-40f7-845c-e31f7e7b50ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:06.992383 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad0648-b9ae-47e9-b957-80185318caa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:06.993072 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad0648-b9ae-47e9-b957-80185318caa0 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:06.993406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad0648-b9ae-47e9-b957-80185318caa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:06.993805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad0648-b9ae-47e9-b957-80185318caa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:06.994730 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad0648-b9ae-47e9-b957-80185318caa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:06.995115 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad0648-b9ae-47e9-b957-80185318caa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:06.996981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad0648-b9ae-47e9-b957-80185318caa0 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:07.002474 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19048e8c-6ae7-40f7-845c-e31f7e7b50ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:07.005096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19048e8c-6ae7-40f7-845c-e31f7e7b50ee None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:07.009757 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 306/605] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:13:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:07.014837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad0648-b9ae-47e9-b957-80185318caa0 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-19048e8c-6ae7-40f7-845c-e31f7e7b50ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:07.029925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:07.031187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:07.032123 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:07.032123 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:07.032123 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:07.033190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:07.036113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 300/606] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:07.038917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19048e8c-6ae7-40f7-845c-e31f7e7b50ee None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:07.103665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:07.149706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad0648-b9ae-47e9-b957-80185318caa0 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:07.173672 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19048e8c-6ae7-40f7-845c-e31f7e7b50ee None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:07.216704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385ae0-00f2-4a19-adfb-1f764bf8bf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:07.217618 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385ae0-00f2-4a19-adfb-1f764bf8bf45 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:07.218111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385ae0-00f2-4a19-adfb-1f764bf8bf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:07.218541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385ae0-00f2-4a19-adfb-1f764bf8bf45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:07.219034 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd6f9c-8ef7-422f-97b2-91a9207a3725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:07.220312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd6f9c-8ef7-422f-97b2-91a9207a3725 None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:07.220907 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd6f9c-8ef7-422f-97b2-91a9207a3725 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:07.221796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd6f9c-8ef7-422f-97b2-91a9207a3725 None admin] PATH_INFO: `/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/a8bcbc6393d341a7be009f3b8c329e21/roles/9f750e14956d482c8757564559516c7a` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:07.232984 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385ae0-00f2-4a19-adfb-1f764bf8bf45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:07.235393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385ae0-00f2-4a19-adfb-1f764bf8bf45 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:07.243114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd6f9c-8ef7-422f-97b2-91a9207a3725 None admin] RBAC: Authorizing `identity:create_grant(project_id=f53fb3d6b68b4654ae7247c9b74015e7, user_id=a8bcbc6393d341a7be009f3b8c329e21, role_id=9f750e14956d482c8757564559516c7a)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:07.244750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd6f9c-8ef7-422f-97b2-91a9207a3725 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-2e385ae0-00f2-4a19-adfb-1f764bf8bf45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:07.255920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:07.257006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:07.257948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:07.257948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:07.257948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:07.264838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 301/607] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:07.264838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385ae0-00f2-4a19-adfb-1f764bf8bf45 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:07.271639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 307/608] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:13:07 2022] PUT /identity/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/a8bcbc6393d341a7be009f3b8c329e21/roles/9f750e14956d482c8757564559516c7a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:13:07.272923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd6f9c-8ef7-422f-97b2-91a9207a3725 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:07.345348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:07.358004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:07.384345 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385ae0-00f2-4a19-adfb-1f764bf8bf45 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:07.406669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd6f9c-8ef7-422f-97b2-91a9207a3725 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:07.433864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e8a65-cfba-4d63-8e89-9b2d2aa01ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:07.434496 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e8a65-cfba-4d63-8e89-9b2d2aa01ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:07.434836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e8a65-cfba-4d63-8e89-9b2d2aa01ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:07.435106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e8a65-cfba-4d63-8e89-9b2d2aa01ec6 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:07.435791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e8a65-cfba-4d63-8e89-9b2d2aa01ec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:07.436062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e8a65-cfba-4d63-8e89-9b2d2aa01ec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:07.437487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e8a65-cfba-4d63-8e89-9b2d2aa01ec6 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:07.477548 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 302/609] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:07.490788 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e8a65-cfba-4d63-8e89-9b2d2aa01ec6 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:07.494632 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c145dc3-9a1e-4f1a-893d-44f644aaf234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:07.495330 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c145dc3-9a1e-4f1a-893d-44f644aaf234 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:07.495962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c145dc3-9a1e-4f1a-893d-44f644aaf234 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:07.496231 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c145dc3-9a1e-4f1a-893d-44f644aaf234 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:07.496894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c145dc3-9a1e-4f1a-893d-44f644aaf234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:07.497197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c145dc3-9a1e-4f1a-893d-44f644aaf234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:07.498641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c145dc3-9a1e-4f1a-893d-44f644aaf234 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:07.513675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 308/610] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:07.520351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c145dc3-9a1e-4f1a-893d-44f644aaf234 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:07.613798 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e8a65-cfba-4d63-8e89-9b2d2aa01ec6 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:07.631652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c145dc3-9a1e-4f1a-893d-44f644aaf234 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:07.651660 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e078c7-d29f-4bfa-a521-cb80bbff6dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:07.653005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e078c7-d29f-4bfa-a521-cb80bbff6dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:07.653521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e078c7-d29f-4bfa-a521-cb80bbff6dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:07.654037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e078c7-d29f-4bfa-a521-cb80bbff6dc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:07.654305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:07.658497 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:07.664239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e078c7-d29f-4bfa-a521-cb80bbff6dc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:07.666405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e078c7-d29f-4bfa-a521-cb80bbff6dc5 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:07.673676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ede15c-b2ec-4133-bc7a-8a700de26aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:07.674454 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ede15c-b2ec-4133-bc7a-8a700de26aee None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:07.674631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ede15c-b2ec-4133-bc7a-8a700de26aee None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:07.674978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ede15c-b2ec-4133-bc7a-8a700de26aee None admin] PATH_INFO: `/v3/users/swift` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-92e078c7-d29f-4bfa-a521-cb80bbff6dc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:07.681206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:07.682164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:07.683088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:07.683088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:07.683088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:07.683088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:07.683088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:07.683088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:07.683088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:07.683088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:07.684614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ede15c-b2ec-4133-bc7a-8a700de26aee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:07.685822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 303/611] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:07.690670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ede15c-b2ec-4133-bc7a-8a700de26aee None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:07.692083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e078c7-d29f-4bfa-a521-cb80bbff6dc5 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-d9ede15c-b2ec-4133-bc7a-8a700de26aee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:07.704227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:07.705641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:07.707077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:07.707077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:07.707077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:07.707077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:07.707077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:07.707077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:07.707077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:07.707077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:07.707077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:13:07.707077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:07.707077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 309/612] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:13:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:07.714437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ede15c-b2ec-4133-bc7a-8a700de26aee None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:07.838742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e078c7-d29f-4bfa-a521-cb80bbff6dc5 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:07.891520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244fca0-09aa-42f2-ab9b-dbfb92a40cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:07.892330 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244fca0-09aa-42f2-ab9b-dbfb92a40cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:07.893114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244fca0-09aa-42f2-ab9b-dbfb92a40cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:07.893502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244fca0-09aa-42f2-ab9b-dbfb92a40cd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:07.894613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244fca0-09aa-42f2-ab9b-dbfb92a40cd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:07.895028 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244fca0-09aa-42f2-ab9b-dbfb92a40cd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:07.897330 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244fca0-09aa-42f2-ab9b-dbfb92a40cd9 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:07.902539 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ede15c-b2ec-4133-bc7a-8a700de26aee None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:07.918349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 304/613] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:07.918349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96dd6-8ba5-433a-b0ed-b58ce841bbaa None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:07.918349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96dd6-8ba5-433a-b0ed-b58ce841bbaa None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:07.918349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96dd6-8ba5-433a-b0ed-b58ce841bbaa None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:07.921641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 305/614] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:07.922593 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f96dd6-8ba5-433a-b0ed-b58ce841bbaa None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:07.947040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7029e-0cc3-4ad1-97f4-747fa0253220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:07.948011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7029e-0cc3-4ad1-97f4-747fa0253220 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:07.948488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7029e-0cc3-4ad1-97f4-747fa0253220 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:07.948937 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7029e-0cc3-4ad1-97f4-747fa0253220 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:07.949925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7029e-0cc3-4ad1-97f4-747fa0253220 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:07.950453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7029e-0cc3-4ad1-97f4-747fa0253220 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:07.952213 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7029e-0cc3-4ad1-97f4-747fa0253220 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:07.972031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 310/615] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Aug 9 11:13:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:07.973774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b26f2a-fb35-4a66-9cee-1e573533975b None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:07.974268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b26f2a-fb35-4a66-9cee-1e573533975b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:07.974720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b26f2a-fb35-4a66-9cee-1e573533975b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:07.994394 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-d8b26f2a-fb35-4a66-9cee-1e573533975b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:07.996025 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:07.996589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d8b26f2a-fb35-4a66-9cee-1e573533975b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:08.051795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:08.055373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f96dd6-8ba5-433a-b0ed-b58ce841bbaa None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:08.076225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 311/616] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:08.077492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b26f2a-fb35-4a66-9cee-1e573533975b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:08.116753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59da7c0-ed32-413e-a71d-ae328c1ed460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:08.117362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59da7c0-ed32-413e-a71d-ae328c1ed460 None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:08.117633 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59da7c0-ed32-413e-a71d-ae328c1ed460 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:08.117950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59da7c0-ed32-413e-a71d-ae328c1ed460 None admin] PATH_INFO: `/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/54cdc076295642bf945fe63a972b8aa4/roles/9f750e14956d482c8757564559516c7a` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:08.136170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59da7c0-ed32-413e-a71d-ae328c1ed460 None admin] RBAC: Authorizing `identity:create_grant(project_id=f53fb3d6b68b4654ae7247c9b74015e7, user_id=54cdc076295642bf945fe63a972b8aa4, role_id=9f750e14956d482c8757564559516c7a)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:08.137674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59da7c0-ed32-413e-a71d-ae328c1ed460 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:08.153249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 306/617] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:13:07 2022] PUT /identity/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/54cdc076295642bf945fe63a972b8aa4/roles/9f750e14956d482c8757564559516c7a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:13:08.159169 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59da7c0-ed32-413e-a71d-ae328c1ed460 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:08.225403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b26f2a-fb35-4a66-9cee-1e573533975b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:08.264347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490978b-4721-460b-bb83-b09c1651c81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:08.265438 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490978b-4721-460b-bb83-b09c1651c81f None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:08.265996 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490978b-4721-460b-bb83-b09c1651c81f None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:08.266539 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490978b-4721-460b-bb83-b09c1651c81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:08.278580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490978b-4721-460b-bb83-b09c1651c81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:08.280429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490978b-4721-460b-bb83-b09c1651c81f None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-6490978b-4721-460b-bb83-b09c1651c81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:08.297544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:08.298567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:08.299504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:08.299504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:08.299504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:08.301736 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 312/618] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:08.310354 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490978b-4721-460b-bb83-b09c1651c81f None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:08.343482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:08.351577 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59da7c0-ed32-413e-a71d-ae328c1ed460 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:08.372412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:08.436977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360010d5-e92c-4883-9ae4-d462889c452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:08.437635 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360010d5-e92c-4883-9ae4-d462889c452e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:08.437977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360010d5-e92c-4883-9ae4-d462889c452e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:08.438253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360010d5-e92c-4883-9ae4-d462889c452e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:08.438664 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490978b-4721-460b-bb83-b09c1651c81f None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:08.457160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360010d5-e92c-4883-9ae4-d462889c452e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-360010d5-e92c-4883-9ae4-d462889c452e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:08.461874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:08.462849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:08.465073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:08.465073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:08.465073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:08.465073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:08.465073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:08.465073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:08.465073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:08.465073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:08.465073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:08.465073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:08.465073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:08.465073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:08.465073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 307/619] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:08.469359 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360010d5-e92c-4883-9ae4-d462889c452e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:08.496984 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10e924-db95-4c5a-a181-e10b91747ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:08.497978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10e924-db95-4c5a-a181-e10b91747ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:08.498471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10e924-db95-4c5a-a181-e10b91747ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:08.498977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10e924-db95-4c5a-a181-e10b91747ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:08.499841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10e924-db95-4c5a-a181-e10b91747ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:08.500379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10e924-db95-4c5a-a181-e10b91747ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:08.502013 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10e924-db95-4c5a-a181-e10b91747ec8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:08.521113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 313/620] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:08.527232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10e924-db95-4c5a-a181-e10b91747ec8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:08.661903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:08.667686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360010d5-e92c-4883-9ae4-d462889c452e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:08.697380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10e924-db95-4c5a-a181-e10b91747ec8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:08.713478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeb59d-5d8e-470a-adbe-7f32727d8c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:08.714445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeb59d-5d8e-470a-adbe-7f32727d8c5e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:08.714975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeb59d-5d8e-470a-adbe-7f32727d8c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:08.715611 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeb59d-5d8e-470a-adbe-7f32727d8c5e None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:08.716536 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aeb59d-5d8e-470a-adbe-7f32727d8c5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:08.717063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aeb59d-5d8e-470a-adbe-7f32727d8c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:08.722847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aeb59d-5d8e-470a-adbe-7f32727d8c5e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:08.736826 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2edcd8-f4fd-42eb-865d-f0fd3d029dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:08.737667 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2edcd8-f4fd-42eb-865d-f0fd3d029dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:08.737946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2edcd8-f4fd-42eb-865d-f0fd3d029dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:08.738208 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2edcd8-f4fd-42eb-865d-f0fd3d029dc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:08.740530 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 308/621] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:13:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:08.745983 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2edcd8-f4fd-42eb-865d-f0fd3d029dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:08.746337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeb59d-5d8e-470a-adbe-7f32727d8c5e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:08.747601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2edcd8-f4fd-42eb-865d-f0fd3d029dc8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-5c2edcd8-f4fd-42eb-865d-f0fd3d029dc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:08.762850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:08.764198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:08.765118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:08.765118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:08.765118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:08.765118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:08.765118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:08.765118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:08.765118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:08.765118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:08.765118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 314/622] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:08.768549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2edcd8-f4fd-42eb-865d-f0fd3d029dc8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:08.820377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:08.918649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeb59d-5d8e-470a-adbe-7f32727d8c5e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:08.939064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2edcd8-f4fd-42eb-865d-f0fd3d029dc8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:08.954565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a595ce3-e356-489b-a4b2-4f8062a23ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:08.955335 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a595ce3-e356-489b-a4b2-4f8062a23ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:08.955613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a595ce3-e356-489b-a4b2-4f8062a23ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:08.955882 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a595ce3-e356-489b-a4b2-4f8062a23ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:08.967520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a595ce3-e356-489b-a4b2-4f8062a23ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:08.969137 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a595ce3-e356-489b-a4b2-4f8062a23ee2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:08.976447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a4db2-47d1-4735-8f8f-d9f0e2f9470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:08.977066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a4db2-47d1-4735-8f8f-d9f0e2f9470a None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:08.977339 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a4db2-47d1-4735-8f8f-d9f0e2f9470a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:08.977605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a4db2-47d1-4735-8f8f-d9f0e2f9470a None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:08.978294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a4db2-47d1-4735-8f8f-d9f0e2f9470a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:08.978591 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a4db2-47d1-4735-8f8f-d9f0e2f9470a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:08.980063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a4db2-47d1-4735-8f8f-d9f0e2f9470a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:08.989743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-5a595ce3-e356-489b-a4b2-4f8062a23ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:08.992165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:08.994555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:08.997043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:08.997043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:08.997043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:08.997043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 309/623] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:09.002316 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a595ce3-e356-489b-a4b2-4f8062a23ee2 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:09.002542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 315/624] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:09.010185 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a4db2-47d1-4735-8f8f-d9f0e2f9470a None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:09.091858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:09.125903 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a595ce3-e356-489b-a4b2-4f8062a23ee2 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:09.153603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a4db2-47d1-4735-8f8f-d9f0e2f9470a None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:09.175085 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ceb8e6-884b-4b08-8c73-1b54bf3865f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:09.176063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceb8e6-884b-4b08-8c73-1b54bf3865f8 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:09.176555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceb8e6-884b-4b08-8c73-1b54bf3865f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:09.177015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceb8e6-884b-4b08-8c73-1b54bf3865f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:09.177878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ceb8e6-884b-4b08-8c73-1b54bf3865f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:09.178391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ceb8e6-884b-4b08-8c73-1b54bf3865f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:09.180138 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ceb8e6-884b-4b08-8c73-1b54bf3865f8 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:09.193873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e709d-e354-4536-ac32-3c27f0d05b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:09.194533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e709d-e354-4536-ac32-3c27f0d05b5b None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:09.194842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e709d-e354-4536-ac32-3c27f0d05b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:09.195146 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e709d-e354-4536-ac32-3c27f0d05b5b None admin] PATH_INFO: `/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/913447120a2e42d8affdf50bb74dc5aa/roles/9f750e14956d482c8757564559516c7a` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:09.195567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 310/625] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:09.197138 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089d1e4-7d73-46bd-bbe6-9adf04a37b21 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:09.197647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089d1e4-7d73-46bd-bbe6-9adf04a37b21 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:09.198144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089d1e4-7d73-46bd-bbe6-9adf04a37b21 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:09.199896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 311/626] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:09.204059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089d1e4-7d73-46bd-bbe6-9adf04a37b21 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:09.220399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e709d-e354-4536-ac32-3c27f0d05b5b None admin] RBAC: Authorizing `identity:create_grant(project_id=f53fb3d6b68b4654ae7247c9b74015e7, user_id=913447120a2e42d8affdf50bb74dc5aa, role_id=9f750e14956d482c8757564559516c7a)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:09.222278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e709d-e354-4536-ac32-3c27f0d05b5b None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:09.238296 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 316/627] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:13:09 2022] PUT /identity/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/913447120a2e42d8affdf50bb74dc5aa/roles/9f750e14956d482c8757564559516c7a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:13:09.240149 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61d8e1-084c-41fb-8b0a-c2383db41460 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:09.240786 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61d8e1-084c-41fb-8b0a-c2383db41460 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:09.241396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61d8e1-084c-41fb-8b0a-c2383db41460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:09.262288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-1c61d8e1-084c-41fb-8b0a-c2383db41460 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:09.264062 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1c61d8e1-084c-41fb-8b0a-c2383db41460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:09.317516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:09.343653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 317/628] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:09.362663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089d1e4-7d73-46bd-bbe6-9adf04a37b21 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:09.367781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61d8e1-084c-41fb-8b0a-c2383db41460 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:09.431436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893e957-d1c8-4456-bcb2-d40c6429dcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:09.432397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e957-d1c8-4456-bcb2-d40c6429dcaf None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:09.432843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e957-d1c8-4456-bcb2-d40c6429dcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:09.433275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e957-d1c8-4456-bcb2-d40c6429dcaf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:09.452725 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893e957-d1c8-4456-bcb2-d40c6429dcaf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:09.454569 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893e957-d1c8-4456-bcb2-d40c6429dcaf None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:09.457868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-c893e957-d1c8-4456-bcb2-d40c6429dcaf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:09.469126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:09.470249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:09.471237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:09.471237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:09.471237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:09.471237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:09.471237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:09.471237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:09.471237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:09.471237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:09.471237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 11:13:09.471237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:09.474766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 312/629] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:13:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:09.480919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893e957-d1c8-4456-bcb2-d40c6429dcaf None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:09.492179 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61d8e1-084c-41fb-8b0a-c2383db41460 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:09.553305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6674b2-97ce-4008-ac71-eac5005e0222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:09.554005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6674b2-97ce-4008-ac71-eac5005e0222 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:09.554279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6674b2-97ce-4008-ac71-eac5005e0222 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:09.554553 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6674b2-97ce-4008-ac71-eac5005e0222 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:09.575418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6674b2-97ce-4008-ac71-eac5005e0222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-eb6674b2-97ce-4008-ac71-eac5005e0222 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:09.580221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:09.581245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:09.582093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:09.582093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:09.582093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:09.582093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:09.582093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:09.582093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:09.582093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:09.582093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:09.582093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:09.582093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:09.582093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:09.582093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:09.586672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 318/630] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:09.587632 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6674b2-97ce-4008-ac71-eac5005e0222 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:09.616869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893e957-d1c8-4456-bcb2-d40c6429dcaf None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:09.642041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:09.718998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6674b2-97ce-4008-ac71-eac5005e0222 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:09.729822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd5b65-a92d-4759-8b57-5245a3c53998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:09.730526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd5b65-a92d-4759-8b57-5245a3c53998 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:09.730712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd5b65-a92d-4759-8b57-5245a3c53998 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:09.731002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd5b65-a92d-4759-8b57-5245a3c53998 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:09.731746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd5b65-a92d-4759-8b57-5245a3c53998 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:09.732046 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd5b65-a92d-4759-8b57-5245a3c53998 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:09.733487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd5b65-a92d-4759-8b57-5245a3c53998 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:09.777618 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 313/631] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Aug 9 11:13:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:09.783141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd5b65-a92d-4759-8b57-5245a3c53998 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:09.788774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd76db-6d67-4a73-8dda-76c571670d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:09.789407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd76db-6d67-4a73-8dda-76c571670d40 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:09.789677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd76db-6d67-4a73-8dda-76c571670d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:09.789944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd76db-6d67-4a73-8dda-76c571670d40 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:09.790617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd76db-6d67-4a73-8dda-76c571670d40 None admin] RBAC: Adding query filter params (name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:09.790939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd76db-6d67-4a73-8dda-76c571670d40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:09.793013 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd76db-6d67-4a73-8dda-76c571670d40 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:09.803113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 319/632] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:13:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:09.810743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd76db-6d67-4a73-8dda-76c571670d40 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:09.907219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:09.977801 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd5b65-a92d-4759-8b57-5245a3c53998 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:10.009259 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd76db-6d67-4a73-8dda-76c571670d40 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:10.015975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:10.016179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb3499-2c2e-45ad-abd2-5891269a7691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:10.016901 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb3499-2c2e-45ad-abd2-5891269a7691 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:10.017171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb3499-2c2e-45ad-abd2-5891269a7691 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:10.017436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb3499-2c2e-45ad-abd2-5891269a7691 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:10.089632 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e552d-a993-4ce8-ba5e-c6246d06d431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:10.090911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e552d-a993-4ce8-ba5e-c6246d06d431 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:10.091825 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e552d-a993-4ce8-ba5e-c6246d06d431 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:10.092369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e552d-a993-4ce8-ba5e-c6246d06d431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:10.099122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb3499-2c2e-45ad-abd2-5891269a7691 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:10.100723 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb3499-2c2e-45ad-abd2-5891269a7691 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:10.118565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e552d-a993-4ce8-ba5e-c6246d06d431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:10.120082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e552d-a993-4ce8-ba5e-c6246d06d431 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-e97e552d-a993-4ce8-ba5e-c6246d06d431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:10.141543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:10.142614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:10.143523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:10.143523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:10.143523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:10.150449 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 320/633] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:10.151942 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c80683-7cce-4e87-991d-cb67b69b059a None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:10.152228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c80683-7cce-4e87-991d-cb67b69b059a None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:10.152496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c80683-7cce-4e87-991d-cb67b69b059a None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:10.158118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 321/634] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:10.158118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c80683-7cce-4e87-991d-cb67b69b059a None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:10.185873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:10.234848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 314/635] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:13:10.236460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5c852-8a7f-4c46-ae6e-4c230e5e92c0 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:10.236939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5c852-8a7f-4c46-ae6e-4c230e5e92c0 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:10.237548 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5c852-8a7f-4c46-ae6e-4c230e5e92c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:10.258364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-aff5c852-8a7f-4c46-ae6e-4c230e5e92c0 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:10.260214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-aff5c852-8a7f-4c46-ae6e-4c230e5e92c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:10.278002 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c80683-7cce-4e87-991d-cb67b69b059a None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:10.313501 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e68fb-453c-4270-ac12-6ba8ac1a540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:10.314111 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e68fb-453c-4270-ac12-6ba8ac1a540e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:10.314380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e68fb-453c-4270-ac12-6ba8ac1a540e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:10.314644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e68fb-453c-4270-ac12-6ba8ac1a540e None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:10.315331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e68fb-453c-4270-ac12-6ba8ac1a540e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:10.315705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e68fb-453c-4270-ac12-6ba8ac1a540e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:10.317080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e68fb-453c-4270-ac12-6ba8ac1a540e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:10.334205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 322/636] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:10.335052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e68fb-453c-4270-ac12-6ba8ac1a540e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:10.341051 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 315/637] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:10.342276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5c852-8a7f-4c46-ae6e-4c230e5e92c0 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:10.363926 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:10.451696 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:10.463581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e68fb-453c-4270-ac12-6ba8ac1a540e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:10.469300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5c852-8a7f-4c46-ae6e-4c230e5e92c0 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:10.503734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de864e7-e995-4e6c-97bc-cb51193be49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:10.504284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de864e7-e995-4e6c-97bc-cb51193be49f None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:10.504558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de864e7-e995-4e6c-97bc-cb51193be49f None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:10.504819 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de864e7-e995-4e6c-97bc-cb51193be49f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:10.515630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8700b63-a6ec-465c-ac5f-104ea6753f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:10.516782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de864e7-e995-4e6c-97bc-cb51193be49f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:10.517045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8700b63-a6ec-465c-ac5f-104ea6753f2c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:10.517534 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8700b63-a6ec-465c-ac5f-104ea6753f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:10.518057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8700b63-a6ec-465c-ac5f-104ea6753f2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:10.518352 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de864e7-e995-4e6c-97bc-cb51193be49f None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:10.527953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8700b63-a6ec-465c-ac5f-104ea6753f2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:10.530081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8700b63-a6ec-465c-ac5f-104ea6753f2c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-1de864e7-e995-4e6c-97bc-cb51193be49f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:10.535858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:10.536925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:10.537830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:10.537830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:10.537830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:10.537830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 323/638] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:10.537830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de864e7-e995-4e6c-97bc-cb51193be49f None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-c8700b63-a6ec-465c-ac5f-104ea6753f2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:10.548457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:10.549518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:10.550521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:10.550521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:10.550521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:10.550521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:10.550521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:10.550521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:10.550521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:10.550521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:10.550521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:13:10.550521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:10.553565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 316/639] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Aug 9 11:13:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:10.554860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8700b63-a6ec-465c-ac5f-104ea6753f2c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:10.615120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:10.652992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de864e7-e995-4e6c-97bc-cb51193be49f None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:10.670202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8700b63-a6ec-465c-ac5f-104ea6753f2c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:10.688803 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caee78-d45d-414c-a8da-ac70268ef580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:10.689445 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caee78-d45d-414c-a8da-ac70268ef580 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:10.689712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caee78-d45d-414c-a8da-ac70268ef580 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:10.689974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caee78-d45d-414c-a8da-ac70268ef580 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:10.700341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caee78-d45d-414c-a8da-ac70268ef580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-85caee78-d45d-414c-a8da-ac70268ef580 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:10.705497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:10.707084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:10.708551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:10.708551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:10.708551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:10.708551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:10.708551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:10.708551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:10.708551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:10.708551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:10.708551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:10.708551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:10.708551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:10.708551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:10.708551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 324/640] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:10.708551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caee78-d45d-414c-a8da-ac70268ef580 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:10.713145 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e1c39-d25d-4230-87fd-4812446643ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:10.714082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e1c39-d25d-4230-87fd-4812446643ae None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:10.714423 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e1c39-d25d-4230-87fd-4812446643ae None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:10.714772 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e1c39-d25d-4230-87fd-4812446643ae None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:10.715524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e1c39-d25d-4230-87fd-4812446643ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:10.716178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e1c39-d25d-4230-87fd-4812446643ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:10.720125 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e1c39-d25d-4230-87fd-4812446643ae None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:10.730646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 317/641] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:10.732011 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c77e1-56b1-4365-8726-7b19d734361c None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:10.732292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c77e1-56b1-4365-8726-7b19d734361c None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:10.732563 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c77e1-56b1-4365-8726-7b19d734361c None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:10.733875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 318/642] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:10.734489 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c77e1-56b1-4365-8726-7b19d734361c None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:10.747300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:10.832943 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caee78-d45d-414c-a8da-ac70268ef580 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:10.842992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c77e1-56b1-4365-8726-7b19d734361c None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:10.862464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:10.874357 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5dcc9-7ded-4e59-8e87-2b4c1a5802b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:10.875005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5dcc9-7ded-4e59-8e87-2b4c1a5802b9 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:10.875272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5dcc9-7ded-4e59-8e87-2b4c1a5802b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:10.875532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5dcc9-7ded-4e59-8e87-2b4c1a5802b9 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:10.876306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5dcc9-7ded-4e59-8e87-2b4c1a5802b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:10.876602 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5dcc9-7ded-4e59-8e87-2b4c1a5802b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:10.878079 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5dcc9-7ded-4e59-8e87-2b4c1a5802b9 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:10.880550 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ff842-45dc-4354-b8e3-401de10f9e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:10.882122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ff842-45dc-4354-b8e3-401de10f9e72 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:10.882536 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ff842-45dc-4354-b8e3-401de10f9e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:10.883035 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ff842-45dc-4354-b8e3-401de10f9e72 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:10.883857 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ff842-45dc-4354-b8e3-401de10f9e72 None admin] RBAC: Adding query filter params (name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:10.884288 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ff842-45dc-4354-b8e3-401de10f9e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:10.886068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ff842-45dc-4354-b8e3-401de10f9e72 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:10.895875 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 325/643] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Aug 9 11:13:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:10.896712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5dcc9-7ded-4e59-8e87-2b4c1a5802b9 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:10.897476 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 319/644] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:13:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:10.898928 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e5b3b-1276-4953-bee5-6c6621061aba None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:10.899329 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e5b3b-1276-4953-bee5-6c6621061aba None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:10.899715 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e5b3b-1276-4953-bee5-6c6621061aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:10.921357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-0d7e5b3b-1276-4953-bee5-6c6621061aba None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:10.923293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-0d7e5b3b-1276-4953-bee5-6c6621061aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:11.003022 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:11.004294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5dcc9-7ded-4e59-8e87-2b4c1a5802b9 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:11.009402 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 320/645] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:11.010459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e5b3b-1276-4953-bee5-6c6621061aba None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:11.052816 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbe6a4-321b-4692-a667-eb1cfd0dba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:11.053452 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbe6a4-321b-4692-a667-eb1cfd0dba9d None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:11.053727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbe6a4-321b-4692-a667-eb1cfd0dba9d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:11.053994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbe6a4-321b-4692-a667-eb1cfd0dba9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:11.061296 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbe6a4-321b-4692-a667-eb1cfd0dba9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:11.062784 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbe6a4-321b-4692-a667-eb1cfd0dba9d None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-a5bbe6a4-321b-4692-a667-eb1cfd0dba9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:11.074653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:11.075725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:11.076994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:11.076994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:11.076994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:11.076994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:11.076994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:11.076994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:11.076994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:11.076994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:11.080546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 326/646] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:11.081347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbe6a4-321b-4692-a667-eb1cfd0dba9d None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:11.123584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e5b3b-1276-4953-bee5-6c6621061aba None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:11.128995 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:11.162218 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a72068-c861-4ea2-aef4-fdf019be1a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:11.162844 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a72068-c861-4ea2-aef4-fdf019be1a73 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:11.163114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a72068-c861-4ea2-aef4-fdf019be1a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:11.163378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a72068-c861-4ea2-aef4-fdf019be1a73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:11.192195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbe6a4-321b-4692-a667-eb1cfd0dba9d None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:11.231484 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc88c27-8f5e-4f8d-91f7-2e14688d76ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:11.232133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc88c27-8f5e-4f8d-91f7-2e14688d76ac None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:11.232407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc88c27-8f5e-4f8d-91f7-2e14688d76ac None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:11.232673 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc88c27-8f5e-4f8d-91f7-2e14688d76ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:11.236458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:11.239619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a72068-c861-4ea2-aef4-fdf019be1a73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:11.242718 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a72068-c861-4ea2-aef4-fdf019be1a73 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:11.244044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc88c27-8f5e-4f8d-91f7-2e14688d76ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:11.245897 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc88c27-8f5e-4f8d-91f7-2e14688d76ac None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-ebc88c27-8f5e-4f8d-91f7-2e14688d76ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:11.262027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:11.263077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:11.264010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:11.264010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:11.264010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:11.264010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 327/647] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:11.264010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc88c27-8f5e-4f8d-91f7-2e14688d76ac None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:11.353972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 321/648] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:13:11.354846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a72068-c861-4ea2-aef4-fdf019be1a73 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:11.365580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:11.373911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc88c27-8f5e-4f8d-91f7-2e14688d76ac None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:11.413560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57826d96-3aa4-4cf1-98f6-9d885a275276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:11.414592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57826d96-3aa4-4cf1-98f6-9d885a275276 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:11.415080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57826d96-3aa4-4cf1-98f6-9d885a275276 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:11.415490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57826d96-3aa4-4cf1-98f6-9d885a275276 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:11.431038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57826d96-3aa4-4cf1-98f6-9d885a275276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-57826d96-3aa4-4cf1-98f6-9d885a275276 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:11.437982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:11.445076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:11.446487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:11.446487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:11.446487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:11.446487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:11.446487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:11.446487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:11.446487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:11.446487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:11.446487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:11.446487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:11.446487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:11.446487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:11.446487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 328/649] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:11.446487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57826d96-3aa4-4cf1-98f6-9d885a275276 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:11.570222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57826d96-3aa4-4cf1-98f6-9d885a275276 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:11.581327 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:11.584668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a72068-c861-4ea2-aef4-fdf019be1a73 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:11.607271 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fbf63-70d4-40e9-a6e4-1ebdc4824285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:11.607903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fbf63-70d4-40e9-a6e4-1ebdc4824285 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:11.608161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fbf63-70d4-40e9-a6e4-1ebdc4824285 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:11.608435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fbf63-70d4-40e9-a6e4-1ebdc4824285 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:11.609077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fbf63-70d4-40e9-a6e4-1ebdc4824285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:11.609374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fbf63-70d4-40e9-a6e4-1ebdc4824285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:11.610775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fbf63-70d4-40e9-a6e4-1ebdc4824285 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:11.619057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc68c5-6344-4206-95c8-61e20fd4c39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:11.619665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc68c5-6344-4206-95c8-61e20fd4c39b None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:11.619947 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc68c5-6344-4206-95c8-61e20fd4c39b None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:11.620217 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc68c5-6344-4206-95c8-61e20fd4c39b None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:11.621277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc68c5-6344-4206-95c8-61e20fd4c39b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:11.621571 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc68c5-6344-4206-95c8-61e20fd4c39b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:11.623079 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 329/650] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:11.623204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc68c5-6344-4206-95c8-61e20fd4c39b None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:11.623727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fbf63-70d4-40e9-a6e4-1ebdc4824285 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:11.636337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 322/651] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:11.636337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc68c5-6344-4206-95c8-61e20fd4c39b None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:11.646642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:11.735020 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fbf63-70d4-40e9-a6e4-1ebdc4824285 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:11.737968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc68c5-6344-4206-95c8-61e20fd4c39b None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:11.769210 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cceba-c00f-4230-88d9-364d81aa20df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:11.769902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cceba-c00f-4230-88d9-364d81aa20df None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:11.770177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cceba-c00f-4230-88d9-364d81aa20df None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:11.770447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cceba-c00f-4230-88d9-364d81aa20df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:11.771841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef382562-54d5-4008-8157-644c888a4c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:11.772440 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef382562-54d5-4008-8157-644c888a4c82 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:11.772707 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef382562-54d5-4008-8157-644c888a4c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:11.772983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef382562-54d5-4008-8157-644c888a4c82 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:11.773616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef382562-54d5-4008-8157-644c888a4c82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:11.773911 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef382562-54d5-4008-8157-644c888a4c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:11.775311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef382562-54d5-4008-8157-644c888a4c82 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:11.780769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cceba-c00f-4230-88d9-364d81aa20df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:11.782235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cceba-c00f-4230-88d9-364d81aa20df None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:11.787778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 323/652] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:13:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:11.787778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddec2c3-9961-4eed-a6fa-de93bbb58094 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:11.787778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddec2c3-9961-4eed-a6fa-de93bbb58094 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:11.787778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddec2c3-9961-4eed-a6fa-de93bbb58094 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:11.787778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 324/653] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:11.787778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddec2c3-9961-4eed-a6fa-de93bbb58094 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-a67cceba-c00f-4230-88d9-364d81aa20df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:11.798732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:11.800083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:11.801005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:11.801005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:11.801005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:11.801005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 330/654] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:11.801319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cceba-c00f-4230-88d9-364d81aa20df None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:11.813983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:11.867169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:11.890475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddec2c3-9961-4eed-a6fa-de93bbb58094 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:11.900601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cceba-c00f-4230-88d9-364d81aa20df None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:11.923254 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f67da-03a0-45dc-9ff4-ed20c2121563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:11.924009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f67da-03a0-45dc-9ff4-ed20c2121563 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:11.924322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f67da-03a0-45dc-9ff4-ed20c2121563 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:11.924681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f67da-03a0-45dc-9ff4-ed20c2121563 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:11.931950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f67da-03a0-45dc-9ff4-ed20c2121563 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:11.933403 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f67da-03a0-45dc-9ff4-ed20c2121563 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:11.935673 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76cab9-2523-41c9-a82d-15da3651c9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:11.936293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76cab9-2523-41c9-a82d-15da3651c9cd None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:11.936567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76cab9-2523-41c9-a82d-15da3651c9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:11.936836 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76cab9-2523-41c9-a82d-15da3651c9cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:11.937567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76cab9-2523-41c9-a82d-15da3651c9cd None admin] RBAC: Adding query filter params (role.id=9f750e14956d482c8757564559516c7a, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=a7f8976306ff477592c6c5b62af60f9a) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:11.937871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76cab9-2523-41c9-a82d-15da3651c9cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:11.939355 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76cab9-2523-41c9-a82d-15da3651c9cd None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-d37f67da-03a0-45dc-9ff4-ed20c2121563 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:11.944950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:11.945934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:11.947398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:11.947398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:11.947398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:11.947398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:11.947398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:11.947398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:11.947398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:11.947398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:11.947398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:13:11.947398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:11.947951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 331/655] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:11 2022] GET /identity/v3/role_assignments?user.id=a7f8976306ff477592c6c5b62af60f9a&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=9f750e14956d482c8757564559516c7a => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:11.947951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76cab9-2523-41c9-a82d-15da3651c9cd None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:11.948176 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 325/656] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:13:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:11.948176 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc505b69-be28-41c2-bdd4-6185a6eb8141 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:11.948176 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc505b69-be28-41c2-bdd4-6185a6eb8141 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:11.948176 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc505b69-be28-41c2-bdd4-6185a6eb8141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:11.973006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-bc505b69-be28-41c2-bdd4-6185a6eb8141 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:11.974262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-bc505b69-be28-41c2-bdd4-6185a6eb8141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:12.058660 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 326/657] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:12.060031 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc505b69-be28-41c2-bdd4-6185a6eb8141 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:12.079286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:12.087633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76cab9-2523-41c9-a82d-15da3651c9cd None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:12.127040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:12.135424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbcb73-1ac1-4af4-9200-fefb773e9985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:12.135914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbcb73-1ac1-4af4-9200-fefb773e9985 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:12.136199 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbcb73-1ac1-4af4-9200-fefb773e9985 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:12.136468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbcb73-1ac1-4af4-9200-fefb773e9985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:12.150862 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbcb73-1ac1-4af4-9200-fefb773e9985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:12.152446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbcb73-1ac1-4af4-9200-fefb773e9985 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-1abbcb73-1ac1-4af4-9200-fefb773e9985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:12.167610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:12.168627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:12.169549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:12.169549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:12.169549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:12.169549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 332/658] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:12.169844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbcb73-1ac1-4af4-9200-fefb773e9985 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:12.192671 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc505b69-be28-41c2-bdd4-6185a6eb8141 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:12.230246 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22b21d-4c66-4d36-bd7f-e264e378e158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:12.230900 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22b21d-4c66-4d36-bd7f-e264e378e158 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:12.231180 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22b21d-4c66-4d36-bd7f-e264e378e158 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:12.231450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22b21d-4c66-4d36-bd7f-e264e378e158 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:12.232100 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22b21d-4c66-4d36-bd7f-e264e378e158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:12.232406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22b21d-4c66-4d36-bd7f-e264e378e158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:12.233776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22b21d-4c66-4d36-bd7f-e264e378e158 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:12.245911 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 327/659] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:12.246781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22b21d-4c66-4d36-bd7f-e264e378e158 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:12.303630 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbcb73-1ac1-4af4-9200-fefb773e9985 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:12.321374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:12.340221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0dae2-53d2-47a9-bd15-7dc3b28a37cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:12.340844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0dae2-53d2-47a9-bd15-7dc3b28a37cb None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:12.341112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0dae2-53d2-47a9-bd15-7dc3b28a37cb None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:12.341379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0dae2-53d2-47a9-bd15-7dc3b28a37cb None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:12.342116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0dae2-53d2-47a9-bd15-7dc3b28a37cb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:12.342530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0dae2-53d2-47a9-bd15-7dc3b28a37cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:12.344113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0dae2-53d2-47a9-bd15-7dc3b28a37cb None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:12.351764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22b21d-4c66-4d36-bd7f-e264e378e158 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:12.366133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 333/660] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Aug 9 11:13:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:12.367411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0dae2-53d2-47a9-bd15-7dc3b28a37cb None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:12.395815 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac066e-c309-4c78-8dc2-780915ca9a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:12.396961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac066e-c309-4c78-8dc2-780915ca9a01 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:12.397362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac066e-c309-4c78-8dc2-780915ca9a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:12.397635 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac066e-c309-4c78-8dc2-780915ca9a01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:12.412367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:12.417632 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac066e-c309-4c78-8dc2-780915ca9a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-0aac066e-c309-4c78-8dc2-780915ca9a01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:12.424277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:12.425220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:12.431588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:12.431588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:12.431588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:12.431588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:12.431588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:12.431588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:12.431588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:12.431588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:12.431588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:12.431588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:12.431588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:12.431588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:12.431588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 328/661] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:12.431588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac066e-c309-4c78-8dc2-780915ca9a01 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:12.477563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0dae2-53d2-47a9-bd15-7dc3b28a37cb None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:12.520021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dc5d2-72ad-4a12-9c5d-b6c7dbcfbbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:12.520642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dc5d2-72ad-4a12-9c5d-b6c7dbcfbbba None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:12.520916 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dc5d2-72ad-4a12-9c5d-b6c7dbcfbbba None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:12.521181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dc5d2-72ad-4a12-9c5d-b6c7dbcfbbba None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:12.521838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dc5d2-72ad-4a12-9c5d-b6c7dbcfbbba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:12.522125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dc5d2-72ad-4a12-9c5d-b6c7dbcfbbba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:12.523615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dc5d2-72ad-4a12-9c5d-b6c7dbcfbbba None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:12.536075 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 334/662] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:12.536930 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dc5d2-72ad-4a12-9c5d-b6c7dbcfbbba None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:12.566351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac066e-c309-4c78-8dc2-780915ca9a01 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:12.597372 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:12.604714 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287860cc-3bfb-466f-844f-33a94c89baaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:12.605367 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287860cc-3bfb-466f-844f-33a94c89baaa None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:12.605644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287860cc-3bfb-466f-844f-33a94c89baaa None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:12.605915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287860cc-3bfb-466f-844f-33a94c89baaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:12.613792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287860cc-3bfb-466f-844f-33a94c89baaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:12.615315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287860cc-3bfb-466f-844f-33a94c89baaa None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-287860cc-3bfb-466f-844f-33a94c89baaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:12.627238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:12.628560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:12.629754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:12.629754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:12.629754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:12.629754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:12.629754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:12.629754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:12.629754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:12.629754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:12.629754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 329/663] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:12.629754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287860cc-3bfb-466f-844f-33a94c89baaa None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:12.665066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dc5d2-72ad-4a12-9c5d-b6c7dbcfbbba None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:12.667098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:12.707911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090f4f4-a234-45da-8922-bf1e7210ce90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:12.708766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090f4f4-a234-45da-8922-bf1e7210ce90 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:12.709044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090f4f4-a234-45da-8922-bf1e7210ce90 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:12.710212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090f4f4-a234-45da-8922-bf1e7210ce90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:12.746643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287860cc-3bfb-466f-844f-33a94c89baaa None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:12.788318 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bed92-73e0-4ab6-b617-b90f1b6795bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:12.788930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bed92-73e0-4ab6-b617-b90f1b6795bb None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:12.789207 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bed92-73e0-4ab6-b617-b90f1b6795bb None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:12.789457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bed92-73e0-4ab6-b617-b90f1b6795bb None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:12.790108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bed92-73e0-4ab6-b617-b90f1b6795bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:12.790402 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bed92-73e0-4ab6-b617-b90f1b6795bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:12.791807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bed92-73e0-4ab6-b617-b90f1b6795bb None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:12.794135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090f4f4-a234-45da-8922-bf1e7210ce90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:12.795692 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090f4f4-a234-45da-8922-bf1e7210ce90 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:12.807337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 330/664] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:13:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:12.807337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bed92-73e0-4ab6-b617-b90f1b6795bb None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:12.878462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:12.924237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 335/665] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:13:12.924808 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090f4f4-a234-45da-8922-bf1e7210ce90 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:12.927431 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:12.936810 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bed92-73e0-4ab6-b617-b90f1b6795bb None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:12.975856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356b09a-f4ac-4906-942d-2209be44b3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:12.976587 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356b09a-f4ac-4906-942d-2209be44b3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:12.976862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356b09a-f4ac-4906-942d-2209be44b3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:12.977121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356b09a-f4ac-4906-942d-2209be44b3f9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:12.985551 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356b09a-f4ac-4906-942d-2209be44b3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:12.987055 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356b09a-f4ac-4906-942d-2209be44b3f9 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-f356b09a-f4ac-4906-942d-2209be44b3f9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:13.000140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:13.001201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:13.002273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:13.002273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:13.002273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:13.002273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:13.002273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:13.002273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:13.002273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:13.002273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:13.002273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 11:13:13.002273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:13.002273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 331/666] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:13.002273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356b09a-f4ac-4906-942d-2209be44b3f9 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:13.046848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090f4f4-a234-45da-8922-bf1e7210ce90 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:13.083167 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45286-e27e-43fc-99bc-dd9e5abb1d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:13.083782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45286-e27e-43fc-99bc-dd9e5abb1d56 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:13.084049 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45286-e27e-43fc-99bc-dd9e5abb1d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:13.084309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45286-e27e-43fc-99bc-dd9e5abb1d56 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:13.085002 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf45286-e27e-43fc-99bc-dd9e5abb1d56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:13.085293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf45286-e27e-43fc-99bc-dd9e5abb1d56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:13.086739 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf45286-e27e-43fc-99bc-dd9e5abb1d56 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:13.103396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 336/667] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:13.104637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45286-e27e-43fc-99bc-dd9e5abb1d56 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:13.121327 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356b09a-f4ac-4906-942d-2209be44b3f9 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:13.139472 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:13.169375 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4e57e-ddc6-45d9-b2bc-532ad196c2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:13.170116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4e57e-ddc6-45d9-b2bc-532ad196c2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:13.170391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4e57e-ddc6-45d9-b2bc-532ad196c2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:13.170653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4e57e-ddc6-45d9-b2bc-532ad196c2c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:13.185320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4e57e-ddc6-45d9-b2bc-532ad196c2c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:13.186727 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4e57e-ddc6-45d9-b2bc-532ad196c2c9 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:13.189384 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-4dd4e57e-ddc6-45d9-b2bc-532ad196c2c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:13.204020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:13.205096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:13.206136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:13.206136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:13.206136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:13.206136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 332/668] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:13.206136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4e57e-ddc6-45d9-b2bc-532ad196c2c9 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:13.242650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45286-e27e-43fc-99bc-dd9e5abb1d56 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:13.280018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e01300-4ea1-488e-9913-110e1cf03084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:13.280718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e01300-4ea1-488e-9913-110e1cf03084 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:13.280983 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e01300-4ea1-488e-9913-110e1cf03084 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:13.281256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e01300-4ea1-488e-9913-110e1cf03084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:13.292620 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e01300-4ea1-488e-9913-110e1cf03084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:13.294091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e01300-4ea1-488e-9913-110e1cf03084 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-d1e01300-4ea1-488e-9913-110e1cf03084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:13.308676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:13.309695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:13.310618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:13.310618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:13.310618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:13.310618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 337/669] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:13.310618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e01300-4ea1-488e-9913-110e1cf03084 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:13.323953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4e57e-ddc6-45d9-b2bc-532ad196c2c9 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:13.360775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b7ec3-ba2c-468e-8d03-1aa7709d2d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:13.361563 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b7ec3-ba2c-468e-8d03-1aa7709d2d65 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:13.361820 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b7ec3-ba2c-468e-8d03-1aa7709d2d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:13.362166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b7ec3-ba2c-468e-8d03-1aa7709d2d65 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:13.363134 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b7ec3-ba2c-468e-8d03-1aa7709d2d65 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:13.363351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b7ec3-ba2c-468e-8d03-1aa7709d2d65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:13.364852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b7ec3-ba2c-468e-8d03-1aa7709d2d65 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:13.383939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 333/670] 10.222.0.59 () {56 vars in 1139 bytes} [Tue Aug 9 11:13:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:13.389320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b7ec3-ba2c-468e-8d03-1aa7709d2d65 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:13.419537 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:13.426648 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e01300-4ea1-488e-9913-110e1cf03084 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:13.441621 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:13.465807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ead7c9-ee9f-4cd0-944e-98595bac6d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:13.466659 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ead7c9-ee9f-4cd0-944e-98595bac6d5e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:13.466960 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ead7c9-ee9f-4cd0-944e-98595bac6d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:13.467225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ead7c9-ee9f-4cd0-944e-98595bac6d5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:13.468013 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ead7c9-ee9f-4cd0-944e-98595bac6d5e None admin] RBAC: Adding query filter params (role.id=9f750e14956d482c8757564559516c7a, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=2136cf1160a64951ad780424cb28403b) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:13.468315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ead7c9-ee9f-4cd0-944e-98595bac6d5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:13.469763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ead7c9-ee9f-4cd0-944e-98595bac6d5e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:13.478975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 338/671] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:13 2022] GET /identity/v3/role_assignments?user.id=2136cf1160a64951ad780424cb28403b&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=9f750e14956d482c8757564559516c7a => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:13.479760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ead7c9-ee9f-4cd0-944e-98595bac6d5e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:13.526272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b7ec3-ba2c-468e-8d03-1aa7709d2d65 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:13.566922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e683a6-6134-45f0-8575-8d66721496f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:13.567544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e683a6-6134-45f0-8575-8d66721496f0 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:13.567863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e683a6-6134-45f0-8575-8d66721496f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:13.568133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e683a6-6134-45f0-8575-8d66721496f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:13.568797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e683a6-6134-45f0-8575-8d66721496f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:13.569092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e683a6-6134-45f0-8575-8d66721496f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:13.570557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e683a6-6134-45f0-8575-8d66721496f0 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:13.585934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 334/672] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:13.587817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e683a6-6134-45f0-8575-8d66721496f0 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:13.629384 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ead7c9-ee9f-4cd0-944e-98595bac6d5e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:13.679650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7b07d-17e1-4136-a65f-238ac7325a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:13.680642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7b07d-17e1-4136-a65f-238ac7325a6e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:13.681137 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7b07d-17e1-4136-a65f-238ac7325a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:13.681602 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7b07d-17e1-4136-a65f-238ac7325a6e None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:13.682503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7b07d-17e1-4136-a65f-238ac7325a6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:13.682906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7b07d-17e1-4136-a65f-238ac7325a6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:13.684399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7b07d-17e1-4136-a65f-238ac7325a6e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:13.699913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 339/673] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:13.700713 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7b07d-17e1-4136-a65f-238ac7325a6e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:13.701220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:13.724688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e683a6-6134-45f0-8575-8d66721496f0 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:13.755357 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:13.777845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f440e-4f8c-4f56-ad0d-c17cad434fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:13.778538 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f440e-4f8c-4f56-ad0d-c17cad434fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:13.779184 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f440e-4f8c-4f56-ad0d-c17cad434fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:13.779575 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f440e-4f8c-4f56-ad0d-c17cad434fa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:13.841780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7b07d-17e1-4136-a65f-238ac7325a6e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:13.872599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f440e-4f8c-4f56-ad0d-c17cad434fa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:13.874760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f440e-4f8c-4f56-ad0d-c17cad434fa4 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:13.883621 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e197e-3104-4662-8474-dde337862470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:13.884303 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e197e-3104-4662-8474-dde337862470 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:13.884577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e197e-3104-4662-8474-dde337862470 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:13.884844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e197e-3104-4662-8474-dde337862470 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:13.892789 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e197e-3104-4662-8474-dde337862470 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:13.894338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e197e-3104-4662-8474-dde337862470 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-b03e197e-3104-4662-8474-dde337862470 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:13.906429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:13.907481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:13.908867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:13.908867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:13.908867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:13.908867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:13.908867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:13.908867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:13.908867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:13.908867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:13.908867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:13:13.908867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:13.908867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 340/674] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:13:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:13.908867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e197e-3104-4662-8474-dde337862470 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:13.980279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:14.008443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 335/675] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:13:14.009407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f440e-4f8c-4f56-ad0d-c17cad434fa4 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:14.024468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:14.031354 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e197e-3104-4662-8474-dde337862470 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:14.079787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e464acd-22f8-47bc-966c-f5b1c032f79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:14.080835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464acd-22f8-47bc-966c-f5b1c032f79c None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:14.081351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464acd-22f8-47bc-966c-f5b1c032f79c None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:14.081865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464acd-22f8-47bc-966c-f5b1c032f79c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:14.090350 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e464acd-22f8-47bc-966c-f5b1c032f79c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:14.091858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e464acd-22f8-47bc-966c-f5b1c032f79c None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-5e464acd-22f8-47bc-966c-f5b1c032f79c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:14.104227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:14.105151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:14.106044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:14.106044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:14.106044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:14.106044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:14.106044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:14.106044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:14.106044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:14.106044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:14.106044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 341/676] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:14.106756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e464acd-22f8-47bc-966c-f5b1c032f79c None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:14.125599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f440e-4f8c-4f56-ad0d-c17cad434fa4 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:14.166067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c9e4e-92f6-4cf4-90fe-a8ab684ab3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:14.166779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c9e4e-92f6-4cf4-90fe-a8ab684ab3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:14.167083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c9e4e-92f6-4cf4-90fe-a8ab684ab3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:14.167354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c9e4e-92f6-4cf4-90fe-a8ab684ab3d1 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:14.168144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c9e4e-92f6-4cf4-90fe-a8ab684ab3d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:14.168392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c9e4e-92f6-4cf4-90fe-a8ab684ab3d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:14.169878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c9e4e-92f6-4cf4-90fe-a8ab684ab3d1 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:14.194509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 336/677] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Aug 9 11:13:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:14.194509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3dd0-93fc-4670-a9f0-6dbfcaa871ca None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:14.194509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3dd0-93fc-4670-a9f0-6dbfcaa871ca None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:14.194509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3dd0-93fc-4670-a9f0-6dbfcaa871ca None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:14.194509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 337/678] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:14.194509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e3dd0-93fc-4670-a9f0-6dbfcaa871ca None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:14.235195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e464acd-22f8-47bc-966c-f5b1c032f79c None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:14.244350 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:14.283070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee131c-441a-4d7a-948d-d5cec3cfd3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:14.283716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee131c-441a-4d7a-948d-d5cec3cfd3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:14.284156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee131c-441a-4d7a-948d-d5cec3cfd3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:14.284542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee131c-441a-4d7a-948d-d5cec3cfd3d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:14.296374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee131c-441a-4d7a-948d-d5cec3cfd3d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:14.297965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee131c-441a-4d7a-948d-d5cec3cfd3d8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:14.307880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e3dd0-93fc-4670-a9f0-6dbfcaa871ca None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-9aee131c-441a-4d7a-948d-d5cec3cfd3d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:14.312948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:14.314211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:14.315457 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:14.315457 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:14.315457 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:14.316420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 342/679] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:14.317265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee131c-441a-4d7a-948d-d5cec3cfd3d8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:14.330515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:14.350519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5c9bb-aa07-40b9-a5f0-150b62785264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:14.351199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5c9bb-aa07-40b9-a5f0-150b62785264 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:14.351479 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5c9bb-aa07-40b9-a5f0-150b62785264 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:14.351752 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5c9bb-aa07-40b9-a5f0-150b62785264 None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:14.352451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5c9bb-aa07-40b9-a5f0-150b62785264 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:14.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5c9bb-aa07-40b9-a5f0-150b62785264 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:14.354200 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5c9bb-aa07-40b9-a5f0-150b62785264 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:14.366732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 338/680] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:14.368302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0eccb-a323-4baa-a09d-034567b86c6f None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:14.368583 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0eccb-a323-4baa-a09d-034567b86c6f None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:14.368856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0eccb-a323-4baa-a09d-034567b86c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:14.389411 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-e6e0eccb-a323-4baa-a09d-034567b86c6f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:14.390900 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e6e0eccb-a323-4baa-a09d-034567b86c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:14.440954 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee131c-441a-4d7a-948d-d5cec3cfd3d8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:14.465342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 339/681] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:14.466544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0eccb-a323-4baa-a09d-034567b86c6f None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:14.502727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bbf46-bed5-40eb-86d3-3fcc894ec29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:14.503691 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bbf46-bed5-40eb-86d3-3fcc894ec29a None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:14.504098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bbf46-bed5-40eb-86d3-3fcc894ec29a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:14.504919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bbf46-bed5-40eb-86d3-3fcc894ec29a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:14.510725 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:14.589924 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0eccb-a323-4baa-a09d-034567b86c6f None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:14.590451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bbf46-bed5-40eb-86d3-3fcc894ec29a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:14.592058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bbf46-bed5-40eb-86d3-3fcc894ec29a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:14.606541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:14.628111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b341cbe-089e-4ac0-9213-d72fc1970841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:14.628890 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b341cbe-089e-4ac0-9213-d72fc1970841 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:14.629256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b341cbe-089e-4ac0-9213-d72fc1970841 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:14.629648 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b341cbe-089e-4ac0-9213-d72fc1970841 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:14.630393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b341cbe-089e-4ac0-9213-d72fc1970841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:14.630797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b341cbe-089e-4ac0-9213-d72fc1970841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:14.632209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b341cbe-089e-4ac0-9213-d72fc1970841 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:14.644470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 340/682] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:14.645303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b341cbe-089e-4ac0-9213-d72fc1970841 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:14.710602 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 343/683] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:13:14.711679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bbf46-bed5-40eb-86d3-3fcc894ec29a None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:14.753325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:14.764850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b341cbe-089e-4ac0-9213-d72fc1970841 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:14.803760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fbe28-731f-4242-8d38-aca14a7446d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:14.804432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fbe28-731f-4242-8d38-aca14a7446d1 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:14.804629 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fbe28-731f-4242-8d38-aca14a7446d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:14.804892 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fbe28-731f-4242-8d38-aca14a7446d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:14.805622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fbe28-731f-4242-8d38-aca14a7446d1 None admin] RBAC: Adding query filter params (role.id=9f750e14956d482c8757564559516c7a, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=a8bcbc6393d341a7be009f3b8c329e21) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:14.805922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fbe28-731f-4242-8d38-aca14a7446d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:14.807385 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fbe28-731f-4242-8d38-aca14a7446d1 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:14.814514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 341/684] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:14 2022] GET /identity/v3/role_assignments?user.id=a8bcbc6393d341a7be009f3b8c329e21&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=9f750e14956d482c8757564559516c7a => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:14.815235 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fbe28-731f-4242-8d38-aca14a7446d1 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:14.833377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bbf46-bed5-40eb-86d3-3fcc894ec29a None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:14.852037 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:14.885518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c987ebf-69f4-4f16-846c-17959dda6cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:14.886166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c987ebf-69f4-4f16-846c-17959dda6cae None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:14.886438 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c987ebf-69f4-4f16-846c-17959dda6cae None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:14.886704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c987ebf-69f4-4f16-846c-17959dda6cae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:14.899133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c987ebf-69f4-4f16-846c-17959dda6cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:14.900657 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c987ebf-69f4-4f16-846c-17959dda6cae None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-7c987ebf-69f4-4f16-846c-17959dda6cae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:14.917523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:14.918533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:14.919456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:14.919456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:14.919456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:14.919456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 344/685] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:14.920096 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c987ebf-69f4-4f16-846c-17959dda6cae None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:14.967686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fbe28-731f-4242-8d38-aca14a7446d1 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:15.013721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6d5ac-1411-415b-aa8c-490f7e1fa393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:15.014278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6d5ac-1411-415b-aa8c-490f7e1fa393 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:15.014551 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6d5ac-1411-415b-aa8c-490f7e1fa393 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:15.014848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6d5ac-1411-415b-aa8c-490f7e1fa393 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:15.027531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6d5ac-1411-415b-aa8c-490f7e1fa393 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:15.028520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6d5ac-1411-415b-aa8c-490f7e1fa393 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-dfe6d5ac-1411-415b-aa8c-490f7e1fa393 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:15.040993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:15.042120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:15.043275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:15.043275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:15.043275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:15.043275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:15.043275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:15.043275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:15.043275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:15.043275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:15.043275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 342/686] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:15.043275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6d5ac-1411-415b-aa8c-490f7e1fa393 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:15.048375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c987ebf-69f4-4f16-846c-17959dda6cae None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:15.070647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:15.094960 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee87e8-11da-4489-a444-2ea8751f7b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:15.095713 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee87e8-11da-4489-a444-2ea8751f7b59 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:15.096060 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee87e8-11da-4489-a444-2ea8751f7b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:15.096388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee87e8-11da-4489-a444-2ea8751f7b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:15.113735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee87e8-11da-4489-a444-2ea8751f7b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:15.115375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee87e8-11da-4489-a444-2ea8751f7b59 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-6aee87e8-11da-4489-a444-2ea8751f7b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:15.132424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:15.134494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:15.136567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:15.136567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:15.136567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:15.136567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 345/687] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:15.137072 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee87e8-11da-4489-a444-2ea8751f7b59 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:15.157110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:15.222202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6d5ac-1411-415b-aa8c-490f7e1fa393 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:15.266731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d8e7b-a821-464f-a69f-1f5221667a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:15.267587 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d8e7b-a821-464f-a69f-1f5221667a4a None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:15.267999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d8e7b-a821-464f-a69f-1f5221667a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:15.268401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d8e7b-a821-464f-a69f-1f5221667a4a None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:15.269277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d8e7b-a821-464f-a69f-1f5221667a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:15.269751 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d8e7b-a821-464f-a69f-1f5221667a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:15.270082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee87e8-11da-4489-a444-2ea8751f7b59 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:15.271626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d8e7b-a821-464f-a69f-1f5221667a4a None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:15.287371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 343/688] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:15.288654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d8e7b-a821-464f-a69f-1f5221667a4a None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:15.306962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f2e4c-72d0-45bf-b68e-4ef9382d315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:15.307759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f2e4c-72d0-45bf-b68e-4ef9382d315b None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:15.308168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f2e4c-72d0-45bf-b68e-4ef9382d315b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:15.308502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f2e4c-72d0-45bf-b68e-4ef9382d315b None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:15.309276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f2e4c-72d0-45bf-b68e-4ef9382d315b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:15.309673 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f2e4c-72d0-45bf-b68e-4ef9382d315b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:15.311473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f2e4c-72d0-45bf-b68e-4ef9382d315b None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:15.329212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 346/689] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:15.330268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f2e4c-72d0-45bf-b68e-4ef9382d315b None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:15.379912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:15.407664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d8e7b-a821-464f-a69f-1f5221667a4a None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:15.415979 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:15.443633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f2e4c-72d0-45bf-b68e-4ef9382d315b None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:15.449353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98879a6e-0b2b-4ea5-8c52-b5c28f7b306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:15.450232 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879a6e-0b2b-4ea5-8c52-b5c28f7b306a None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:15.450644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879a6e-0b2b-4ea5-8c52-b5c28f7b306a None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:15.451072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879a6e-0b2b-4ea5-8c52-b5c28f7b306a None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:15.451960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98879a6e-0b2b-4ea5-8c52-b5c28f7b306a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:15.452580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98879a6e-0b2b-4ea5-8c52-b5c28f7b306a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:15.454276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98879a6e-0b2b-4ea5-8c52-b5c28f7b306a None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:15.469381 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 344/690] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:15.470674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98879a6e-0b2b-4ea5-8c52-b5c28f7b306a None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:15.481855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b12bf-a624-4f59-a77f-be873449a9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:15.482646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b12bf-a624-4f59-a77f-be873449a9da None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:15.483035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b12bf-a624-4f59-a77f-be873449a9da None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:15.486427 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b12bf-a624-4f59-a77f-be873449a9da None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:15.487815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b12bf-a624-4f59-a77f-be873449a9da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:15.488934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b12bf-a624-4f59-a77f-be873449a9da None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:15.513334 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 347/691] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:13:15 2022] POST /identity/v3/users => generated 254 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:13:15.514433 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b12bf-a624-4f59-a77f-be873449a9da None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:15.600889 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98879a6e-0b2b-4ea5-8c52-b5c28f7b306a None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:15.643673 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae2840-f42b-4b55-b923-253ba51f9f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:15.644790 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae2840-f42b-4b55-b923-253ba51f9f3f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:15.645557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae2840-f42b-4b55-b923-253ba51f9f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:15.646075 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae2840-f42b-4b55-b923-253ba51f9f3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:15.647100 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae2840-f42b-4b55-b923-253ba51f9f3f None admin] RBAC: Adding query filter params (role.id=9f750e14956d482c8757564559516c7a, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=54cdc076295642bf945fe63a972b8aa4) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:15.647630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae2840-f42b-4b55-b923-253ba51f9f3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:15.649292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae2840-f42b-4b55-b923-253ba51f9f3f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:15.649474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b12bf-a624-4f59-a77f-be873449a9da None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:15.653166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:15.658626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 345/692] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:15 2022] GET /identity/v3/role_assignments?user.id=54cdc076295642bf945fe63a972b8aa4&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=9f750e14956d482c8757564559516c7a => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:15.711674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:15.716388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6e168-2e48-4aaf-9f9d-eeb1edf790de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:15.717112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6e168-2e48-4aaf-9f9d-eeb1edf790de None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:15.717392 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6e168-2e48-4aaf-9f9d-eeb1edf790de None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:15.717658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6e168-2e48-4aaf-9f9d-eeb1edf790de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:15.727387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6e168-2e48-4aaf-9f9d-eeb1edf790de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:15.729010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6e168-2e48-4aaf-9f9d-eeb1edf790de None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-ccd6e168-2e48-4aaf-9f9d-eeb1edf790de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:15.749407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:15.750488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:15.751442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:15.751442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:15.751442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:15.751442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:15.751442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:15.751442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:15.751442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:15.751442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:15.755376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 348/693] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:15.763896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae2840-f42b-4b55-b923-253ba51f9f3f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:15.807428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c618858-16e8-4514-81a4-50bf2c6084c4 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:15.807776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c618858-16e8-4514-81a4-50bf2c6084c4 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:15.807971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c618858-16e8-4514-81a4-50bf2c6084c4 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:15.809700 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 349/694] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:15.820894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b7971-aed1-48f3-9296-ef88b44ad282 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:15.821215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b7971-aed1-48f3-9296-ef88b44ad282 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:15.821520 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b7971-aed1-48f3-9296-ef88b44ad282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:15.862892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-819b7971-aed1-48f3-9296-ef88b44ad282 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:15.864078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-819b7971-aed1-48f3-9296-ef88b44ad282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:15.922312 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae2840-f42b-4b55-b923-253ba51f9f3f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:15.966159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 350/695] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:13:15.975451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db28e2-7d7e-4314-a534-d8fd2da0a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:15.976091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db28e2-7d7e-4314-a534-d8fd2da0a684 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:15.976367 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db28e2-7d7e-4314-a534-d8fd2da0a684 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:15.976637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db28e2-7d7e-4314-a534-d8fd2da0a684 None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:15.977356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db28e2-7d7e-4314-a534-d8fd2da0a684 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:15.977662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db28e2-7d7e-4314-a534-d8fd2da0a684 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:15.979159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db28e2-7d7e-4314-a534-d8fd2da0a684 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:15.993583 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 346/696] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:15.993863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b7971-aed1-48f3-9296-ef88b44ad282 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:16.000671 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db28e2-7d7e-4314-a534-d8fd2da0a684 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:16.080657 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:16.112879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b7971-aed1-48f3-9296-ef88b44ad282 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:16.147356 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:16.157657 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db28e2-7d7e-4314-a534-d8fd2da0a684 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:16.180178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae1e20-fcb2-4792-a8c1-4e92594b6ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:16.180840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae1e20-fcb2-4792-a8c1-4e92594b6ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:16.181108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae1e20-fcb2-4792-a8c1-4e92594b6ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:16.181373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae1e20-fcb2-4792-a8c1-4e92594b6ea1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:16.203647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae1e20-fcb2-4792-a8c1-4e92594b6ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-d2ae1e20-fcb2-4792-a8c1-4e92594b6ea1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:16.210316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:16.211306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:16.212201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:16.212201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:16.212201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:16.212201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:16.212201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:16.212201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:16.212201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:16.212201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:16.212201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:16.212201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:16.212201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:13:16.212201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:16.217677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 351/697] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:13:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:16.220434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae1e20-fcb2-4792-a8c1-4e92594b6ea1 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:16.238606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836e7e8-e142-48df-818d-1bbd88a5f55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:16.239293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836e7e8-e142-48df-818d-1bbd88a5f55b None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:16.239570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836e7e8-e142-48df-818d-1bbd88a5f55b None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:16.239832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836e7e8-e142-48df-818d-1bbd88a5f55b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:16.240611 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836e7e8-e142-48df-818d-1bbd88a5f55b None admin] RBAC: Adding query filter params (role.id=9f750e14956d482c8757564559516c7a, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=913447120a2e42d8affdf50bb74dc5aa) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:16.240910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836e7e8-e142-48df-818d-1bbd88a5f55b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:16.242396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836e7e8-e142-48df-818d-1bbd88a5f55b None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:16.255982 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 347/698] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:15 2022] GET /identity/v3/role_assignments?user.id=913447120a2e42d8affdf50bb74dc5aa&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=9f750e14956d482c8757564559516c7a => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:16.439348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae1e20-fcb2-4792-a8c1-4e92594b6ea1 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:16.486880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2257a-e4f3-4af7-9daf-5429c3027df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:16.487588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2257a-e4f3-4af7-9daf-5429c3027df4 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:16.487865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2257a-e4f3-4af7-9daf-5429c3027df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:16.488130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2257a-e4f3-4af7-9daf-5429c3027df4 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:16.488818 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2257a-e4f3-4af7-9daf-5429c3027df4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:16.489104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2257a-e4f3-4af7-9daf-5429c3027df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:16.490509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2257a-e4f3-4af7-9daf-5429c3027df4 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:16.504765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 352/699] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:13:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:16.506303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836e7e8-e142-48df-818d-1bbd88a5f55b None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:16.625988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836e7e8-e142-48df-818d-1bbd88a5f55b None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:16.653820 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:16.667461 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6223d-d813-4284-8dd3-955e9c5d304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:16.668024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6223d-d813-4284-8dd3-955e9c5d304b None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:16.668292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6223d-d813-4284-8dd3-955e9c5d304b None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:16.668555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6223d-d813-4284-8dd3-955e9c5d304b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:16.680372 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6223d-d813-4284-8dd3-955e9c5d304b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:16.681827 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6223d-d813-4284-8dd3-955e9c5d304b None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-79c6223d-d813-4284-8dd3-955e9c5d304b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:16.696937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:16.697921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:16.698841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:16.698841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:16.698841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:16.700968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 348/700] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:16.704167 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2257a-e4f3-4af7-9daf-5429c3027df4 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:16.750528 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:16.810097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2257a-e4f3-4af7-9daf-5429c3027df4 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:16.844520 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a034-cd8b-4f51-abcf-f9406fdc8747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:16.845129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a034-cd8b-4f51-abcf-f9406fdc8747 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:16.845398 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a034-cd8b-4f51-abcf-f9406fdc8747 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:16.845702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a034-cd8b-4f51-abcf-f9406fdc8747 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:16.846345 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09a034-cd8b-4f51-abcf-f9406fdc8747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:16.846689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09a034-cd8b-4f51-abcf-f9406fdc8747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:16.848152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09a034-cd8b-4f51-abcf-f9406fdc8747 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:16.864332 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 353/701] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:16.866437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6223d-d813-4284-8dd3-955e9c5d304b None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:16.976763 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6223d-d813-4284-8dd3-955e9c5d304b None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:17.021250 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aef9d1-021c-4085-a15c-0aed083bfb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:17.021916 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aef9d1-021c-4085-a15c-0aed083bfb1e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:17.022297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aef9d1-021c-4085-a15c-0aed083bfb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:17.022572 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aef9d1-021c-4085-a15c-0aed083bfb1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:17.031785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aef9d1-021c-4085-a15c-0aed083bfb1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:17.033373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aef9d1-021c-4085-a15c-0aed083bfb1e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-e4aef9d1-021c-4085-a15c-0aed083bfb1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:17.051198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:17.052209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:17.053155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:17.053155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:17.053155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:17.053155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:17.053155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:17.053155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:17.053155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:17.053155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:17.053155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:13:17.053155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:17.053155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 349/702] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Aug 9 11:13:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:17.063981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a034-cd8b-4f51-abcf-f9406fdc8747 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:17.163645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2e5b4-372c-49f5-a063-f5b300763249 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:17.164024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2e5b4-372c-49f5-a063-f5b300763249 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:17.164253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2e5b4-372c-49f5-a063-f5b300763249 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:17.165795 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 350/703] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:17.171872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be392d60-1ac0-4c87-b705-7093b269199d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:17.172234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be392d60-1ac0-4c87-b705-7093b269199d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:17.172413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be392d60-1ac0-4c87-b705-7093b269199d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:17.202057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a034-cd8b-4f51-abcf-f9406fdc8747 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:17.207852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-be392d60-1ac0-4c87-b705-7093b269199d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:17.209064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-be392d60-1ac0-4c87-b705-7093b269199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:17.219261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:17.240977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d5d7b-e036-4526-b519-d8b0c9248254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:17.241605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d5d7b-e036-4526-b519-d8b0c9248254 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:17.241880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d5d7b-e036-4526-b519-d8b0c9248254 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:17.242202 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d5d7b-e036-4526-b519-d8b0c9248254 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:17.242971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d5d7b-e036-4526-b519-d8b0c9248254 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:17.243316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d5d7b-e036-4526-b519-d8b0c9248254 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:17.244968 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d5d7b-e036-4526-b519-d8b0c9248254 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:17.263635 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:17.272894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 354/704] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Aug 9 11:13:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:17.274894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d5d7b-e036-4526-b519-d8b0c9248254 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:17.325528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 351/705] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:13:17.363939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be392d60-1ac0-4c87-b705-7093b269199d None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:17.385343 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d5d7b-e036-4526-b519-d8b0c9248254 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:17.426062 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf322c-d1cb-4861-8f9f-cf431ceb692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:17.426731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf322c-d1cb-4861-8f9f-cf431ceb692c None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:17.427027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf322c-d1cb-4861-8f9f-cf431ceb692c None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:17.427334 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf322c-d1cb-4861-8f9f-cf431ceb692c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:17.480975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:17.517776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf322c-d1cb-4861-8f9f-cf431ceb692c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:17.526839 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf322c-d1cb-4861-8f9f-cf431ceb692c None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:17.578858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be392d60-1ac0-4c87-b705-7093b269199d None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:17.614544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c48f59-d5c9-4320-bac4-0d4910b21085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:17.615587 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c48f59-d5c9-4320-bac4-0d4910b21085 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:17.616094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c48f59-d5c9-4320-bac4-0d4910b21085 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:17.616558 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c48f59-d5c9-4320-bac4-0d4910b21085 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:17.617342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c48f59-d5c9-4320-bac4-0d4910b21085 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:17.618985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c48f59-d5c9-4320-bac4-0d4910b21085 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-75c48f59-d5c9-4320-bac4-0d4910b21085 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:17.631864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:17.633001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:17.633840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:17.633840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:17.633840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:17.633840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:17.633840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:17.633840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:17.633840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:17.633840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:17.633840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:17.633840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:17.633840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:17.633840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:17.633840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:13:17.633840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:17.636743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 352/706] 10.222.0.59 () {56 vars in 1129 bytes} [Tue Aug 9 11:13:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:17.646867 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c48f59-d5c9-4320-bac4-0d4910b21085 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:17.667314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 355/707] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:13:17.669020 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf322c-d1cb-4861-8f9f-cf431ceb692c None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:17.730501 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:17.743161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:17.793726 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf322c-d1cb-4861-8f9f-cf431ceb692c None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:17.832683 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34314e56-9007-4b76-9c89-175d2864ae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:17.833446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34314e56-9007-4b76-9c89-175d2864ae11 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:17.833717 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34314e56-9007-4b76-9c89-175d2864ae11 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:17.834300 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34314e56-9007-4b76-9c89-175d2864ae11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:17.854069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34314e56-9007-4b76-9c89-175d2864ae11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:17.856596 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34314e56-9007-4b76-9c89-175d2864ae11 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:17.877558 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c48f59-d5c9-4320-bac4-0d4910b21085 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-34314e56-9007-4b76-9c89-175d2864ae11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:17.885235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:17.886515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:17.887650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:17.887650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:17.887650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:17.899002 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 356/708] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:17.899996 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34314e56-9007-4b76-9c89-175d2864ae11 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:17.925886 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021731-a859-4536-a869-85ffb47f812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:17.926497 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021731-a859-4536-a869-85ffb47f812e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:17.926768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021731-a859-4536-a869-85ffb47f812e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:17.927059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021731-a859-4536-a869-85ffb47f812e None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:17.927781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87021731-a859-4536-a869-85ffb47f812e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:17.928387 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87021731-a859-4536-a869-85ffb47f812e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:17.930057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87021731-a859-4536-a869-85ffb47f812e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:17.936261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 353/709] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Aug 9 11:13:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:17.947170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021731-a859-4536-a869-85ffb47f812e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:18.086903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34314e56-9007-4b76-9c89-175d2864ae11 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:18.111516 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:18.115950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:18.128953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021731-a859-4536-a869-85ffb47f812e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:18.161914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde9059-e716-433b-9cd0-8d1142f0c368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:18.162557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9059-e716-433b-9cd0-8d1142f0c368 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:18.162856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9059-e716-433b-9cd0-8d1142f0c368 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:18.163125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9059-e716-433b-9cd0-8d1142f0c368 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:18.163787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde9059-e716-433b-9cd0-8d1142f0c368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:18.164088 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde9059-e716-433b-9cd0-8d1142f0c368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:18.165499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde9059-e716-433b-9cd0-8d1142f0c368 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:18.179488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 357/710] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:18.185768 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde9059-e716-433b-9cd0-8d1142f0c368 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:18.192360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7dc58-f0c0-4db3-a5a5-ff9538b6e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:18.192985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7dc58-f0c0-4db3-a5a5-ff9538b6e64e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:18.193256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7dc58-f0c0-4db3-a5a5-ff9538b6e64e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:18.193524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7dc58-f0c0-4db3-a5a5-ff9538b6e64e None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:18.194155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7dc58-f0c0-4db3-a5a5-ff9538b6e64e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:18.194452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7dc58-f0c0-4db3-a5a5-ff9538b6e64e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:18.195862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7dc58-f0c0-4db3-a5a5-ff9538b6e64e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:18.211001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 354/711] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Aug 9 11:13:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:18.309302 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde9059-e716-433b-9cd0-8d1142f0c368 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:18.366177 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ccdad-7126-403c-9584-8e03525042e3 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:18.366569 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ccdad-7126-403c-9584-8e03525042e3 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:18.366734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ccdad-7126-403c-9584-8e03525042e3 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:18.368271 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 355/712] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:13:18.369244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7f270-fa10-4a4d-bcfb-220da4649405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:18.369960 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7f270-fa10-4a4d-bcfb-220da4649405 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:18.370229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7f270-fa10-4a4d-bcfb-220da4649405 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:18.370886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7f270-fa10-4a4d-bcfb-220da4649405 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:18.375368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f445856-99d3-438f-ac88-b503766a0928 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:18.375972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f445856-99d3-438f-ac88-b503766a0928 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:18.376436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f445856-99d3-438f-ac88-b503766a0928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:18.385448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7f270-fa10-4a4d-bcfb-220da4649405 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:18.387363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7f270-fa10-4a4d-bcfb-220da4649405 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:18.399589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-6f445856-99d3-438f-ac88-b503766a0928 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-93d7f270-fa10-4a4d-bcfb-220da4649405 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:18.400577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:18.401511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:18.402504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:18.402504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:18.402504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:18.402504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:18.402504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:18.402504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:18.402504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:18.402504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:18.403019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6f445856-99d3-438f-ac88-b503766a0928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:18.409751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 358/713] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:18.411258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5dc39-0244-44c1-8808-0872ed1c1ad8 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:18.411538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5dc39-0244-44c1-8808-0872ed1c1ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:18.411804 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5dc39-0244-44c1-8808-0872ed1c1ad8 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:18.413500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 359/714] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:18.414308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5dc39-0244-44c1-8808-0872ed1c1ad8 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:18.453243 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:18.485010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 356/715] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:18.494834 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c845d-9dc3-4449-9cae-848c009881e3 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:18.495935 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c845d-9dc3-4449-9cae-848c009881e3 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:18.496213 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c845d-9dc3-4449-9cae-848c009881e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:18.526247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-934c845d-9dc3-4449-9cae-848c009881e3 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:18.527995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-934c845d-9dc3-4449-9cae-848c009881e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:18.534731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5dc39-0244-44c1-8808-0872ed1c1ad8 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:18.571401 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822d96a-8ec7-4d36-82c8-6fe454f30ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:18.572128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822d96a-8ec7-4d36-82c8-6fe454f30ebf None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:18.572462 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822d96a-8ec7-4d36-82c8-6fe454f30ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:18.572788 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822d96a-8ec7-4d36-82c8-6fe454f30ebf None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:18.573546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822d96a-8ec7-4d36-82c8-6fe454f30ebf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:18.573947 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822d96a-8ec7-4d36-82c8-6fe454f30ebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:18.575628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822d96a-8ec7-4d36-82c8-6fe454f30ebf None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:18.589040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 360/716] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:18.590086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822d96a-8ec7-4d36-82c8-6fe454f30ebf None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:18.603545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 357/717] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:18.604690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c845d-9dc3-4449-9cae-848c009881e3 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:18.631861 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:18.711000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:18.717209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c845d-9dc3-4449-9cae-848c009881e3 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:18.721074 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822d96a-8ec7-4d36-82c8-6fe454f30ebf None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:18.757749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebddee-3be0-4eb3-b7cd-a02c1e694fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:18.758341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b016c17-482b-4f6c-ac43-065cd9731c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:18.758502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebddee-3be0-4eb3-b7cd-a02c1e694fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:18.758629 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebddee-3be0-4eb3-b7cd-a02c1e694fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:18.758927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebddee-3be0-4eb3-b7cd-a02c1e694fa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:18.759363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b016c17-482b-4f6c-ac43-065cd9731c90 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:18.759654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebddee-3be0-4eb3-b7cd-a02c1e694fa4 None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=2136cf1160a64951ad780424cb28403b) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:18.759774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b016c17-482b-4f6c-ac43-065cd9731c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:18.759961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebddee-3be0-4eb3-b7cd-a02c1e694fa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:18.760220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b016c17-482b-4f6c-ac43-065cd9731c90 None admin] PATH_INFO: `/v3/services/network` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:18.760897 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b016c17-482b-4f6c-ac43-065cd9731c90 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:18.761383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebddee-3be0-4eb3-b7cd-a02c1e694fa4 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:18.762452 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b016c17-482b-4f6c-ac43-065cd9731c90 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:18.773603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 358/718] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:18 2022] GET /identity/v3/role_assignments?user.id=2136cf1160a64951ad780424cb28403b&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=169d11e171d04c87af71475295957618 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:18.774683 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebddee-3be0-4eb3-b7cd-a02c1e694fa4 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-7b016c17-482b-4f6c-ac43-065cd9731c90 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:18.775424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:18.777336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:18.779106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:18.779106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:18.779106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:18.779106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:18.779106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:18.779106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:18.779106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:18.779106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:18.779106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:18.779106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:18.779106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:18.779106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:18.779106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:13:18.779106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:18.780584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 361/719] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:18 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:18.787950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b016c17-482b-4f6c-ac43-065cd9731c90 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:18.943334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:18.950380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebddee-3be0-4eb3-b7cd-a02c1e694fa4 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:18.990621 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f217aa-1c8c-4230-8a93-af3ef3a8e883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:18.991607 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f217aa-1c8c-4230-8a93-af3ef3a8e883 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:18.992058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f217aa-1c8c-4230-8a93-af3ef3a8e883 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:18.992502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f217aa-1c8c-4230-8a93-af3ef3a8e883 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:19.007929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f217aa-1c8c-4230-8a93-af3ef3a8e883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-e9f217aa-1c8c-4230-8a93-af3ef3a8e883 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:19.014731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:19.015721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:19.016564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:19.016564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:19.016564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:19.016564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:19.016564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:19.016564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:19.016564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:19.016564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:19.016564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:19.016564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:19.016564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:19.016564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:19.019499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 359/720] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:19.025237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f217aa-1c8c-4230-8a93-af3ef3a8e883 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:19.040047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b016c17-482b-4f6c-ac43-065cd9731c90 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:19.130655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7f2ce-aba6-4de7-8745-c76a5bbca111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:19.132217 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7f2ce-aba6-4de7-8745-c76a5bbca111 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:19.132763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7f2ce-aba6-4de7-8745-c76a5bbca111 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:19.133177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7f2ce-aba6-4de7-8745-c76a5bbca111 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:19.133992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7f2ce-aba6-4de7-8745-c76a5bbca111 None admin] RBAC: Adding query filter params (name=network) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:19.136430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7f2ce-aba6-4de7-8745-c76a5bbca111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:19.140357 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7f2ce-aba6-4de7-8745-c76a5bbca111 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:19.153197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 362/721] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Aug 9 11:13:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:19.153197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4d35-0f71-4052-bb5b-5a2cbcf1e966 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:19.153197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4d35-0f71-4052-bb5b-5a2cbcf1e966 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:19.153197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4d35-0f71-4052-bb5b-5a2cbcf1e966 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:19.156429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 363/722] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:19.157418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a4d35-0f71-4052-bb5b-5a2cbcf1e966 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:19.180961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f217aa-1c8c-4230-8a93-af3ef3a8e883 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:19.183584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:19.229476 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cf861-d4dc-4365-88d1-782f8baf7c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:19.230106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cf861-d4dc-4365-88d1-782f8baf7c53 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:19.230553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cf861-d4dc-4365-88d1-782f8baf7c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:19.230920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cf861-d4dc-4365-88d1-782f8baf7c53 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:19.231801 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cf861-d4dc-4365-88d1-782f8baf7c53 None admin] RBAC: Adding query filter params (name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:19.232164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cf861-d4dc-4365-88d1-782f8baf7c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:19.233694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cf861-d4dc-4365-88d1-782f8baf7c53 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:19.245227 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 360/723] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:13:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:19.247141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d88014-1955-4c85-975b-e5874686b975 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:19.247483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d88014-1955-4c85-975b-e5874686b975 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:19.247814 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d88014-1955-4c85-975b-e5874686b975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:19.256647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:19.269970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c9d88014-1955-4c85-975b-e5874686b975 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:19.271504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c9d88014-1955-4c85-975b-e5874686b975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:19.302331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a4d35-0f71-4052-bb5b-5a2cbcf1e966 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:19.351590 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a4c6e-dcf8-4bbf-8982-25a7f5c9ccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:19.352423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a4c6e-dcf8-4bbf-8982-25a7f5c9ccec None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:19.352587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a4c6e-dcf8-4bbf-8982-25a7f5c9ccec None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:19.352747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a4c6e-dcf8-4bbf-8982-25a7f5c9ccec None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:19.358842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a4c6e-dcf8-4bbf-8982-25a7f5c9ccec None admin] RBAC: Adding query filter params (type=network) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:19.358842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a4c6e-dcf8-4bbf-8982-25a7f5c9ccec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:19.358842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a4c6e-dcf8-4bbf-8982-25a7f5c9ccec None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:19.359396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 361/724] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:19.359819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d88014-1955-4c85-975b-e5874686b975 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:19.369179 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 364/725] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Aug 9 11:13:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:19.384079 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a4c6e-dcf8-4bbf-8982-25a7f5c9ccec None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:19.574642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:19.580011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a4c6e-dcf8-4bbf-8982-25a7f5c9ccec None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:19.620875 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadf60b-8253-412f-babf-e74ae8455abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:19.621521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadf60b-8253-412f-babf-e74ae8455abb None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:19.621796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadf60b-8253-412f-babf-e74ae8455abb None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:19.622064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadf60b-8253-412f-babf-e74ae8455abb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:19.631450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d88014-1955-4c85-975b-e5874686b975 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:19.648932 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadf60b-8253-412f-babf-e74ae8455abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-5eadf60b-8253-412f-babf-e74ae8455abb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:19.654279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:19.655390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:19.656246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:19.656246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:19.656246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:19.656246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:19.656246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:19.656246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:19.656246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:19.656246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:19.656246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:19.656246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:19.656246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:13:19.656246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:19.668784 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 365/726] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:13:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:19.680633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadf60b-8253-412f-babf-e74ae8455abb None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:19.706279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81352f1-4163-4fab-873a-c5dd411f8157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:19.706949 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81352f1-4163-4fab-873a-c5dd411f8157 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:19.707226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81352f1-4163-4fab-873a-c5dd411f8157 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:19.707495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81352f1-4163-4fab-873a-c5dd411f8157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:19.712266 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:19.727393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81352f1-4163-4fab-873a-c5dd411f8157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:19.728884 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81352f1-4163-4fab-873a-c5dd411f8157 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-a81352f1-4163-4fab-873a-c5dd411f8157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:19.760528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:19.761568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:19.762489 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:19.762489 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:19.762489 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:19.768101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 362/727] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:19.770732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81352f1-4163-4fab-873a-c5dd411f8157 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:19.868782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadf60b-8253-412f-babf-e74ae8455abb None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:19.929364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a6968-177f-4736-8c1b-3c20d161fc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:19.929989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a6968-177f-4736-8c1b-3c20d161fc63 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:19.930262 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a6968-177f-4736-8c1b-3c20d161fc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:19.930530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a6968-177f-4736-8c1b-3c20d161fc63 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:19.931225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a6968-177f-4736-8c1b-3c20d161fc63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:19.931523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a6968-177f-4736-8c1b-3c20d161fc63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:19.938487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a6968-177f-4736-8c1b-3c20d161fc63 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:19.954957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 366/728] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:13:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:19.958993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81352f1-4163-4fab-873a-c5dd411f8157 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:19.961609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a6968-177f-4736-8c1b-3c20d161fc63 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:19.978302 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:20.067570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49084ad3-7eed-4be7-bf7f-3095bf2df65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:20.068194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49084ad3-7eed-4be7-bf7f-3095bf2df65e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:20.068464 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49084ad3-7eed-4be7-bf7f-3095bf2df65e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:20.068733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49084ad3-7eed-4be7-bf7f-3095bf2df65e None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:20.069386 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49084ad3-7eed-4be7-bf7f-3095bf2df65e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:20.069680 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49084ad3-7eed-4be7-bf7f-3095bf2df65e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:20.071110 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49084ad3-7eed-4be7-bf7f-3095bf2df65e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:20.091549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a6968-177f-4736-8c1b-3c20d161fc63 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:20.109347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 363/729] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:20.128075 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49084ad3-7eed-4be7-bf7f-3095bf2df65e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:20.138981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc689b6-a16b-410b-b21e-98631f077c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:20.140935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc689b6-a16b-410b-b21e-98631f077c21 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:20.141364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc689b6-a16b-410b-b21e-98631f077c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:20.141779 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc689b6-a16b-410b-b21e-98631f077c21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:20.153909 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc689b6-a16b-410b-b21e-98631f077c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:20.155638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc689b6-a16b-410b-b21e-98631f077c21 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-fcc689b6-a16b-410b-b21e-98631f077c21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:20.171945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:20.173181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:20.174299 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:20.174299 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:20.174299 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:20.176491 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 367/730] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:20.182048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc689b6-a16b-410b-b21e-98631f077c21 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:20.267904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:20.287221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:20.332705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc689b6-a16b-410b-b21e-98631f077c21 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:20.372123 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eaf91-7b3a-46f4-bdea-74c0dce95d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:20.373823 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eaf91-7b3a-46f4-bdea-74c0dce95d06 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:20.374494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eaf91-7b3a-46f4-bdea-74c0dce95d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:20.375093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eaf91-7b3a-46f4-bdea-74c0dce95d06 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:20.375961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469eaf91-7b3a-46f4-bdea-74c0dce95d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:20.376458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469eaf91-7b3a-46f4-bdea-74c0dce95d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:20.378322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469eaf91-7b3a-46f4-bdea-74c0dce95d06 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:20.393619 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 368/731] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:20.399879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eaf91-7b3a-46f4-bdea-74c0dce95d06 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:20.435992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49084ad3-7eed-4be7-bf7f-3095bf2df65e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:20.476316 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a50a96-17f1-4b14-9b8b-3bce01941b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:20.477329 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a50a96-17f1-4b14-9b8b-3bce01941b23 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:20.477818 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a50a96-17f1-4b14-9b8b-3bce01941b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:20.478979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a50a96-17f1-4b14-9b8b-3bce01941b23 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:20.491036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a50a96-17f1-4b14-9b8b-3bce01941b23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:20.493016 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a50a96-17f1-4b14-9b8b-3bce01941b23 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-e2a50a96-17f1-4b14-9b8b-3bce01941b23 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:20.507394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:20.508393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:20.509340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:20.509340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:20.509340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:20.509340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:20.509340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:20.509340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:20.509340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:20.509340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:20.509340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:13:20.509340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:20.512226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 364/732] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Aug 9 11:13:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:20.518370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a50a96-17f1-4b14-9b8b-3bce01941b23 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:20.636178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eaf91-7b3a-46f4-bdea-74c0dce95d06 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:20.645482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a50a96-17f1-4b14-9b8b-3bce01941b23 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:20.657380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:20.662279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:20.686042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9b905-7eb1-47c1-8c70-f66623379ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:20.687004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9b905-7eb1-47c1-8c70-f66623379ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:20.687637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9b905-7eb1-47c1-8c70-f66623379ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:20.688433 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9b905-7eb1-47c1-8c70-f66623379ff8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:20.696885 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83102b09-36df-41f7-affd-a397f3ace600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:20.697653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102b09-36df-41f7-affd-a397f3ace600 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:20.698131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102b09-36df-41f7-affd-a397f3ace600 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:20.698369 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102b09-36df-41f7-affd-a397f3ace600 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:20.699246 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83102b09-36df-41f7-affd-a397f3ace600 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:20.699637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83102b09-36df-41f7-affd-a397f3ace600 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:20.699865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9b905-7eb1-47c1-8c70-f66623379ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:20.701391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83102b09-36df-41f7-affd-a397f3ace600 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:20.701636 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9b905-7eb1-47c1-8c70-f66623379ff8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-5be9b905-7eb1-47c1-8c70-f66623379ff8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:20.718057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:20.719395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:20.720581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:20.720581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:20.720581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:20.720581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:20.720581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:20.720581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:20.720581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:20.720581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:20.720581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:13:20.720581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:20.723258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 369/733] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:13:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:20.724798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059b457-ccf6-4a60-8981-8fa4db97d815 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:20.729421 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 365/734] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Aug 9 11:13:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:20.729604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059b457-ccf6-4a60-8981-8fa4db97d815 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:20.729687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83102b09-36df-41f7-affd-a397f3ace600 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:20.729784 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059b457-ccf6-4a60-8981-8fa4db97d815 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:20.731438 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 370/735] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:20.732235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059b457-ccf6-4a60-8981-8fa4db97d815 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:20.847293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059b457-ccf6-4a60-8981-8fa4db97d815 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:20.872638 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83102b09-36df-41f7-affd-a397f3ace600 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:20.886977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9ebf7-e2cc-4e49-b114-5597e3f55637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:20.887366 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9ebf7-e2cc-4e49-b114-5597e3f55637 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:20.887642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9ebf7-e2cc-4e49-b114-5597e3f55637 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:20.887906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9ebf7-e2cc-4e49-b114-5597e3f55637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:20.923768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6eed20-c998-40a5-bd92-e8ca20cb8467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:20.924377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6eed20-c998-40a5-bd92-e8ca20cb8467 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:20.924647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6eed20-c998-40a5-bd92-e8ca20cb8467 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:20.925045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6eed20-c998-40a5-bd92-e8ca20cb8467 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:20.925770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6eed20-c998-40a5-bd92-e8ca20cb8467 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:20.926065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6eed20-c998-40a5-bd92-e8ca20cb8467 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:20.927575 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6eed20-c998-40a5-bd92-e8ca20cb8467 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:20.947789 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:20.957681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 366/736] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Aug 9 11:13:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:20.959914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea847b9-d9b6-4d83-bd76-20cff40a5a15 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:20.960653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea847b9-d9b6-4d83-bd76-20cff40a5a15 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:20.961111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea847b9-d9b6-4d83-bd76-20cff40a5a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:20.974185 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9ebf7-e2cc-4e49-b114-5597e3f55637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:20.976052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9ebf7-e2cc-4e49-b114-5597e3f55637 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:20.982289 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-eea847b9-d9b6-4d83-bd76-20cff40a5a15 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:20.983629 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-eea847b9-d9b6-4d83-bd76-20cff40a5a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:21.003939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:21.060256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 367/737] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:21.061327 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea847b9-d9b6-4d83-bd76-20cff40a5a15 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:21.116640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 371/738] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:13:21.121806 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9ebf7-e2cc-4e49-b114-5597e3f55637 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:21.173436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea847b9-d9b6-4d83-bd76-20cff40a5a15 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:21.211308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:21.213455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cab9d-d78a-4c79-9dd5-086483ce377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:21.214050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cab9d-d78a-4c79-9dd5-086483ce377c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:21.214306 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cab9d-d78a-4c79-9dd5-086483ce377c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:21.214697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cab9d-d78a-4c79-9dd5-086483ce377c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:21.236233 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9ebf7-e2cc-4e49-b114-5597e3f55637 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:21.240214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:21.275770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309041bc-cb4b-42dd-a8fb-63c91c9045ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:21.276385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309041bc-cb4b-42dd-a8fb-63c91c9045ff None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:21.276713 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309041bc-cb4b-42dd-a8fb-63c91c9045ff None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:21.276987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309041bc-cb4b-42dd-a8fb-63c91c9045ff None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:21.277623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309041bc-cb4b-42dd-a8fb-63c91c9045ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:21.279096 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309041bc-cb4b-42dd-a8fb-63c91c9045ff None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:21.293330 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cab9d-d78a-4c79-9dd5-086483ce377c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:21.295066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cab9d-d78a-4c79-9dd5-086483ce377c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:21.297826 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 372/739] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Aug 9 11:13:21 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:13:21.298972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c180291-cd94-4791-a1d8-f0823fb1d415 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:21.299255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c180291-cd94-4791-a1d8-f0823fb1d415 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:21.299521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c180291-cd94-4791-a1d8-f0823fb1d415 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:21.301020 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 373/740] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:21.301615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c180291-cd94-4791-a1d8-f0823fb1d415 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:21.432150 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 368/741] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:13:21.435416 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9ac97-a748-4b18-80e6-8d164c4c01be None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:21.436603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9ac97-a748-4b18-80e6-8d164c4c01be None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:21.437032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9ac97-a748-4b18-80e6-8d164c4c01be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:21.458862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-f0c9ac97-a748-4b18-80e6-8d164c4c01be None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:21.460346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f0c9ac97-a748-4b18-80e6-8d164c4c01be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:21.469054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c180291-cd94-4791-a1d8-f0823fb1d415 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:21.511726 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef607e4a-ca14-41b1-8c03-6535806000e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:21.512660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef607e4a-ca14-41b1-8c03-6535806000e7 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:21.513082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef607e4a-ca14-41b1-8c03-6535806000e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:21.513346 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef607e4a-ca14-41b1-8c03-6535806000e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:21.515881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:21.532644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef607e4a-ca14-41b1-8c03-6535806000e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:21.534165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef607e4a-ca14-41b1-8c03-6535806000e7 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:21.547405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-ef607e4a-ca14-41b1-8c03-6535806000e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:21.553464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:21.554492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:21.556224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:21.556224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:21.556224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:21.556224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 374/742] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:21.556224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef607e4a-ca14-41b1-8c03-6535806000e7 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:21.571065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 369/743] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:21.571910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9ac97-a748-4b18-80e6-8d164c4c01be None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:21.687734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9ac97-a748-4b18-80e6-8d164c4c01be None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:21.727161 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc097f3b-4a7d-4304-9b7d-7e088b530369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:21.728655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc097f3b-4a7d-4304-9b7d-7e088b530369 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:21.728935 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc097f3b-4a7d-4304-9b7d-7e088b530369 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:21.729208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc097f3b-4a7d-4304-9b7d-7e088b530369 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:21.729864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc097f3b-4a7d-4304-9b7d-7e088b530369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:21.730169 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc097f3b-4a7d-4304-9b7d-7e088b530369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:21.731585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc097f3b-4a7d-4304-9b7d-7e088b530369 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:21.744191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 370/744] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:21.745017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc097f3b-4a7d-4304-9b7d-7e088b530369 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:21.796588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:21.807805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef607e4a-ca14-41b1-8c03-6535806000e7 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:21.846242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7280da7-97fa-49fc-99ab-45c8b55142dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:21.846954 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7280da7-97fa-49fc-99ab-45c8b55142dd None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:21.847231 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7280da7-97fa-49fc-99ab-45c8b55142dd None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:21.847498 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7280da7-97fa-49fc-99ab-45c8b55142dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:21.858461 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7280da7-97fa-49fc-99ab-45c8b55142dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:21.859963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7280da7-97fa-49fc-99ab-45c8b55142dd None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:21.863715 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc097f3b-4a7d-4304-9b7d-7e088b530369 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-e7280da7-97fa-49fc-99ab-45c8b55142dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:21.874941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:21.875965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:21.876864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:21.876864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:21.876864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:21.876864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 375/745] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:21.877609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0251b-9c64-4cab-9009-c196f562d9bf None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:21.878308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0251b-9c64-4cab-9009-c196f562d9bf None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:21.878308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0251b-9c64-4cab-9009-c196f562d9bf None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:21.882896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 376/746] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:21.882896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0251b-9c64-4cab-9009-c196f562d9bf None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:21.910225 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648f525-31d8-4835-9089-7337a79746d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:21.911084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648f525-31d8-4835-9089-7337a79746d6 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:21.911402 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648f525-31d8-4835-9089-7337a79746d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:21.911731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648f525-31d8-4835-9089-7337a79746d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:21.924240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648f525-31d8-4835-9089-7337a79746d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:21.926430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-b648f525-31d8-4835-9089-7337a79746d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:21.930939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:21.932000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:21.932879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:21.932879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:21.932879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:21.932879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:21.932879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:21.932879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:21.932879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:21.932879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:21.932879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:21.932879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:21.932879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:13:21.932879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:21.932879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 371/747] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:13:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:21.933616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648f525-31d8-4835-9089-7337a79746d6 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:21.997607 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0251b-9c64-4cab-9009-c196f562d9bf None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:22.035730 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f35a1f-9087-4140-8a5c-bd2d2e2c625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:22.036379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f35a1f-9087-4140-8a5c-bd2d2e2c625a None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:22.036882 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f35a1f-9087-4140-8a5c-bd2d2e2c625a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:22.036882 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f35a1f-9087-4140-8a5c-bd2d2e2c625a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:22.039947 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648f525-31d8-4835-9089-7337a79746d6 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:22.041630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:22.044924 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f35a1f-9087-4140-8a5c-bd2d2e2c625a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:22.046491 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f35a1f-9087-4140-8a5c-bd2d2e2c625a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-28f35a1f-9087-4140-8a5c-bd2d2e2c625a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:22.059471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:22.060516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:22.061426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:22.061426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:22.061426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:22.061426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:22.061426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:22.061426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:22.061426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:22.061426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:22.065386 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 377/748] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:22.066791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a15d2b-7909-4e53-aebe-20437fbfd097 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:22.067096 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a15d2b-7909-4e53-aebe-20437fbfd097 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:22.067369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a15d2b-7909-4e53-aebe-20437fbfd097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:22.078565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dddd6c-ffbd-4220-9b03-93041b2da7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:22.079370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dddd6c-ffbd-4220-9b03-93041b2da7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:22.079744 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dddd6c-ffbd-4220-9b03-93041b2da7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:22.080523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dddd6c-ffbd-4220-9b03-93041b2da7b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:22.081319 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dddd6c-ffbd-4220-9b03-93041b2da7b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:22.081821 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dddd6c-ffbd-4220-9b03-93041b2da7b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:22.083352 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dddd6c-ffbd-4220-9b03-93041b2da7b9 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:22.085390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f8a15d2b-7909-4e53-aebe-20437fbfd097 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:22.086583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f8a15d2b-7909-4e53-aebe-20437fbfd097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:22.101312 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 372/749] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:22.101312 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dddd6c-ffbd-4220-9b03-93041b2da7b9 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:22.173592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 378/750] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:13:22.174531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a15d2b-7909-4e53-aebe-20437fbfd097 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:22.205853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:22.228002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dddd6c-ffbd-4220-9b03-93041b2da7b9 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:22.267787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f486d6f-8e48-489a-af82-e6b878d31e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:22.268582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f486d6f-8e48-489a-af82-e6b878d31e38 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:22.268863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f486d6f-8e48-489a-af82-e6b878d31e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:22.269131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f486d6f-8e48-489a-af82-e6b878d31e38 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:22.270389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f486d6f-8e48-489a-af82-e6b878d31e38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:22.270494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f486d6f-8e48-489a-af82-e6b878d31e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:22.271928 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f486d6f-8e48-489a-af82-e6b878d31e38 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:22.281487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 373/751] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:13:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:22.282357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f486d6f-8e48-489a-af82-e6b878d31e38 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:22.293977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a15d2b-7909-4e53-aebe-20437fbfd097 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:22.310170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:22.335308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2c700-61c5-40f8-bfc5-ae52cde43fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:22.336071 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2c700-61c5-40f8-bfc5-ae52cde43fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:22.336348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2c700-61c5-40f8-bfc5-ae52cde43fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:22.336623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2c700-61c5-40f8-bfc5-ae52cde43fa7 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:22.337590 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2c700-61c5-40f8-bfc5-ae52cde43fa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:22.337889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2c700-61c5-40f8-bfc5-ae52cde43fa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:22.339368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2c700-61c5-40f8-bfc5-ae52cde43fa7 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:22.357342 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 379/752] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:22.357342 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2c700-61c5-40f8-bfc5-ae52cde43fa7 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:22.399102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f486d6f-8e48-489a-af82-e6b878d31e38 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:22.440500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df558b-1278-42ee-8ffb-aa58235cfa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:22.441200 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df558b-1278-42ee-8ffb-aa58235cfa9c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:22.441484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df558b-1278-42ee-8ffb-aa58235cfa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:22.441750 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df558b-1278-42ee-8ffb-aa58235cfa9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:22.448816 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df558b-1278-42ee-8ffb-aa58235cfa9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:22.449962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:22.450270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df558b-1278-42ee-8ffb-aa58235cfa9c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-b3df558b-1278-42ee-8ffb-aa58235cfa9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:22.462480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:22.463650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:22.464753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:22.464753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:22.464753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:22.464753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:22.464753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:22.464753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:22.464753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:22.464753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:22.464753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 374/753] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:22.464753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df558b-1278-42ee-8ffb-aa58235cfa9c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:22.472962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2c700-61c5-40f8-bfc5-ae52cde43fa7 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:22.513171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ec4a3-b7e1-4ef4-a347-3365c1f87070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:22.513796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec4a3-b7e1-4ef4-a347-3365c1f87070 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:22.514069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec4a3-b7e1-4ef4-a347-3365c1f87070 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:22.514336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec4a3-b7e1-4ef4-a347-3365c1f87070 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:22.515023 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ec4a3-b7e1-4ef4-a347-3365c1f87070 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:22.516405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ec4a3-b7e1-4ef4-a347-3365c1f87070 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:22.534225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 380/754] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Aug 9 11:13:22 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:13:22.544095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ec4a3-b7e1-4ef4-a347-3365c1f87070 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:22.583944 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:22.604410 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df558b-1278-42ee-8ffb-aa58235cfa9c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:22.658520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077cffa-97bd-4302-a2a7-e9b143714957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:22.659488 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077cffa-97bd-4302-a2a7-e9b143714957 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:22.659876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077cffa-97bd-4302-a2a7-e9b143714957 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:22.660240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077cffa-97bd-4302-a2a7-e9b143714957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:22.679821 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077cffa-97bd-4302-a2a7-e9b143714957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:22.682481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077cffa-97bd-4302-a2a7-e9b143714957 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:22.693329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ec4a3-b7e1-4ef4-a347-3365c1f87070 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-2077cffa-97bd-4302-a2a7-e9b143714957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:22.704919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:22.705995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:22.707122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:22.707122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:22.707122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:22.709298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 375/755] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:22.710501 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077cffa-97bd-4302-a2a7-e9b143714957 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:22.735402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78b106-7837-4efa-8722-14f15ba6c032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:22.736010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78b106-7837-4efa-8722-14f15ba6c032 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:22.736277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78b106-7837-4efa-8722-14f15ba6c032 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:22.736538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78b106-7837-4efa-8722-14f15ba6c032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:22.737348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78b106-7837-4efa-8722-14f15ba6c032 None admin] RBAC: Adding query filter params (role.id=9f750e14956d482c8757564559516c7a, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=2c0549bc0a3445b48aa7fa7e341f8900) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:22.737654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78b106-7837-4efa-8722-14f15ba6c032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:22.739262 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78b106-7837-4efa-8722-14f15ba6c032 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:22.746900 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 381/756] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:22 2022] GET /identity/v3/role_assignments?user.id=2c0549bc0a3445b48aa7fa7e341f8900&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=9f750e14956d482c8757564559516c7a => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:22.747097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78b106-7837-4efa-8722-14f15ba6c032 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:22.769591 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:22.851638 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077cffa-97bd-4302-a2a7-e9b143714957 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:22.909048 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:22.915833 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78b106-7837-4efa-8722-14f15ba6c032 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:22.921074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18028dc9-3e44-49fb-a29a-a0fc4d27be89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:22.922105 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18028dc9-3e44-49fb-a29a-a0fc4d27be89 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:22.922581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18028dc9-3e44-49fb-a29a-a0fc4d27be89 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:22.923078 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18028dc9-3e44-49fb-a29a-a0fc4d27be89 None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:22.924007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18028dc9-3e44-49fb-a29a-a0fc4d27be89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:22.925032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18028dc9-3e44-49fb-a29a-a0fc4d27be89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:22.929949 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18028dc9-3e44-49fb-a29a-a0fc4d27be89 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:22.955351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 376/757] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:22.962782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18028dc9-3e44-49fb-a29a-a0fc4d27be89 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:22.997297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e17e4f-c114-4a19-ad38-583360b3c0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:22.998096 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e17e4f-c114-4a19-ad38-583360b3c0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:22.998388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e17e4f-c114-4a19-ad38-583360b3c0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:22.998752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e17e4f-c114-4a19-ad38-583360b3c0e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:22.999434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e17e4f-c114-4a19-ad38-583360b3c0e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:22.999729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e17e4f-c114-4a19-ad38-583360b3c0e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:23.001136 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e17e4f-c114-4a19-ad38-583360b3c0e5 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:23.028068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 382/758] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:23.033867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e17e4f-c114-4a19-ad38-583360b3c0e5 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:23.113717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18028dc9-3e44-49fb-a29a-a0fc4d27be89 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:23.161581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:23.177482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2610c6e-3fbe-4176-ad0b-4b59528260ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:23.178105 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2610c6e-3fbe-4176-ad0b-4b59528260ac None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:23.178381 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2610c6e-3fbe-4176-ad0b-4b59528260ac None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:23.178653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2610c6e-3fbe-4176-ad0b-4b59528260ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:23.179429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2610c6e-3fbe-4176-ad0b-4b59528260ac None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=913447120a2e42d8affdf50bb74dc5aa) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:23.179736 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2610c6e-3fbe-4176-ad0b-4b59528260ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:23.181190 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2610c6e-3fbe-4176-ad0b-4b59528260ac None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:23.189585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 377/759] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:22 2022] GET /identity/v3/role_assignments?user.id=913447120a2e42d8affdf50bb74dc5aa&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=169d11e171d04c87af71475295957618 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:23.215125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e17e4f-c114-4a19-ad38-583360b3c0e5 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:23.275631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c233bfc-0bf7-4b33-a101-d530267107e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:23.276484 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c233bfc-0bf7-4b33-a101-d530267107e8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:23.276857 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c233bfc-0bf7-4b33-a101-d530267107e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:23.277221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c233bfc-0bf7-4b33-a101-d530267107e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:23.290049 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c233bfc-0bf7-4b33-a101-d530267107e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:23.291769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c233bfc-0bf7-4b33-a101-d530267107e8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-9c233bfc-0bf7-4b33-a101-d530267107e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:23.307722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:23.308957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:23.310153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:23.310153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:23.310153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:23.310153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:23.310153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:23.310153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:23.310153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:23.310153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:23.310153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:13:23.310153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:23.312003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 383/760] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Aug 9 11:13:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:23.319652 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2610c6e-3fbe-4176-ad0b-4b59528260ac None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:23.392969 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:23.450286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2610c6e-3fbe-4176-ad0b-4b59528260ac None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:23.501094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c01de-173e-43a7-9098-84c0e613e432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:23.501709 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c01de-173e-43a7-9098-84c0e613e432 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:23.501978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c01de-173e-43a7-9098-84c0e613e432 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:23.502243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c01de-173e-43a7-9098-84c0e613e432 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:23.503060 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c01de-173e-43a7-9098-84c0e613e432 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:23.503359 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c01de-173e-43a7-9098-84c0e613e432 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:23.504353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de7e6e-f5d6-4efc-86a2-15c7d782e5f9 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:23.504788 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c01de-173e-43a7-9098-84c0e613e432 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:23.505285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de7e6e-f5d6-4efc-86a2-15c7d782e5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:23.505654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de7e6e-f5d6-4efc-86a2-15c7d782e5f9 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:23.512413 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 384/761] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:23.514176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb056269-de62-4888-950f-b83b4e34ce45 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:23.514614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb056269-de62-4888-950f-b83b4e34ce45 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:23.514914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb056269-de62-4888-950f-b83b4e34ce45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:23.528644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 378/762] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Aug 9 11:13:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:23.531142 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c01de-173e-43a7-9098-84c0e613e432 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:23.553136 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-bb056269-de62-4888-950f-b83b4e34ce45 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:23.555110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-bb056269-de62-4888-950f-b83b4e34ce45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:23.669419 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 385/763] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:23.703056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb056269-de62-4888-950f-b83b4e34ce45 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:23.715092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c01de-173e-43a7-9098-84c0e613e432 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:23.745025 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:23.770637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddcbf9-59a6-4401-aef7-db282f6747b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:23.771734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddcbf9-59a6-4401-aef7-db282f6747b3 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:23.772154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddcbf9-59a6-4401-aef7-db282f6747b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:23.772603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddcbf9-59a6-4401-aef7-db282f6747b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:23.785769 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddcbf9-59a6-4401-aef7-db282f6747b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:23.787499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddcbf9-59a6-4401-aef7-db282f6747b3 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-abddcbf9-59a6-4401-aef7-db282f6747b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:23.806975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:23.808106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:23.809059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:23.809059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:23.809059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:23.811220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 379/764] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:23.819839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddcbf9-59a6-4401-aef7-db282f6747b3 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:23.836494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:23.900518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb056269-de62-4888-950f-b83b4e34ce45 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:23.965188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860b373-7e67-4dc2-94c2-ffb91e62efc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:23.965914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860b373-7e67-4dc2-94c2-ffb91e62efc5 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:23.966276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860b373-7e67-4dc2-94c2-ffb91e62efc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:23.966637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860b373-7e67-4dc2-94c2-ffb91e62efc5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:23.967359 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860b373-7e67-4dc2-94c2-ffb91e62efc5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:23.968856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860b373-7e67-4dc2-94c2-ffb91e62efc5 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-a860b373-7e67-4dc2-94c2-ffb91e62efc5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:23.981855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:23.983126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:23.984222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:23.984222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:23.984222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:23.984222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:23.984222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:23.984222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:23.984222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:23.984222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:23.984222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:23.984222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:23.984222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:23.984222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:23.984222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:13:23.984222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:23.990198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 386/765] 10.222.0.59 () {56 vars in 1129 bytes} [Tue Aug 9 11:13:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:23.995910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860b373-7e67-4dc2-94c2-ffb91e62efc5 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:24.010385 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddcbf9-59a6-4401-aef7-db282f6747b3 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:24.088842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb41fdb-c8be-4c65-9ac1-38eb60a38905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:24.089456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb41fdb-c8be-4c65-9ac1-38eb60a38905 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:24.089727 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb41fdb-c8be-4c65-9ac1-38eb60a38905 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:24.089992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb41fdb-c8be-4c65-9ac1-38eb60a38905 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:24.090659 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb41fdb-c8be-4c65-9ac1-38eb60a38905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:24.090983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb41fdb-c8be-4c65-9ac1-38eb60a38905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:24.093277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb41fdb-c8be-4c65-9ac1-38eb60a38905 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:24.122858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 380/766] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:24.123855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb41fdb-c8be-4c65-9ac1-38eb60a38905 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:24.165867 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:24.194272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860b373-7e67-4dc2-94c2-ffb91e62efc5 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:24.247908 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:24.265903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95097f83-2b95-4fdf-8766-417fc6218fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:24.266522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95097f83-2b95-4fdf-8766-417fc6218fdd None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:24.266795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95097f83-2b95-4fdf-8766-417fc6218fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:24.267084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95097f83-2b95-4fdf-8766-417fc6218fdd None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:24.267724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95097f83-2b95-4fdf-8766-417fc6218fdd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:24.268021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95097f83-2b95-4fdf-8766-417fc6218fdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:24.269479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95097f83-2b95-4fdf-8766-417fc6218fdd None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:24.290312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 387/767] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Aug 9 11:13:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:24.290617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb41fdb-c8be-4c65-9ac1-38eb60a38905 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:24.300691 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95097f83-2b95-4fdf-8766-417fc6218fdd None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:24.335544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee4d25-95b0-479d-86eb-c07146ecf870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:24.336352 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee4d25-95b0-479d-86eb-c07146ecf870 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:24.336480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee4d25-95b0-479d-86eb-c07146ecf870 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:24.336711 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee4d25-95b0-479d-86eb-c07146ecf870 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:24.350183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee4d25-95b0-479d-86eb-c07146ecf870 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:24.351675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee4d25-95b0-479d-86eb-c07146ecf870 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-d9ee4d25-95b0-479d-86eb-c07146ecf870 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:24.383311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:24.384303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:24.385211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:24.385211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:24.385211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:24.385211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:24.385211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:24.385211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:24.385211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:24.385211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:24.385211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 381/768] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:24.393206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee4d25-95b0-479d-86eb-c07146ecf870 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:24.479877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95097f83-2b95-4fdf-8766-417fc6218fdd None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:24.517974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349176b5-2f28-4ebe-b90b-17e8e10978b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:24.519399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349176b5-2f28-4ebe-b90b-17e8e10978b8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:24.519824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349176b5-2f28-4ebe-b90b-17e8e10978b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:24.520215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349176b5-2f28-4ebe-b90b-17e8e10978b8 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:24.520969 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349176b5-2f28-4ebe-b90b-17e8e10978b8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:24.521437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349176b5-2f28-4ebe-b90b-17e8e10978b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:24.522988 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349176b5-2f28-4ebe-b90b-17e8e10978b8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:24.528666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 388/769] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Aug 9 11:13:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:24.534609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349176b5-2f28-4ebe-b90b-17e8e10978b8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:24.592761 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:24.599565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:24.603121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee4d25-95b0-479d-86eb-c07146ecf870 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:24.673728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b7a94-2e7d-4942-a941-c4cb6112fcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:24.675356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7a94-2e7d-4942-a941-c4cb6112fcab None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:24.676940 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7a94-2e7d-4942-a941-c4cb6112fcab None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:24.677288 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7a94-2e7d-4942-a941-c4cb6112fcab None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:24.679340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b7a94-2e7d-4942-a941-c4cb6112fcab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:24.679720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b7a94-2e7d-4942-a941-c4cb6112fcab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:24.682090 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b7a94-2e7d-4942-a941-c4cb6112fcab None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:24.685352 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349176b5-2f28-4ebe-b90b-17e8e10978b8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:24.706165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 382/770] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:24.712352 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b7a94-2e7d-4942-a941-c4cb6112fcab None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:24.757050 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689bc95-67f0-40b8-8d90-4770da7d85dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:24.757766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689bc95-67f0-40b8-8d90-4770da7d85dd None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:24.758106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689bc95-67f0-40b8-8d90-4770da7d85dd None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:24.758435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689bc95-67f0-40b8-8d90-4770da7d85dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:24.759295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689bc95-67f0-40b8-8d90-4770da7d85dd None admin] RBAC: Adding query filter params (interface=public, service_id=4cdc57fed47f41f7acc9f5879da76a42, region_id=RegionOne) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:24.759666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689bc95-67f0-40b8-8d90-4770da7d85dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:24.761332 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689bc95-67f0-40b8-8d90-4770da7d85dd None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:24.784205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 389/771] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Aug 9 11:13:24 2022] GET /identity/v3/endpoints?service_id=4cdc57fed47f41f7acc9f5879da76a42&interface=public®ion_id=RegionOne => generated 194 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:24.785655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689bc95-67f0-40b8-8d90-4770da7d85dd None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:24.915127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b7a94-2e7d-4942-a941-c4cb6112fcab None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:24.972798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689bc95-67f0-40b8-8d90-4770da7d85dd None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:24.980557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d90c6-43e3-4b73-97cd-4a6877f9fec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:24.981240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d90c6-43e3-4b73-97cd-4a6877f9fec0 None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:24.981518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d90c6-43e3-4b73-97cd-4a6877f9fec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:24.981791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d90c6-43e3-4b73-97cd-4a6877f9fec0 None admin] PATH_INFO: `/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/2136cf1160a64951ad780424cb28403b/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:24.983799 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d90c6-43e3-4b73-97cd-4a6877f9fec0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f53fb3d6b68b4654ae7247c9b74015e7, user_id=2136cf1160a64951ad780424cb28403b, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:24.985357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d90c6-43e3-4b73-97cd-4a6877f9fec0 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:24.991301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:25.002998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 383/772] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:13:24 2022] PUT /identity/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/2136cf1160a64951ad780424cb28403b/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:13:25.010278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1336d80-6f28-4e0e-9478-7ea5dd4d57c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:25.010990 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1336d80-6f28-4e0e-9478-7ea5dd4d57c2 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:25.011263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1336d80-6f28-4e0e-9478-7ea5dd4d57c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:25.011529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1336d80-6f28-4e0e-9478-7ea5dd4d57c2 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:25.012148 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1336d80-6f28-4e0e-9478-7ea5dd4d57c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:25.013679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1336d80-6f28-4e0e-9478-7ea5dd4d57c2 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:25.021096 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 390/773] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Aug 9 11:13:24 2022] GET /identity/v3/services => generated 772 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:25.202155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d3082-2e9e-424d-aca5-ce2a1a00660b None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:25.202541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d3082-2e9e-424d-aca5-ce2a1a00660b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:25.202708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d3082-2e9e-424d-aca5-ce2a1a00660b None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:25.204483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 384/774] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:25.210304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ba821-fbc3-4eb6-8a50-c3cd0de93a95 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:25.210657 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ba821-fbc3-4eb6-8a50-c3cd0de93a95 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:25.210875 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ba821-fbc3-4eb6-8a50-c3cd0de93a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:25.236125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-157ba821-fbc3-4eb6-8a50-c3cd0de93a95 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:25.237773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-157ba821-fbc3-4eb6-8a50-c3cd0de93a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:25.243792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979734f-e723-4530-b551-fa2eb66aad9e None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:25.244128 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979734f-e723-4530-b551-fa2eb66aad9e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:25.244341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979734f-e723-4530-b551-fa2eb66aad9e None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:25.246346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 385/775] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:25.252994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd917c83-294f-4a48-ac4e-ca3361629b0b None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:25.253289 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd917c83-294f-4a48-ac4e-ca3361629b0b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:25.253537 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd917c83-294f-4a48-ac4e-ca3361629b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:25.269924 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:25.280898 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-dd917c83-294f-4a48-ac4e-ca3361629b0b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:25.282379 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-dd917c83-294f-4a48-ac4e-ca3361629b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:25.326238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 391/776] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:25.349714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ba821-fbc3-4eb6-8a50-c3cd0de93a95 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:25.402595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 386/777] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:25.425741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd917c83-294f-4a48-ac4e-ca3361629b0b None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:25.560500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ba821-fbc3-4eb6-8a50-c3cd0de93a95 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:25.568042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd917c83-294f-4a48-ac4e-ca3361629b0b None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:25.575885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:25.601223 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690d03a-177d-4eb4-a4fe-556517b7f409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:25.602122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690d03a-177d-4eb4-a4fe-556517b7f409 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:25.602578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690d03a-177d-4eb4-a4fe-556517b7f409 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:25.602964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690d03a-177d-4eb4-a4fe-556517b7f409 None admin] PATH_INFO: `/v3/services/network` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:25.603614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690d03a-177d-4eb4-a4fe-556517b7f409 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:25.605125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690d03a-177d-4eb4-a4fe-556517b7f409 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:25.607867 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197915e9-a631-4b50-b5de-90e419ff7c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:25.608532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197915e9-a631-4b50-b5de-90e419ff7c62 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:25.608811 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197915e9-a631-4b50-b5de-90e419ff7c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:25.609076 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197915e9-a631-4b50-b5de-90e419ff7c62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:25.612520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-0690d03a-177d-4eb4-a4fe-556517b7f409 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:25.615409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:25.616458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:25.617348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:25.617348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:25.617348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:25.617348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:25.617348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:25.617348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:25.617348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:25.617348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:25.617348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:25.617348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:25.617348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:25.617348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:25.617348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:13:25.617348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:25.618086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 392/778] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:25 2022] GET /identity/v3/services/network => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:25.622842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ace9ba-fb6f-46b8-af10-a5abf416ee6b None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:25.622842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ace9ba-fb6f-46b8-af10-a5abf416ee6b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:25.622842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ace9ba-fb6f-46b8-af10-a5abf416ee6b None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:25.622842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 393/779] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:25.623632 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ace9ba-fb6f-46b8-af10-a5abf416ee6b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:25.627813 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197915e9-a631-4b50-b5de-90e419ff7c62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-197915e9-a631-4b50-b5de-90e419ff7c62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:25.634003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:25.636219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:25.637270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:25.637270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:25.637270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:25.637270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:25.637270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:25.637270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:25.637270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:25.637270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:25.637270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:25.637270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:25.637270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:25.637270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:25.637270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 387/780] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:25.637270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671e548-ac9d-4e0f-aed3-96013d80dc2a None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:25.638226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671e548-ac9d-4e0f-aed3-96013d80dc2a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:25.638226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671e548-ac9d-4e0f-aed3-96013d80dc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:25.657905 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-0671e548-ac9d-4e0f-aed3-96013d80dc2a None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:25.659376 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-0671e548-ac9d-4e0f-aed3-96013d80dc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:25.750917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 388/781] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:25.751950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671e548-ac9d-4e0f-aed3-96013d80dc2a None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:25.774405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ace9ba-fb6f-46b8-af10-a5abf416ee6b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:25.813427 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc24e47-4f92-4cb2-bcec-df726181c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:25.814376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc24e47-4f92-4cb2-bcec-df726181c65a None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:25.814831 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc24e47-4f92-4cb2-bcec-df726181c65a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:25.815483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc24e47-4f92-4cb2-bcec-df726181c65a None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:25.816364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc24e47-4f92-4cb2-bcec-df726181c65a None admin] RBAC: Adding query filter params (name=network) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:25.816898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc24e47-4f92-4cb2-bcec-df726181c65a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:25.818490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc24e47-4f92-4cb2-bcec-df726181c65a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:25.824497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 394/782] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Aug 9 11:13:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:25.829940 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc24e47-4f92-4cb2-bcec-df726181c65a None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:25.855727 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671e548-ac9d-4e0f-aed3-96013d80dc2a None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:25.878359 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:25.883110 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:25.892062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcb369-9df2-4c4e-9f94-67a4a4005a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:25.892700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcb369-9df2-4c4e-9f94-67a4a4005a11 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:25.893088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcb369-9df2-4c4e-9f94-67a4a4005a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:25.893210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcb369-9df2-4c4e-9f94-67a4a4005a11 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:25.894499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcb369-9df2-4c4e-9f94-67a4a4005a11 None admin] RBAC: Adding query filter params (name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:25.894499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcb369-9df2-4c4e-9f94-67a4a4005a11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:25.896153 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcb369-9df2-4c4e-9f94-67a4a4005a11 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:25.909718 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 389/783] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:13:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:25.910463 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcb369-9df2-4c4e-9f94-67a4a4005a11 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:25.946063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc24e47-4f92-4cb2-bcec-df726181c65a None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:25.981779 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44c554-352d-445c-b575-db8dbf13a914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:25.982700 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44c554-352d-445c-b575-db8dbf13a914 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:25.983265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44c554-352d-445c-b575-db8dbf13a914 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:25.983772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44c554-352d-445c-b575-db8dbf13a914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:25.995759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44c554-352d-445c-b575-db8dbf13a914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-fd44c554-352d-445c-b575-db8dbf13a914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:26.001272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:26.002260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:26.003176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:26.003176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:26.003176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:26.003176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:26.003176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:26.003176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:26.003176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:26.003176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:26.003176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:26.003176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:26.003176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:13:26.003176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:26.005557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 395/784] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:13:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:26.006493 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44c554-352d-445c-b575-db8dbf13a914 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:26.015758 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcb369-9df2-4c4e-9f94-67a4a4005a11 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:26.051519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc066ac3-dd95-4c9e-b91a-0ea8e84d85bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:26.052141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc066ac3-dd95-4c9e-b91a-0ea8e84d85bb None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:26.052420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc066ac3-dd95-4c9e-b91a-0ea8e84d85bb None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:26.052692 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc066ac3-dd95-4c9e-b91a-0ea8e84d85bb None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:26.053325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc066ac3-dd95-4c9e-b91a-0ea8e84d85bb None admin] RBAC: Adding query filter params (type=network) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:26.053631 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc066ac3-dd95-4c9e-b91a-0ea8e84d85bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:26.055055 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc066ac3-dd95-4c9e-b91a-0ea8e84d85bb None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:26.065395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 390/785] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Aug 9 11:13:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:26.065395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc066ac3-dd95-4c9e-b91a-0ea8e84d85bb None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:26.114557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:26.117904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44c554-352d-445c-b575-db8dbf13a914 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:26.118633 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:26.153472 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f2c10-14c2-4f75-a8ff-d6e5e6c20dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:26.154569 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f2c10-14c2-4f75-a8ff-d6e5e6c20dad None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:26.155092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f2c10-14c2-4f75-a8ff-d6e5e6c20dad None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:26.155560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f2c10-14c2-4f75-a8ff-d6e5e6c20dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:26.167160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f2c10-14c2-4f75-a8ff-d6e5e6c20dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:26.168923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f2c10-14c2-4f75-a8ff-d6e5e6c20dad None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:26.169817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc066ac3-dd95-4c9e-b91a-0ea8e84d85bb None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-bf3f2c10-14c2-4f75-a8ff-d6e5e6c20dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:26.184688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:26.185704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:26.186679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:26.186679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:26.186679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:26.188844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 396/786] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:26.189857 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f2c10-14c2-4f75-a8ff-d6e5e6c20dad None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:26.213310 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c964526-8a27-4a7c-ac17-555d7fb57264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:26.214560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c964526-8a27-4a7c-ac17-555d7fb57264 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:26.215270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c964526-8a27-4a7c-ac17-555d7fb57264 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:26.215716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c964526-8a27-4a7c-ac17-555d7fb57264 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:26.219519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c964526-8a27-4a7c-ac17-555d7fb57264 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:26.220545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c964526-8a27-4a7c-ac17-555d7fb57264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:26.223137 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c964526-8a27-4a7c-ac17-555d7fb57264 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:26.236749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 391/787] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:13:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:26.238237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c964526-8a27-4a7c-ac17-555d7fb57264 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:26.339061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f2c10-14c2-4f75-a8ff-d6e5e6c20dad None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:26.357407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c964526-8a27-4a7c-ac17-555d7fb57264 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:26.376708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:26.390252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c73d5-51d7-47dc-8290-be0ac0109b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:26.391283 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c73d5-51d7-47dc-8290-be0ac0109b38 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:26.391718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c73d5-51d7-47dc-8290-be0ac0109b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:26.392495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c73d5-51d7-47dc-8290-be0ac0109b38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:26.393658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c73d5-51d7-47dc-8290-be0ac0109b38 None admin] RBAC: Adding query filter params (interface=public, service_id=d68be77171a147819a77f0e0b06f00c0, region_id=RegionOne) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:26.394011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c73d5-51d7-47dc-8290-be0ac0109b38 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:26.395808 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c73d5-51d7-47dc-8290-be0ac0109b38 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:26.401056 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d9378-1298-4d28-a891-44b28373c483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:26.401876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d9378-1298-4d28-a891-44b28373c483 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:26.402290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d9378-1298-4d28-a891-44b28373c483 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:26.402700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d9378-1298-4d28-a891-44b28373c483 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:26.406890 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 397/788] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Aug 9 11:13:26 2022] GET /identity/v3/endpoints?service_id=d68be77171a147819a77f0e0b06f00c0&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:26.406890 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c73d5-51d7-47dc-8290-be0ac0109b38 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:26.407698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d9378-1298-4d28-a891-44b28373c483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:26.408460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d9378-1298-4d28-a891-44b28373c483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:26.409546 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d9378-1298-4d28-a891-44b28373c483 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:26.424080 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 392/789] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:26.425010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d9378-1298-4d28-a891-44b28373c483 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:26.434852 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:26.539539 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d9378-1298-4d28-a891-44b28373c483 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:26.546737 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c73d5-51d7-47dc-8290-be0ac0109b38 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:26.576065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f20c2a-34ce-4a64-bedc-42d145a334ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:26.576673 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f20c2a-34ce-4a64-bedc-42d145a334ba None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:26.576950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f20c2a-34ce-4a64-bedc-42d145a334ba None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:26.577220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f20c2a-34ce-4a64-bedc-42d145a334ba None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:26.577835 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f20c2a-34ce-4a64-bedc-42d145a334ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:26.579264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f20c2a-34ce-4a64-bedc-42d145a334ba None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:26.591053 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c799e-f196-42d3-b2c7-ea9aa07864f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:26.591582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 393/790] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Aug 9 11:13:26 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:26.592232 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f20c2a-34ce-4a64-bedc-42d145a334ba None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:26.592805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c799e-f196-42d3-b2c7-ea9aa07864f4 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:26.593362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c799e-f196-42d3-b2c7-ea9aa07864f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:26.593831 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c799e-f196-42d3-b2c7-ea9aa07864f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:26.607761 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c799e-f196-42d3-b2c7-ea9aa07864f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:26.609649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c799e-f196-42d3-b2c7-ea9aa07864f4 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-6c6c799e-f196-42d3-b2c7-ea9aa07864f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:26.628935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:26.629998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:26.630957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:26.630957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:26.630957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:26.633551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 398/791] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:26.639833 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c799e-f196-42d3-b2c7-ea9aa07864f4 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:26.685809 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:26.720132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:26.763439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c799e-f196-42d3-b2c7-ea9aa07864f4 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:26.804251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0eb506-57c5-4133-9bac-f6bb9b154db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:26.804870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0eb506-57c5-4133-9bac-f6bb9b154db6 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:26.805140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0eb506-57c5-4133-9bac-f6bb9b154db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:26.805409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0eb506-57c5-4133-9bac-f6bb9b154db6 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:26.806062 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0eb506-57c5-4133-9bac-f6bb9b154db6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:26.806355 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0eb506-57c5-4133-9bac-f6bb9b154db6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:26.808426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0eb506-57c5-4133-9bac-f6bb9b154db6 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:26.823979 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 399/792] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:26.830358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0eb506-57c5-4133-9bac-f6bb9b154db6 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:26.850659 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f20c2a-34ce-4a64-bedc-42d145a334ba None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:26.895365 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e9804-5bf8-44e4-bf63-cef5dfcee11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:26.896004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e9804-5bf8-44e4-bf63-cef5dfcee11c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:26.896275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e9804-5bf8-44e4-bf63-cef5dfcee11c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:26.896536 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e9804-5bf8-44e4-bf63-cef5dfcee11c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:26.907348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e9804-5bf8-44e4-bf63-cef5dfcee11c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:26.908854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e9804-5bf8-44e4-bf63-cef5dfcee11c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-725e9804-5bf8-44e4-bf63-cef5dfcee11c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:26.922067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:26.923130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:26.924062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:26.924062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:26.924062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:26.924062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:26.924062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:26.924062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:26.924062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:26.924062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:26.924062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:13:26.924062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:26.924062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 394/793] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Aug 9 11:13:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:26.929526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e9804-5bf8-44e4-bf63-cef5dfcee11c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:26.968047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0eb506-57c5-4133-9bac-f6bb9b154db6 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:27.015624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:27.027658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa9a74-243e-4a35-a40c-c75c67b33bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:27.028358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa9a74-243e-4a35-a40c-c75c67b33bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:27.028638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa9a74-243e-4a35-a40c-c75c67b33bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:27.028907 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa9a74-243e-4a35-a40c-c75c67b33bf7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:27.044905 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa9a74-243e-4a35-a40c-c75c67b33bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:27.046379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa9a74-243e-4a35-a40c-c75c67b33bf7 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:27.054586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e9804-5bf8-44e4-bf63-cef5dfcee11c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-9dfa9a74-243e-4a35-a40c-c75c67b33bf7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:27.058495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:27.059446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:27.060385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:27.060385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:27.060385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:27.060385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:27.060385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:27.060385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:27.060385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:27.060385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:27.060385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:13:27.060385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:27.060385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 400/794] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:13:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:27.065631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa9a74-243e-4a35-a40c-c75c67b33bf7 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:27.066801 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:27.100615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8d6a4-b311-4cf2-bbee-efd798412c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:27.101686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8d6a4-b311-4cf2-bbee-efd798412c88 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:27.102178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8d6a4-b311-4cf2-bbee-efd798412c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:27.102835 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8d6a4-b311-4cf2-bbee-efd798412c88 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:27.103765 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8d6a4-b311-4cf2-bbee-efd798412c88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:27.104280 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8d6a4-b311-4cf2-bbee-efd798412c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:27.106471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8d6a4-b311-4cf2-bbee-efd798412c88 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:27.145606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 395/795] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Aug 9 11:13:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:27.151183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8d6a4-b311-4cf2-bbee-efd798412c88 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:27.199037 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa9a74-243e-4a35-a40c-c75c67b33bf7 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:27.237109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fbe96-4701-47bd-ad07-8f037ece6bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:27.238307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fbe96-4701-47bd-ad07-8f037ece6bae None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:27.238902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fbe96-4701-47bd-ad07-8f037ece6bae None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:27.239368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fbe96-4701-47bd-ad07-8f037ece6bae None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:27.240310 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fbe96-4701-47bd-ad07-8f037ece6bae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:27.240904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fbe96-4701-47bd-ad07-8f037ece6bae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:27.242693 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fbe96-4701-47bd-ad07-8f037ece6bae None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:27.264001 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 401/796] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Aug 9 11:13:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:27.264617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8d6a4-b311-4cf2-bbee-efd798412c88 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:27.272794 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fbe96-4701-47bd-ad07-8f037ece6bae None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:27.300712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2356a-c979-4996-a436-4deefaa410e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:27.301733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2356a-c979-4996-a436-4deefaa410e8 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:27.302107 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2356a-c979-4996-a436-4deefaa410e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:27.302473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2356a-c979-4996-a436-4deefaa410e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:27.313535 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2356a-c979-4996-a436-4deefaa410e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:27.315090 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2356a-c979-4996-a436-4deefaa410e8 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-fed2356a-c979-4996-a436-4deefaa410e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:27.330439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:27.331712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:27.332605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:27.332605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:27.332605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:27.332605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 396/797] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:27.333412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeea378-c791-4cdf-9476-98ed082514fd None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:27.333690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeea378-c791-4cdf-9476-98ed082514fd None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:27.333962 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeea378-c791-4cdf-9476-98ed082514fd None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:27.343964 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 397/798] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:27.343964 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeea378-c791-4cdf-9476-98ed082514fd None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:27.364863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:27.368612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:27.436392 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fbe96-4701-47bd-ad07-8f037ece6bae None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:27.451409 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeea378-c791-4cdf-9476-98ed082514fd None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:27.477158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141fd9b-ad7a-4f42-bb6c-c51eeee7dc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:27.483944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141fd9b-ad7a-4f42-bb6c-c51eeee7dc93 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:27.484631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141fd9b-ad7a-4f42-bb6c-c51eeee7dc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:27.485154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141fd9b-ad7a-4f42-bb6c-c51eeee7dc93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:27.487466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab892cc-5b0b-456b-b1b9-a425cbb88b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:27.488084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab892cc-5b0b-456b-b1b9-a425cbb88b32 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:27.488364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab892cc-5b0b-456b-b1b9-a425cbb88b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:27.488631 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab892cc-5b0b-456b-b1b9-a425cbb88b32 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:27.489294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab892cc-5b0b-456b-b1b9-a425cbb88b32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:27.489597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab892cc-5b0b-456b-b1b9-a425cbb88b32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:27.491010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab892cc-5b0b-456b-b1b9-a425cbb88b32 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:27.505796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141fd9b-ad7a-4f42-bb6c-c51eeee7dc93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:27.505796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141fd9b-ad7a-4f42-bb6c-c51eeee7dc93 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:27.508188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 398/799] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:27.509613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b0972-16b2-41b6-83a4-c4b66e24a6ee None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:27.509896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b0972-16b2-41b6-83a4-c4b66e24a6ee None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:27.510169 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b0972-16b2-41b6-83a4-c4b66e24a6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-c141fd9b-ad7a-4f42-bb6c-c51eeee7dc93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:27.518945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:27.519923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:27.520814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:27.520814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:27.520814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:27.524854 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 402/800] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:27.525787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141fd9b-ad7a-4f42-bb6c-c51eeee7dc93 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:27.529370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-576b0972-16b2-41b6-83a4-c4b66e24a6ee None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:27.531532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-576b0972-16b2-41b6-83a4-c4b66e24a6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:27.600259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:27.606836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 399/801] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:27.608276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328e473-35b7-432e-a9ef-952796315fbe None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:27.608651 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328e473-35b7-432e-a9ef-952796315fbe None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:27.608992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328e473-35b7-432e-a9ef-952796315fbe None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:27.610446 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 400/802] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:27.611102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328e473-35b7-432e-a9ef-952796315fbe None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:27.639305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:27.643719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141fd9b-ad7a-4f42-bb6c-c51eeee7dc93 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:27.679712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fc08f-fb87-482f-a76e-5ccde895990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:27.680446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fc08f-fb87-482f-a76e-5ccde895990b None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:27.680714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fc08f-fb87-482f-a76e-5ccde895990b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:27.680974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fc08f-fb87-482f-a76e-5ccde895990b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:27.687864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fc08f-fb87-482f-a76e-5ccde895990b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:27.689318 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fc08f-fb87-482f-a76e-5ccde895990b None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-593fc08f-fb87-482f-a76e-5ccde895990b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:27.700776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:27.702578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:27.704087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:27.704087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:27.704087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:27.704087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:27.704087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:27.704087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:27.704087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:27.704087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:27.707162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 403/803] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:27.708656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefb430-c5c3-4e40-b419-ec1e198ac793 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:27.708883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefb430-c5c3-4e40-b419-ec1e198ac793 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:27.709241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefb430-c5c3-4e40-b419-ec1e198ac793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:27.728363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-2cefb430-c5c3-4e40-b419-ec1e198ac793 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:27.729562 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-2cefb430-c5c3-4e40-b419-ec1e198ac793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:27.735277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328e473-35b7-432e-a9ef-952796315fbe None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:27.773072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e30d5-ae52-4896-b7f5-c282721af590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:27.774165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e30d5-ae52-4896-b7f5-c282721af590 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:27.774448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e30d5-ae52-4896-b7f5-c282721af590 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:27.774716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e30d5-ae52-4896-b7f5-c282721af590 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:27.775397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e30d5-ae52-4896-b7f5-c282721af590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:27.775699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e30d5-ae52-4896-b7f5-c282721af590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:27.777758 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e30d5-ae52-4896-b7f5-c282721af590 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:27.790286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 401/804] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:27.790959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e30d5-ae52-4896-b7f5-c282721af590 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:27.806156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 404/805] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:27.806865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefb430-c5c3-4e40-b419-ec1e198ac793 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:27.869409 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:27.901129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:27.915595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefb430-c5c3-4e40-b419-ec1e198ac793 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:27.916740 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e30d5-ae52-4896-b7f5-c282721af590 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:27.954865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba67809-a95f-445a-815a-e317097a8627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:27.954865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba67809-a95f-445a-815a-e317097a8627 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:27.954865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba67809-a95f-445a-815a-e317097a8627 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:27.954865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba67809-a95f-445a-815a-e317097a8627 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:27.955300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265f5cc-c99d-495b-bd83-dcc321b26f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:27.955387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba67809-a95f-445a-815a-e317097a8627 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:27.955387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba67809-a95f-445a-815a-e317097a8627 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:27.955512 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265f5cc-c99d-495b-bd83-dcc321b26f9e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:27.955512 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265f5cc-c99d-495b-bd83-dcc321b26f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:27.956023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265f5cc-c99d-495b-bd83-dcc321b26f9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:27.956670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba67809-a95f-445a-815a-e317097a8627 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:27.968375 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265f5cc-c99d-495b-bd83-dcc321b26f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:27.973743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 405/806] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:27.973743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba67809-a95f-445a-815a-e317097a8627 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-0265f5cc-c99d-495b-bd83-dcc321b26f9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:27.974188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:27.975298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:27.976182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:27.976182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:27.976182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:27.976182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:27.976182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:27.976182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:27.976182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:27.976182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:27.976182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:27.976182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:27.976182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:13:27.976182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:27.976182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 402/807] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:13:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:27.976872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265f5cc-c99d-495b-bd83-dcc321b26f9e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:28.090986 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265f5cc-c99d-495b-bd83-dcc321b26f9e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:28.098485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba67809-a95f-445a-815a-e317097a8627 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:28.110634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:28.131525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec0e1d-12aa-488f-9b05-b00602070f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:28.132166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec0e1d-12aa-488f-9b05-b00602070f48 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:28.132431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec0e1d-12aa-488f-9b05-b00602070f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:28.132701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec0e1d-12aa-488f-9b05-b00602070f48 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:28.133288 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec0e1d-12aa-488f-9b05-b00602070f48 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:28.134670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec0e1d-12aa-488f-9b05-b00602070f48 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:28.136064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c300d-cfc3-48da-a222-cbd6badf84b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:28.136702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c300d-cfc3-48da-a222-cbd6badf84b1 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:28.136978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c300d-cfc3-48da-a222-cbd6badf84b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:28.137250 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c300d-cfc3-48da-a222-cbd6badf84b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-7bec0e1d-12aa-488f-9b05-b00602070f48 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:28.144095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:28.145131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:28.145992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:28.145992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:28.145992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:28.145992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:28.145992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:28.145992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:28.145992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:28.145992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:28.145992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:28.145992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:28.145992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:28.145992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:28.145992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:13:28.145992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:28.146850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c300d-cfc3-48da-a222-cbd6badf84b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:28.147285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 403/808] 10.222.0.59 () {56 vars in 1129 bytes} [Tue Aug 9 11:13:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:28.147285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec0e1d-12aa-488f-9b05-b00602070f48 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:28.150758 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c300d-cfc3-48da-a222-cbd6badf84b1 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-423c300d-cfc3-48da-a222-cbd6badf84b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:28.164560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:28.170604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:28.171802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:28.171802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:28.171802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:28.171802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:28.171802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:28.171802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:28.171802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:28.171802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:28.171802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 406/809] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:28.171802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c300d-cfc3-48da-a222-cbd6badf84b1 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:28.183184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:28.272767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec0e1d-12aa-488f-9b05-b00602070f48 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:28.285337 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c300d-cfc3-48da-a222-cbd6badf84b1 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:28.311709 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ac908-82e1-4b90-8035-d2d899c6b5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:28.312649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ac908-82e1-4b90-8035-d2d899c6b5ef None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:28.313044 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ac908-82e1-4b90-8035-d2d899c6b5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:28.313552 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ac908-82e1-4b90-8035-d2d899c6b5ef None admin] PATH_INFO: `/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/2c0549bc0a3445b48aa7fa7e341f8900/roles/9f750e14956d482c8757564559516c7a` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:28.321055 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc31fb-01b8-4413-be0f-92fc621b0f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:28.321623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc31fb-01b8-4413-be0f-92fc621b0f8e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:28.321897 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc31fb-01b8-4413-be0f-92fc621b0f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:28.322166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc31fb-01b8-4413-be0f-92fc621b0f8e None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:28.322857 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc31fb-01b8-4413-be0f-92fc621b0f8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:28.323159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc31fb-01b8-4413-be0f-92fc621b0f8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:28.324549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc31fb-01b8-4413-be0f-92fc621b0f8e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:28.330892 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ac908-82e1-4b90-8035-d2d899c6b5ef None admin] RBAC: Authorizing `identity:create_grant(project_id=f53fb3d6b68b4654ae7247c9b74015e7, user_id=2c0549bc0a3445b48aa7fa7e341f8900, role_id=9f750e14956d482c8757564559516c7a)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:28.332532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ac908-82e1-4b90-8035-d2d899c6b5ef None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:28.337933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 407/810] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:28.337933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc31fb-01b8-4413-be0f-92fc621b0f8e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:28.350679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 404/811] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:13:28 2022] PUT /identity/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/2c0549bc0a3445b48aa7fa7e341f8900/roles/9f750e14956d482c8757564559516c7a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:13:28.351679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ac908-82e1-4b90-8035-d2d899c6b5ef None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:28.394986 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:28.443024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:28.481122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc31fb-01b8-4413-be0f-92fc621b0f8e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:28.482841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ac908-82e1-4b90-8035-d2d899c6b5ef None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:28.525515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a6ab1-a3d6-43b6-bacf-a028bb00ba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:28.527105 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a6ab1-a3d6-43b6-bacf-a028bb00ba63 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:28.528491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758831b-a3f4-495e-98a2-e5218be69e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:28.528887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a6ab1-a3d6-43b6-bacf-a028bb00ba63 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:28.529300 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a6ab1-a3d6-43b6-bacf-a028bb00ba63 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:28.529458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758831b-a3f4-495e-98a2-e5218be69e80 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:28.530423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a6ab1-a3d6-43b6-bacf-a028bb00ba63 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:28.530727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a6ab1-a3d6-43b6-bacf-a028bb00ba63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:28.532183 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a6ab1-a3d6-43b6-bacf-a028bb00ba63 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:28.533597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758831b-a3f4-495e-98a2-e5218be69e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:28.533915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758831b-a3f4-495e-98a2-e5218be69e80 None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:28.534710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758831b-a3f4-495e-98a2-e5218be69e80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:28.535039 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758831b-a3f4-495e-98a2-e5218be69e80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:28.537087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758831b-a3f4-495e-98a2-e5218be69e80 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:28.542636 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 408/812] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Aug 9 11:13:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:28.543388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a6ab1-a3d6-43b6-bacf-a028bb00ba63 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:28.552339 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 405/813] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:28.553491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758831b-a3f4-495e-98a2-e5218be69e80 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:28.683554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a6ab1-a3d6-43b6-bacf-a028bb00ba63 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:28.684782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:28.698644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758831b-a3f4-495e-98a2-e5218be69e80 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:28.736188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646ade7-a2d9-44d2-88cc-8e0817e286d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:28.736835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646ade7-a2d9-44d2-88cc-8e0817e286d8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:28.737106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646ade7-a2d9-44d2-88cc-8e0817e286d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:28.738905 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646ade7-a2d9-44d2-88cc-8e0817e286d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:28.739745 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:28.750624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646ade7-a2d9-44d2-88cc-8e0817e286d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:28.752122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646ade7-a2d9-44d2-88cc-8e0817e286d8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:28.752781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4235c9-6a80-4be2-a13e-31db33353d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:28.753579 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4235c9-6a80-4be2-a13e-31db33353d96 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:28.754237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4235c9-6a80-4be2-a13e-31db33353d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:28.754668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4235c9-6a80-4be2-a13e-31db33353d96 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:28.755991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4235c9-6a80-4be2-a13e-31db33353d96 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:28.756431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4235c9-6a80-4be2-a13e-31db33353d96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:28.757990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4235c9-6a80-4be2-a13e-31db33353d96 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:28.765218 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 406/814] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Aug 9 11:13:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:28.766342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4235c9-6a80-4be2-a13e-31db33353d96 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-0646ade7-a2d9-44d2-88cc-8e0817e286d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:28.767531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:28.768792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:28.769933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:28.769933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:28.769933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:28.770693 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 409/815] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:28.776399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646ade7-a2d9-44d2-88cc-8e0817e286d8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:28.881347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646ade7-a2d9-44d2-88cc-8e0817e286d8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:28.891998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4235c9-6a80-4be2-a13e-31db33353d96 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:28.917175 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d8a66-2a88-4cd9-aee9-5cc20e1e8425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:28.917808 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d8a66-2a88-4cd9-aee9-5cc20e1e8425 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:28.918081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d8a66-2a88-4cd9-aee9-5cc20e1e8425 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:28.918349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d8a66-2a88-4cd9-aee9-5cc20e1e8425 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:28.919070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d8a66-2a88-4cd9-aee9-5cc20e1e8425 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:28.920476 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d8a66-2a88-4cd9-aee9-5cc20e1e8425 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:28.929881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d6ab9-5267-4b4c-9eb8-203ccfdf7b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:28.930541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6ab9-5267-4b4c-9eb8-203ccfdf7b40 None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:28.930837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6ab9-5267-4b4c-9eb8-203ccfdf7b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:28.931106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6ab9-5267-4b4c-9eb8-203ccfdf7b40 None admin] PATH_INFO: `/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/913447120a2e42d8affdf50bb74dc5aa/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:28.933773 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d6ab9-5267-4b4c-9eb8-203ccfdf7b40 None admin] RBAC: Authorizing `identity:create_grant(project_id=f53fb3d6b68b4654ae7247c9b74015e7, user_id=913447120a2e42d8affdf50bb74dc5aa, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:28.935662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d6ab9-5267-4b4c-9eb8-203ccfdf7b40 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:28.943959 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 410/816] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:13:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:13:28.944929 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d8a66-2a88-4cd9-aee9-5cc20e1e8425 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:28.957069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 407/817] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:13:28 2022] PUT /identity/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/913447120a2e42d8affdf50bb74dc5aa/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:13:28.958558 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325598bd-6a48-4ce7-bff2-1a3bce0439d0 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:28.958990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325598bd-6a48-4ce7-bff2-1a3bce0439d0 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:28.959410 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325598bd-6a48-4ce7-bff2-1a3bce0439d0 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:28.966952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 408/818] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:28.973890 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12dacb-f35c-410f-833a-cbc471056292 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:28.973890 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12dacb-f35c-410f-833a-cbc471056292 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:28.973890 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12dacb-f35c-410f-833a-cbc471056292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:29.009358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-3a12dacb-f35c-410f-833a-cbc471056292 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:29.012540 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-3a12dacb-f35c-410f-833a-cbc471056292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:29.046873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:29.049429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:29.149945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d8a66-2a88-4cd9-aee9-5cc20e1e8425 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:29.165998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 409/819] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:29.188068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12dacb-f35c-410f-833a-cbc471056292 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:29.195664 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd849d5-6f2c-4c95-ad50-df7e95fcf9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:29.196289 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd849d5-6f2c-4c95-ad50-df7e95fcf9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:29.196565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd849d5-6f2c-4c95-ad50-df7e95fcf9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:29.196828 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd849d5-6f2c-4c95-ad50-df7e95fcf9f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:29.197602 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd849d5-6f2c-4c95-ad50-df7e95fcf9f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:29.197905 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd849d5-6f2c-4c95-ad50-df7e95fcf9f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:29.199349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd849d5-6f2c-4c95-ad50-df7e95fcf9f7 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:29.216146 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 411/820] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:29.222005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd849d5-6f2c-4c95-ad50-df7e95fcf9f7 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:29.314254 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12dacb-f35c-410f-833a-cbc471056292 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:29.349782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd849d5-6f2c-4c95-ad50-df7e95fcf9f7 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:29.359238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:29.363586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a69447-4ca4-4c67-8255-12037a08a68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:29.364292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69447-4ca4-4c67-8255-12037a08a68d None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:29.364510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69447-4ca4-4c67-8255-12037a08a68d None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:29.364784 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69447-4ca4-4c67-8255-12037a08a68d None admin] PATH_INFO: `/v3/services/network` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:29.365374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a69447-4ca4-4c67-8255-12037a08a68d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:29.366768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a69447-4ca4-4c67-8255-12037a08a68d None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-54a69447-4ca4-4c67-8255-12037a08a68d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:29.378847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:29.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:29.380791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 410/821] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:29 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:29.386858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a69447-4ca4-4c67-8255-12037a08a68d None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:29.408542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:29.429519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c9fd9-a834-408d-bf33-19a8ff236434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:29.430163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c9fd9-a834-408d-bf33-19a8ff236434 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:29.430527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c9fd9-a834-408d-bf33-19a8ff236434 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:29.430798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c9fd9-a834-408d-bf33-19a8ff236434 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:29.444658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c9fd9-a834-408d-bf33-19a8ff236434 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:29.446144 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c9fd9-a834-408d-bf33-19a8ff236434 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-4e0c9fd9-a834-408d-bf33-19a8ff236434 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:29.462898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:29.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:29.464876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:29.464876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:29.464876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:29.464876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:29.464876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:29.464876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:29.464876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:29.464876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:29.464876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:13:29.464876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:29.464876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 412/822] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Aug 9 11:13:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:29.470703 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c9fd9-a834-408d-bf33-19a8ff236434 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:29.621472 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c9fd9-a834-408d-bf33-19a8ff236434 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:29.634710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a69447-4ca4-4c67-8255-12037a08a68d None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:29.688311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91696383-c5d5-43e8-9684-23d8a941e86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:29.688988 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91696383-c5d5-43e8-9684-23d8a941e86a None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:29.689208 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91696383-c5d5-43e8-9684-23d8a941e86a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:29.689474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91696383-c5d5-43e8-9684-23d8a941e86a None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:29.690215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91696383-c5d5-43e8-9684-23d8a941e86a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:29.691499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91696383-c5d5-43e8-9684-23d8a941e86a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:29.692031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91696383-c5d5-43e8-9684-23d8a941e86a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:29.696293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442a89c-10eb-4bd1-b7a5-0ec9296bedd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:29.696913 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442a89c-10eb-4bd1-b7a5-0ec9296bedd1 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:29.697188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442a89c-10eb-4bd1-b7a5-0ec9296bedd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:29.697455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442a89c-10eb-4bd1-b7a5-0ec9296bedd1 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:29.698094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442a89c-10eb-4bd1-b7a5-0ec9296bedd1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:29.698397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442a89c-10eb-4bd1-b7a5-0ec9296bedd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:29.699800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442a89c-10eb-4bd1-b7a5-0ec9296bedd1 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:29.709537 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 411/823] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Aug 9 11:13:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:29.715072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442a89c-10eb-4bd1-b7a5-0ec9296bedd1 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:29.731237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 413/824] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Aug 9 11:13:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:29.736439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91696383-c5d5-43e8-9684-23d8a941e86a None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:29.762913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:29.843190 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:29.890021 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442a89c-10eb-4bd1-b7a5-0ec9296bedd1 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:29.902301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91696383-c5d5-43e8-9684-23d8a941e86a None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:29.955233 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d3e0c-3e42-410f-9269-3c1a623fd490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:29.955876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d3e0c-3e42-410f-9269-3c1a623fd490 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:29.956168 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d3e0c-3e42-410f-9269-3c1a623fd490 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:29.956433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d3e0c-3e42-410f-9269-3c1a623fd490 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:29.957314 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d3e0c-3e42-410f-9269-3c1a623fd490 None admin] RBAC: Adding query filter params (type=network) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:29.957609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d3e0c-3e42-410f-9269-3c1a623fd490 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:29.959006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d3e0c-3e42-410f-9269-3c1a623fd490 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:29.965984 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd5bc9-c77f-413a-ac3b-3f69381128df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:29.966593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd5bc9-c77f-413a-ac3b-3f69381128df None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:29.966886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd5bc9-c77f-413a-ac3b-3f69381128df None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:29.967204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd5bc9-c77f-413a-ac3b-3f69381128df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:29.972015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 412/825] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Aug 9 11:13:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:29.977535 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d3e0c-3e42-410f-9269-3c1a623fd490 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:30.081472 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd5bc9-c77f-413a-ac3b-3f69381128df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:30.082929 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd5bc9-c77f-413a-ac3b-3f69381128df None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:30.102843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:30.149089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d3e0c-3e42-410f-9269-3c1a623fd490 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:30.190387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 414/826] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:13:30.199853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd5bc9-c77f-413a-ac3b-3f69381128df None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:30.225082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536799b6-36f3-46a3-a0cc-6857b4fceeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:30.226090 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536799b6-36f3-46a3-a0cc-6857b4fceeb8 None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:30.226553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536799b6-36f3-46a3-a0cc-6857b4fceeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:30.227052 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536799b6-36f3-46a3-a0cc-6857b4fceeb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:30.228063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536799b6-36f3-46a3-a0cc-6857b4fceeb8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:30.229654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536799b6-36f3-46a3-a0cc-6857b4fceeb8 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:30.246411 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:30.267951 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 413/827] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:13:29 2022] POST /identity/v3/endpoints => generated 337 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:13:30.349914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd5bc9-c77f-413a-ac3b-3f69381128df None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:30.376906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:30.412195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2a870-0a74-48b4-874e-259893fea861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:30.412911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a870-0a74-48b4-874e-259893fea861 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:30.413184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a870-0a74-48b4-874e-259893fea861 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:30.413446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a870-0a74-48b4-874e-259893fea861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:30.433374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2a870-0a74-48b4-874e-259893fea861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:30.434939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2a870-0a74-48b4-874e-259893fea861 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-eda2a870-0a74-48b4-874e-259893fea861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:30.455892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:30.456961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:30.458261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:30.458261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:30.458261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:30.458261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 415/828] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:30.463245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536799b6-36f3-46a3-a0cc-6857b4fceeb8 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:30.607363 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536799b6-36f3-46a3-a0cc-6857b4fceeb8 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:30.645014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59928b1-d0de-4375-be7a-190bff70d73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:30.646468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59928b1-d0de-4375-be7a-190bff70d73f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:30.646995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59928b1-d0de-4375-be7a-190bff70d73f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:30.647461 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59928b1-d0de-4375-be7a-190bff70d73f None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:30.648338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59928b1-d0de-4375-be7a-190bff70d73f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:30.648855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59928b1-d0de-4375-be7a-190bff70d73f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:30.650495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59928b1-d0de-4375-be7a-190bff70d73f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:30.665378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 414/829] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:30.670635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2a870-0a74-48b4-874e-259893fea861 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:30.708773 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876274ed-ccfb-4fc3-99eb-a8fcdfcc2f5a None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:30.709096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876274ed-ccfb-4fc3-99eb-a8fcdfcc2f5a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:30.709317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876274ed-ccfb-4fc3-99eb-a8fcdfcc2f5a None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:30.710939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 415/830] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:13:30.716115 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead66aa8-97b4-43f7-911b-727d94102082 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:30.716391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead66aa8-97b4-43f7-911b-727d94102082 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:30.716662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead66aa8-97b4-43f7-911b-727d94102082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:30.739478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ead66aa8-97b4-43f7-911b-727d94102082 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:30.741981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ead66aa8-97b4-43f7-911b-727d94102082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:30.801817 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2a870-0a74-48b4-874e-259893fea861 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:30.815490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:30.842178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 416/831] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:30.851933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3f806-43f9-4bd6-aa4d-cb274c5fdee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:30.852957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3f806-43f9-4bd6-aa4d-cb274c5fdee3 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:30.853455 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3f806-43f9-4bd6-aa4d-cb274c5fdee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:30.853913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3f806-43f9-4bd6-aa4d-cb274c5fdee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:30.861779 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3f806-43f9-4bd6-aa4d-cb274c5fdee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:30.863619 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3f806-43f9-4bd6-aa4d-cb274c5fdee3 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:30.866546 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead66aa8-97b4-43f7-911b-727d94102082 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-1fc3f806-43f9-4bd6-aa4d-cb274c5fdee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:30.881750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:30.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:30.884178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:30.884178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:30.884178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:30.884178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:30.884178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:30.884178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:30.884178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:30.884178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:30.885041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 416/832] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:30.889828 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3f806-43f9-4bd6-aa4d-cb274c5fdee3 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:30.925759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:31.008451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead66aa8-97b4-43f7-911b-727d94102082 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:31.038101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3f806-43f9-4bd6-aa4d-cb274c5fdee3 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:31.065425 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369190b-130a-4f5d-895c-30668b1a3239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:31.066444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369190b-130a-4f5d-895c-30668b1a3239 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:31.066903 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369190b-130a-4f5d-895c-30668b1a3239 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:31.067449 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369190b-130a-4f5d-895c-30668b1a3239 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:31.081128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67444219-08f0-4abd-bf7b-8126a6d33705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:31.081901 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67444219-08f0-4abd-bf7b-8126a6d33705 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:31.082483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67444219-08f0-4abd-bf7b-8126a6d33705 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:31.082887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67444219-08f0-4abd-bf7b-8126a6d33705 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:31.083790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67444219-08f0-4abd-bf7b-8126a6d33705 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:31.084145 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369190b-130a-4f5d-895c-30668b1a3239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:31.084311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67444219-08f0-4abd-bf7b-8126a6d33705 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:31.085713 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67444219-08f0-4abd-bf7b-8126a6d33705 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-8369190b-130a-4f5d-895c-30668b1a3239 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:31.091991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:31.093081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:31.093968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:31.093968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:31.093968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:31.093968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:31.093968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:31.093968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:31.093968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:31.093968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:31.093968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:31.093968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:31.093968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:13:31.093968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:31.103038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 417/834] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:31.103277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 417/834] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:13:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:31.105724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67444219-08f0-4abd-bf7b-8126a6d33705 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:31.107091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369190b-130a-4f5d-895c-30668b1a3239 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:31.160927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:31.222179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369190b-130a-4f5d-895c-30668b1a3239 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:31.226796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:31.248171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67444219-08f0-4abd-bf7b-8126a6d33705 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:31.267806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773bd24-6a39-4b41-81ac-0dd3e709fab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:31.268501 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773bd24-6a39-4b41-81ac-0dd3e709fab3 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:31.268779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773bd24-6a39-4b41-81ac-0dd3e709fab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:31.269050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773bd24-6a39-4b41-81ac-0dd3e709fab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:31.270844 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773bd24-6a39-4b41-81ac-0dd3e709fab3 None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=2136cf1160a64951ad780424cb28403b) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:31.271156 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773bd24-6a39-4b41-81ac-0dd3e709fab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:31.272653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773bd24-6a39-4b41-81ac-0dd3e709fab3 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:31.282273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 418/835] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:31 2022] GET /identity/v3/role_assignments?user.id=2136cf1160a64951ad780424cb28403b&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=169d11e171d04c87af71475295957618 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:31.297014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc333b-3117-445e-bdff-798d244d7dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:31.298104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc333b-3117-445e-bdff-798d244d7dba None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:31.298596 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc333b-3117-445e-bdff-798d244d7dba None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:31.299084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc333b-3117-445e-bdff-798d244d7dba None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:31.300163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc333b-3117-445e-bdff-798d244d7dba None admin] RBAC: Adding query filter params (name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:31.300687 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc333b-3117-445e-bdff-798d244d7dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:31.302343 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc333b-3117-445e-bdff-798d244d7dba None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:31.313832 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 418/836] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:13:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:31.320215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773bd24-6a39-4b41-81ac-0dd3e709fab3 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:31.404455 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88cf6-b435-475c-9879-694dd3ae43e4 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:31.404455 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88cf6-b435-475c-9879-694dd3ae43e4 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:31.404782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88cf6-b435-475c-9879-694dd3ae43e4 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:31.406308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 419/837] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:31.413935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2479b-1715-4e9a-bfe2-be521714595e None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:31.414143 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2479b-1715-4e9a-bfe2-be521714595e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:31.414448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2479b-1715-4e9a-bfe2-be521714595e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:31.439395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c7f2479b-1715-4e9a-bfe2-be521714595e None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:31.442304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c7f2479b-1715-4e9a-bfe2-be521714595e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:31.459136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773bd24-6a39-4b41-81ac-0dd3e709fab3 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:31.470455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:31.500732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b21f21-c866-432f-be3b-42fbed843461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:31.501375 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b21f21-c866-432f-be3b-42fbed843461 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:31.501797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b21f21-c866-432f-be3b-42fbed843461 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:31.502652 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b21f21-c866-432f-be3b-42fbed843461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:31.514093 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b21f21-c866-432f-be3b-42fbed843461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:31.515581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b21f21-c866-432f-be3b-42fbed843461 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:31.526473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 420/838] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:31.527963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de812607-28c6-482f-a029-4ff08d9f59b4 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:31.528250 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de812607-28c6-482f-a029-4ff08d9f59b4 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:31.528521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de812607-28c6-482f-a029-4ff08d9f59b4 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:31.530006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 421/839] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-e5b21f21-c866-432f-be3b-42fbed843461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:31.530166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:31.531171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:31.532254 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:31.532254 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:31.532254 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:31.535627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 419/840] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:31.536434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db250-0c97-44aa-a059-7f384984f40d None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:31.536720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db250-0c97-44aa-a059-7f384984f40d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:31.536988 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db250-0c97-44aa-a059-7f384984f40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:31.540700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b21f21-c866-432f-be3b-42fbed843461 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:31.557661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-152db250-0c97-44aa-a059-7f384984f40d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:31.558858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-152db250-0c97-44aa-a059-7f384984f40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:31.626860 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 422/841] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:31.626860 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db250-0c97-44aa-a059-7f384984f40d None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:31.633918 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:31.677212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b21f21-c866-432f-be3b-42fbed843461 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:31.713295 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02edb7b-45e3-469e-a0fe-ef25df458728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:31.713902 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02edb7b-45e3-469e-a0fe-ef25df458728 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:31.714171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02edb7b-45e3-469e-a0fe-ef25df458728 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:31.714433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02edb7b-45e3-469e-a0fe-ef25df458728 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:31.715100 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02edb7b-45e3-469e-a0fe-ef25df458728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:31.715395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02edb7b-45e3-469e-a0fe-ef25df458728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:31.716759 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02edb7b-45e3-469e-a0fe-ef25df458728 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:31.730321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 420/842] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:31.731084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02edb7b-45e3-469e-a0fe-ef25df458728 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:31.733645 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db250-0c97-44aa-a059-7f384984f40d None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:31.753533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:31.772630 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e77f2-b50f-494c-95b3-ccb7a9744779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:31.773722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e77f2-b50f-494c-95b3-ccb7a9744779 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:31.774172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e77f2-b50f-494c-95b3-ccb7a9744779 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:31.774611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e77f2-b50f-494c-95b3-ccb7a9744779 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:31.775516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e77f2-b50f-494c-95b3-ccb7a9744779 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:31.776921 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e77f2-b50f-494c-95b3-ccb7a9744779 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-a64e77f2-b50f-494c-95b3-ccb7a9744779 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:31.786696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:31.787802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:31.789309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 423/843] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:13:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:31.790103 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e77f2-b50f-494c-95b3-ccb7a9744779 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:31.841982 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02edb7b-45e3-469e-a0fe-ef25df458728 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:31.863412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:31.885081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62733520-81ed-4299-a1ba-5d2dc17833ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:31.885831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62733520-81ed-4299-a1ba-5d2dc17833ce None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:31.886171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62733520-81ed-4299-a1ba-5d2dc17833ce None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:31.886446 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62733520-81ed-4299-a1ba-5d2dc17833ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:31.897826 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62733520-81ed-4299-a1ba-5d2dc17833ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:31.898182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e77f2-b50f-494c-95b3-ccb7a9744779 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-62733520-81ed-4299-a1ba-5d2dc17833ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:31.902585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:31.903554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:31.904414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:31.904414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:31.904414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:31.904414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:31.904414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:31.904414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:31.904414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:31.904414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:31.904414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:31.904414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:31.904414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:13:31.904414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:31.904414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 421/844] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:13:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:31.909499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62733520-81ed-4299-a1ba-5d2dc17833ce None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:31.937534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52e2ae-a3c6-4ad3-9d0d-e40b5b5f6880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:31.938077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52e2ae-a3c6-4ad3-9d0d-e40b5b5f6880 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:31.938347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52e2ae-a3c6-4ad3-9d0d-e40b5b5f6880 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:31.938609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52e2ae-a3c6-4ad3-9d0d-e40b5b5f6880 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:31.946928 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52e2ae-a3c6-4ad3-9d0d-e40b5b5f6880 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:31.948361 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52e2ae-a3c6-4ad3-9d0d-e40b5b5f6880 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-2d52e2ae-a3c6-4ad3-9d0d-e40b5b5f6880 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:31.962092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:31.963277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:31.964267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:31.964267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:31.964267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:31.964267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:31.964267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:31.964267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:31.964267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:31.964267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:31.964267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:13:31.964267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:31.964267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 424/845] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Aug 9 11:13:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:31.964267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52e2ae-a3c6-4ad3-9d0d-e40b5b5f6880 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:32.018885 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:32.037417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62733520-81ed-4299-a1ba-5d2dc17833ce None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:32.074524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e196eb8-6507-4e84-964e-bf5b858cc8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:32.075152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e196eb8-6507-4e84-964e-bf5b858cc8aa None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:32.075422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e196eb8-6507-4e84-964e-bf5b858cc8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:32.075688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e196eb8-6507-4e84-964e-bf5b858cc8aa None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:32.076315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e196eb8-6507-4e84-964e-bf5b858cc8aa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:32.076609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e196eb8-6507-4e84-964e-bf5b858cc8aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:32.077986 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e196eb8-6507-4e84-964e-bf5b858cc8aa None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:32.088653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 422/846] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:13:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:32.088653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e196eb8-6507-4e84-964e-bf5b858cc8aa None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:32.109655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52e2ae-a3c6-4ad3-9d0d-e40b5b5f6880 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:32.143502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:32.150048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bee43-3226-4897-94e7-c680bb8d1360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:32.150662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bee43-3226-4897-94e7-c680bb8d1360 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:32.150970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bee43-3226-4897-94e7-c680bb8d1360 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:32.151240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bee43-3226-4897-94e7-c680bb8d1360 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:32.151912 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bee43-3226-4897-94e7-c680bb8d1360 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:32.152213 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bee43-3226-4897-94e7-c680bb8d1360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:32.153634 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bee43-3226-4897-94e7-c680bb8d1360 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:32.162875 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 425/847] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:13:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:32.163040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bee43-3226-4897-94e7-c680bb8d1360 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:32.215805 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e196eb8-6507-4e84-964e-bf5b858cc8aa None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:32.252127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb92ba6-a9b8-465b-bf28-e8e2fd691d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:32.252923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92ba6-a9b8-465b-bf28-e8e2fd691d08 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:32.253197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92ba6-a9b8-465b-bf28-e8e2fd691d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:32.253465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92ba6-a9b8-465b-bf28-e8e2fd691d08 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:32.254320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb92ba6-a9b8-465b-bf28-e8e2fd691d08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:32.254623 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb92ba6-a9b8-465b-bf28-e8e2fd691d08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:32.256203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb92ba6-a9b8-465b-bf28-e8e2fd691d08 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:32.270224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bee43-3226-4897-94e7-c680bb8d1360 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:32.282622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 423/848] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Aug 9 11:13:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:32.283725 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb92ba6-a9b8-465b-bf28-e8e2fd691d08 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:32.286687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:32.306128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb80e9-d8e3-4e2b-9596-d0e2f705f4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:32.306856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb80e9-d8e3-4e2b-9596-d0e2f705f4de None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:32.307197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb80e9-d8e3-4e2b-9596-d0e2f705f4de None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:32.307556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb80e9-d8e3-4e2b-9596-d0e2f705f4de None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:32.308195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb80e9-d8e3-4e2b-9596-d0e2f705f4de None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:32.308475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb80e9-d8e3-4e2b-9596-d0e2f705f4de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:32.309885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb80e9-d8e3-4e2b-9596-d0e2f705f4de None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:32.322847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 426/849] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:13:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:32.322847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb80e9-d8e3-4e2b-9596-d0e2f705f4de None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:32.400251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:32.420982 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb92ba6-a9b8-465b-bf28-e8e2fd691d08 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:32.469656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb80e9-d8e3-4e2b-9596-d0e2f705f4de None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:32.489672 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e405667-9fb0-47f2-b4fd-3f70b2f1629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:32.490938 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e405667-9fb0-47f2-b4fd-3f70b2f1629b None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:32.491419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e405667-9fb0-47f2-b4fd-3f70b2f1629b None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:32.492232 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e405667-9fb0-47f2-b4fd-3f70b2f1629b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:32.508876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e405667-9fb0-47f2-b4fd-3f70b2f1629b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:32.510198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e405667-9fb0-47f2-b4fd-3f70b2f1629b None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:32.517851 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c431c-e361-4b95-9829-240953c1d9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:32.519475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c431c-e361-4b95-9829-240953c1d9dc None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:32.519929 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c431c-e361-4b95-9829-240953c1d9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:32.520360 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c431c-e361-4b95-9829-240953c1d9dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-7e405667-9fb0-47f2-b4fd-3f70b2f1629b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:32.528743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:32.529741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:32.531284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:32.531284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:32.531284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:32.531284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 424/850] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:32.535897 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e405667-9fb0-47f2-b4fd-3f70b2f1629b None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:32.593662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:32.600301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c431c-e361-4b95-9829-240953c1d9dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:32.601861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c431c-e361-4b95-9829-240953c1d9dc None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:32.641826 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e405667-9fb0-47f2-b4fd-3f70b2f1629b None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:32.661398 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:32.677225 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef03dfb-8d9c-4b3e-9559-70db2dd12442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:32.678552 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef03dfb-8d9c-4b3e-9559-70db2dd12442 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:32.679055 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef03dfb-8d9c-4b3e-9559-70db2dd12442 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:32.679622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef03dfb-8d9c-4b3e-9559-70db2dd12442 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:32.680470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef03dfb-8d9c-4b3e-9559-70db2dd12442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:32.680976 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef03dfb-8d9c-4b3e-9559-70db2dd12442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:32.682549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef03dfb-8d9c-4b3e-9559-70db2dd12442 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:32.695429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 425/851] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:32.701083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef03dfb-8d9c-4b3e-9559-70db2dd12442 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:32.721059 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 427/852] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:32 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:13:32.726251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c431c-e361-4b95-9829-240953c1d9dc None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:32.811491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef03dfb-8d9c-4b3e-9559-70db2dd12442 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:32.826985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:32.841050 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c431c-e361-4b95-9829-240953c1d9dc None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:32.849840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce197bf-b409-4248-b537-c144b647dbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:32.850616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce197bf-b409-4248-b537-c144b647dbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:32.850989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce197bf-b409-4248-b537-c144b647dbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:32.851324 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce197bf-b409-4248-b537-c144b647dbc4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:32.860049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce197bf-b409-4248-b537-c144b647dbc4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:32.861298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce197bf-b409-4248-b537-c144b647dbc4 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-5ce197bf-b409-4248-b537-c144b647dbc4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:32.874364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:32.880210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:32.881179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:32.881179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:32.881179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:32.881179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:32.881179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:32.881179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:32.881179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:32.881179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:32.881179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:13:32.881179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:32.881179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 426/853] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:13:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:32.884204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce197bf-b409-4248-b537-c144b647dbc4 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:32.894393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b398e-5060-47b4-9969-76c724f1c0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:32.895765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b398e-5060-47b4-9969-76c724f1c0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:32.896276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b398e-5060-47b4-9969-76c724f1c0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:32.896884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b398e-5060-47b4-9969-76c724f1c0d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:32.909331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b398e-5060-47b4-9969-76c724f1c0d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:32.911464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b398e-5060-47b4-9969-76c724f1c0d6 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-061b398e-5060-47b4-9969-76c724f1c0d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:32.928503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:32.929546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:32.930471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:32.930471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:32.930471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:32.937070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 428/854] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:32.938201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b398e-5060-47b4-9969-76c724f1c0d6 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:32.951440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:32.989148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce197bf-b409-4248-b537-c144b647dbc4 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:33.028663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40253d38-ae17-4f36-a984-d635ab48dd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:33.029273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40253d38-ae17-4f36-a984-d635ab48dd75 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:33.029549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40253d38-ae17-4f36-a984-d635ab48dd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:33.029818 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40253d38-ae17-4f36-a984-d635ab48dd75 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:33.030567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40253d38-ae17-4f36-a984-d635ab48dd75 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:33.030866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40253d38-ae17-4f36-a984-d635ab48dd75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:33.032379 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40253d38-ae17-4f36-a984-d635ab48dd75 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:33.056264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 427/855] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Aug 9 11:13:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:33.057677 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40253d38-ae17-4f36-a984-d635ab48dd75 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:33.071735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b398e-5060-47b4-9969-76c724f1c0d6 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:33.099435 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:33.117573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8e713-2764-4747-acc9-5127d2065580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:33.118713 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8e713-2764-4747-acc9-5127d2065580 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:33.119224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8e713-2764-4747-acc9-5127d2065580 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:33.119690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8e713-2764-4747-acc9-5127d2065580 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:33.120972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8e713-2764-4747-acc9-5127d2065580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:33.121515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8e713-2764-4747-acc9-5127d2065580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:33.123230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8e713-2764-4747-acc9-5127d2065580 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:33.142262 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 429/856] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:33.143628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8e713-2764-4747-acc9-5127d2065580 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:33.175966 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40253d38-ae17-4f36-a984-d635ab48dd75 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:33.210733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77973505-6fb8-41f5-99fb-6e552f32c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:33.211391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973505-6fb8-41f5-99fb-6e552f32c303 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:33.211665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973505-6fb8-41f5-99fb-6e552f32c303 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:33.211934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973505-6fb8-41f5-99fb-6e552f32c303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:33.219882 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:33.259043 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8e713-2764-4747-acc9-5127d2065580 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:33.282857 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77973505-6fb8-41f5-99fb-6e552f32c303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:33.284191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77973505-6fb8-41f5-99fb-6e552f32c303 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:33.298503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19af70-63d4-473f-8b30-57b663c686b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:33.300200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19af70-63d4-473f-8b30-57b663c686b5 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:33.300778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19af70-63d4-473f-8b30-57b663c686b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:33.301264 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19af70-63d4-473f-8b30-57b663c686b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:33.311365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19af70-63d4-473f-8b30-57b663c686b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:33.313919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19af70-63d4-473f-8b30-57b663c686b5 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:33.315555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-1d19af70-63d4-473f-8b30-57b663c686b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:33.332327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:33.333313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:33.334224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:33.334224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:33.334224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:33.334224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:33.334224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:33.334224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:33.334224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:33.334224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:33.341066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 430/857] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:33.343524 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19af70-63d4-473f-8b30-57b663c686b5 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:33.406848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 428/858] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:33 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:13:33.406848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7deda4-9b84-48bc-96e4-914055c9f0cd None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:33.406848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7deda4-9b84-48bc-96e4-914055c9f0cd None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:33.406848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7deda4-9b84-48bc-96e4-914055c9f0cd None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:33.407742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 429/859] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:33.410623 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7deda4-9b84-48bc-96e4-914055c9f0cd None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:33.458744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19af70-63d4-473f-8b30-57b663c686b5 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:33.497921 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:33.507818 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4902420-6915-4095-b70d-230ccffeaab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:33.508441 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902420-6915-4095-b70d-230ccffeaab8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:33.508711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902420-6915-4095-b70d-230ccffeaab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:33.508977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902420-6915-4095-b70d-230ccffeaab8 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:33.509812 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4902420-6915-4095-b70d-230ccffeaab8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:33.510059 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4902420-6915-4095-b70d-230ccffeaab8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:33.511584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4902420-6915-4095-b70d-230ccffeaab8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:33.524732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 431/860] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:33.530691 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e53e-c483-432a-8dc8-3a7ed86560bd None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:33.531008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e53e-c483-432a-8dc8-3a7ed86560bd None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:33.531272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e53e-c483-432a-8dc8-3a7ed86560bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:33.534458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7deda4-9b84-48bc-96e4-914055c9f0cd None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:33.550281 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-d9a5e53e-c483-432a-8dc8-3a7ed86560bd None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:33.551456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d9a5e53e-c483-432a-8dc8-3a7ed86560bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:33.567683 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:33.576921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaecbe6-2742-46ad-a9eb-38bd665cf451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:33.577565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaecbe6-2742-46ad-a9eb-38bd665cf451 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:33.577839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaecbe6-2742-46ad-a9eb-38bd665cf451 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:33.578108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaecbe6-2742-46ad-a9eb-38bd665cf451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:33.589581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaecbe6-2742-46ad-a9eb-38bd665cf451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:33.591168 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaecbe6-2742-46ad-a9eb-38bd665cf451 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-ddaecbe6-2742-46ad-a9eb-38bd665cf451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:33.607065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:33.608202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:33.609140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:33.609140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:33.609140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:33.609140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 430/861] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:33.609140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaecbe6-2742-46ad-a9eb-38bd665cf451 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:33.630380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 432/862] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:33.631642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e53e-c483-432a-8dc8-3a7ed86560bd None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:33.737144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaecbe6-2742-46ad-a9eb-38bd665cf451 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:33.761016 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e53e-c483-432a-8dc8-3a7ed86560bd None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:33.776264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d1aab-1a24-43be-b481-999399e1418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:33.776919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d1aab-1a24-43be-b481-999399e1418a None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:33.777192 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d1aab-1a24-43be-b481-999399e1418a None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:33.777411 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d1aab-1a24-43be-b481-999399e1418a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:33.778150 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d1aab-1a24-43be-b481-999399e1418a None admin] RBAC: Adding query filter params (role.id=9f750e14956d482c8757564559516c7a, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=2c0549bc0a3445b48aa7fa7e341f8900) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:33.778755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d1aab-1a24-43be-b481-999399e1418a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:33.780033 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d1aab-1a24-43be-b481-999399e1418a None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:33.781464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:33.787472 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 431/863] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:33 2022] GET /identity/v3/role_assignments?user.id=2c0549bc0a3445b48aa7fa7e341f8900&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=9f750e14956d482c8757564559516c7a => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:33.788412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d1aab-1a24-43be-b481-999399e1418a None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:33.823903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b47723-431e-419d-8046-49140194765e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:33.824769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b47723-431e-419d-8046-49140194765e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:33.825159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b47723-431e-419d-8046-49140194765e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:33.825431 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b47723-431e-419d-8046-49140194765e None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:33.826353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b47723-431e-419d-8046-49140194765e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:33.826663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b47723-431e-419d-8046-49140194765e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:33.828173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b47723-431e-419d-8046-49140194765e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:33.845097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 433/864] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:33.851741 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b47723-431e-419d-8046-49140194765e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:33.861720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:33.941361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d1aab-1a24-43be-b481-999399e1418a None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:33.986145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b47723-431e-419d-8046-49140194765e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:33.993534 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9632766-2e48-4156-acad-4c300e74955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:33.994498 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9632766-2e48-4156-acad-4c300e74955f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:33.994951 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9632766-2e48-4156-acad-4c300e74955f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:33.995724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9632766-2e48-4156-acad-4c300e74955f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:33.996463 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9632766-2e48-4156-acad-4c300e74955f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:33.998001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9632766-2e48-4156-acad-4c300e74955f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-f9632766-2e48-4156-acad-4c300e74955f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:34.007641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:34.008833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:34.009956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:34.009956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:34.009956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:34.009956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:34.009956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:34.009956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:34.009956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:34.009956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:34.009956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:34.009956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:34.009956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:34.009956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:34.009956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:13:34.009956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:34.012279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 432/865] 10.222.0.59 () {56 vars in 1132 bytes} [Tue Aug 9 11:13:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:34.018911 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9632766-2e48-4156-acad-4c300e74955f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:34.029529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24476e32-abde-42f2-8053-2bb13926d076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:34.030519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24476e32-abde-42f2-8053-2bb13926d076 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:34.030519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24476e32-abde-42f2-8053-2bb13926d076 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:34.030785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24476e32-abde-42f2-8053-2bb13926d076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:34.040557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24476e32-abde-42f2-8053-2bb13926d076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:34.042038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24476e32-abde-42f2-8053-2bb13926d076 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-24476e32-abde-42f2-8053-2bb13926d076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:34.059565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:34.060519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:34.061417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:34.061417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:34.061417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:34.061417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:34.061417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:34.061417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:34.061417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:34.061417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:34.061417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 434/866] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:34.067813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24476e32-abde-42f2-8053-2bb13926d076 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:34.120175 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:34.168491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9632766-2e48-4156-acad-4c300e74955f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:34.192898 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:34.196474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24476e32-abde-42f2-8053-2bb13926d076 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:34.217978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb37dd-ce51-4215-a9d8-cb2439e7c1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:34.218697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb37dd-ce51-4215-a9d8-cb2439e7c1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:34.218985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb37dd-ce51-4215-a9d8-cb2439e7c1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:34.219253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb37dd-ce51-4215-a9d8-cb2439e7c1a1 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:34.219889 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb37dd-ce51-4215-a9d8-cb2439e7c1a1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:34.220194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb37dd-ce51-4215-a9d8-cb2439e7c1a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:34.221745 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb37dd-ce51-4215-a9d8-cb2439e7c1a1 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:34.227572 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 433/867] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Aug 9 11:13:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:34.234216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb37dd-ce51-4215-a9d8-cb2439e7c1a1 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:34.246491 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebdf10c-7462-45c2-94b5-5954af144086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:34.247169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdf10c-7462-45c2-94b5-5954af144086 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:34.247440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdf10c-7462-45c2-94b5-5954af144086 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:34.247751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdf10c-7462-45c2-94b5-5954af144086 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:34.248502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebdf10c-7462-45c2-94b5-5954af144086 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:34.248806 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebdf10c-7462-45c2-94b5-5954af144086 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:34.250451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebdf10c-7462-45c2-94b5-5954af144086 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:34.264894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 435/868] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:34.270767 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebdf10c-7462-45c2-94b5-5954af144086 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:34.360759 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb37dd-ce51-4215-a9d8-cb2439e7c1a1 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:34.381806 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:34.386784 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebdf10c-7462-45c2-94b5-5954af144086 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:34.404285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa2af9-0e07-43be-9d13-88a8b1a79ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:34.404908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa2af9-0e07-43be-9d13-88a8b1a79ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:34.405178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa2af9-0e07-43be-9d13-88a8b1a79ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:34.405446 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa2af9-0e07-43be-9d13-88a8b1a79ae6 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:34.406355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa2af9-0e07-43be-9d13-88a8b1a79ae6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:34.406656 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa2af9-0e07-43be-9d13-88a8b1a79ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:34.408531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa2af9-0e07-43be-9d13-88a8b1a79ae6 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:34.414906 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 434/869] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Aug 9 11:13:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:34.422323 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b2a8e-acd5-435a-9922-c49ce1983f91 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:34.422654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b2a8e-acd5-435a-9922-c49ce1983f91 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:34.424712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b2a8e-acd5-435a-9922-c49ce1983f91 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:34.429420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 435/870] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:34.436528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8074b-9b8b-452a-aff7-9786ef84468f None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:34.437195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8074b-9b8b-452a-aff7-9786ef84468f None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:34.437710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8074b-9b8b-452a-aff7-9786ef84468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:34.439528 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e819154-0e9f-4506-89d1-dbbc51cb3321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:34.440158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819154-0e9f-4506-89d1-dbbc51cb3321 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:34.440538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819154-0e9f-4506-89d1-dbbc51cb3321 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:34.440809 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819154-0e9f-4506-89d1-dbbc51cb3321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:34.441573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e819154-0e9f-4506-89d1-dbbc51cb3321 None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=913447120a2e42d8affdf50bb74dc5aa) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:34.441883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e819154-0e9f-4506-89d1-dbbc51cb3321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:34.443439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e819154-0e9f-4506-89d1-dbbc51cb3321 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:34.454972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 436/871] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:34 2022] GET /identity/v3/role_assignments?user.id=913447120a2e42d8affdf50bb74dc5aa&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=169d11e171d04c87af71475295957618 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:34.460786 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-b2f8074b-9b8b-452a-aff7-9786ef84468f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:34.462447 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b2f8074b-9b8b-452a-aff7-9786ef84468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:34.520467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:34.570041 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 436/872] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:34.593511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e819154-0e9f-4506-89d1-dbbc51cb3321 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:34.713015 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e819154-0e9f-4506-89d1-dbbc51cb3321 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:34.749047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8403a97-06f3-4792-806e-8b66bd4bddb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:34.749661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8403a97-06f3-4792-806e-8b66bd4bddb6 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:34.749938 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8403a97-06f3-4792-806e-8b66bd4bddb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:34.750209 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8403a97-06f3-4792-806e-8b66bd4bddb6 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:34.750906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8403a97-06f3-4792-806e-8b66bd4bddb6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:34.752302 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8403a97-06f3-4792-806e-8b66bd4bddb6 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:34.768429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 437/873] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Aug 9 11:13:34 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:13:35.976616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770b59d-8a9a-4e0d-9205-088813626c80 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:35.977154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770b59d-8a9a-4e0d-9205-088813626c80 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:35.977154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770b59d-8a9a-4e0d-9205-088813626c80 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:35.978788 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 437/874] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:35.984349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122c8fc-0082-4e2d-9a14-a6363fb567b5 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:35.984843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122c8fc-0082-4e2d-9a14-a6363fb567b5 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:35.984925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122c8fc-0082-4e2d-9a14-a6363fb567b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:36.006757 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-3122c8fc-0082-4e2d-9a14-a6363fb567b5 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:36.008224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-3122c8fc-0082-4e2d-9a14-a6363fb567b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:36.029375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:36.093790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 438/875] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:35 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:36.116885 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770b59d-8a9a-4e0d-9205-088813626c80 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:36.236143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770b59d-8a9a-4e0d-9205-088813626c80 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:36.276116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997465fd-c8a0-425a-8f76-500d655f7d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:36.277129 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997465fd-c8a0-425a-8f76-500d655f7d7f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:36.277587 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997465fd-c8a0-425a-8f76-500d655f7d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:36.278041 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997465fd-c8a0-425a-8f76-500d655f7d7f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:36.289619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997465fd-c8a0-425a-8f76-500d655f7d7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-997465fd-c8a0-425a-8f76-500d655f7d7f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:36.294620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:36.295664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:36.296555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:36.296555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:36.296555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:36.296555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:36.296555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:36.296555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:36.296555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:36.296555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:36.296555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:36.296555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:36.296555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:13:36.296555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:36.298992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 438/876] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Aug 9 11:13:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:36.306841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122c8fc-0082-4e2d-9a14-a6363fb567b5 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:36.433023 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122c8fc-0082-4e2d-9a14-a6363fb567b5 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:36.469613 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c6070-a3d1-4321-8df8-22afb490d656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:36.470232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c6070-a3d1-4321-8df8-22afb490d656 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:36.470507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c6070-a3d1-4321-8df8-22afb490d656 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:36.470778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c6070-a3d1-4321-8df8-22afb490d656 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:36.471532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c6070-a3d1-4321-8df8-22afb490d656 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:36.471834 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c6070-a3d1-4321-8df8-22afb490d656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:36.473317 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c6070-a3d1-4321-8df8-22afb490d656 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:36.483014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 439/877] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Aug 9 11:13:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:36.489069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997465fd-c8a0-425a-8f76-500d655f7d7f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:36.524108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:36.598714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb8011-c01b-45f3-86cb-161127ce9150 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:36.599022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb8011-c01b-45f3-86cb-161127ce9150 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:36.599276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb8011-c01b-45f3-86cb-161127ce9150 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:36.599389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997465fd-c8a0-425a-8f76-500d655f7d7f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:36.600791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 440/878] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:13:36.606191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70448a-b1f5-4a60-8b7a-66919e400ecb None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:36.606491 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70448a-b1f5-4a60-8b7a-66919e400ecb None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:36.606732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70448a-b1f5-4a60-8b7a-66919e400ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:36.625550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-ff70448a-b1f5-4a60-8b7a-66919e400ecb None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:36.626726 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ff70448a-b1f5-4a60-8b7a-66919e400ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:36.631119 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:36.644902 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15815f0b-b5d6-496f-a676-1599a17462f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:36.645972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15815f0b-b5d6-496f-a676-1599a17462f0 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:36.646637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15815f0b-b5d6-496f-a676-1599a17462f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:36.647046 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15815f0b-b5d6-496f-a676-1599a17462f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:36.659218 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15815f0b-b5d6-496f-a676-1599a17462f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:36.661098 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15815f0b-b5d6-496f-a676-1599a17462f0 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-15815f0b-b5d6-496f-a676-1599a17462f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:36.684299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:36.686049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:36.687511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:36.687511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:36.687511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:36.687511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 439/879] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:36.687511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f62e5-78d6-4ec8-84d3-061b5d77daf5 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:36.687511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f62e5-78d6-4ec8-84d3-061b5d77daf5 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:36.687511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f62e5-78d6-4ec8-84d3-061b5d77daf5 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:36.690868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 440/880] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:36.691661 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f62e5-78d6-4ec8-84d3-061b5d77daf5 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:36.709108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 441/881] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:36.710644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d031009-796f-461e-805b-bbf6ddbf7c2a None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:36.711085 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d031009-796f-461e-805b-bbf6ddbf7c2a None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:36.711209 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d031009-796f-461e-805b-bbf6ddbf7c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:36.735147 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-2d031009-796f-461e-805b-bbf6ddbf7c2a None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:36.737489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-2d031009-796f-461e-805b-bbf6ddbf7c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:36.795081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:36.818672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 442/882] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:36.820004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d031009-796f-461e-805b-bbf6ddbf7c2a None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:36.830395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f62e5-78d6-4ec8-84d3-061b5d77daf5 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:36.873935 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f12a10-7588-40a1-b51e-60427f80b9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:36.874531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f12a10-7588-40a1-b51e-60427f80b9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:36.874805 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f12a10-7588-40a1-b51e-60427f80b9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:36.875094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f12a10-7588-40a1-b51e-60427f80b9b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:36.875750 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f12a10-7588-40a1-b51e-60427f80b9b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:36.876050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f12a10-7588-40a1-b51e-60427f80b9b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:36.877447 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f12a10-7588-40a1-b51e-60427f80b9b8 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:36.890353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 441/883] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:36.891644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f12a10-7588-40a1-b51e-60427f80b9b8 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:36.905440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:36.937822 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d031009-796f-461e-805b-bbf6ddbf7c2a None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:36.976399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babdb32-c226-4b76-ae22-ac38704bc65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:36.977035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babdb32-c226-4b76-ae22-ac38704bc65d None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:36.977304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babdb32-c226-4b76-ae22-ac38704bc65d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:36.977574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babdb32-c226-4b76-ae22-ac38704bc65d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:36.978163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babdb32-c226-4b76-ae22-ac38704bc65d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:36.979610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babdb32-c226-4b76-ae22-ac38704bc65d None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-0babdb32-c226-4b76-ae22-ac38704bc65d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:36.988769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:36.990435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:36.992080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 443/884] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Aug 9 11:13:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:36.993485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f784071-c63a-4ba2-8e30-1686575df2ce None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:36.993485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f784071-c63a-4ba2-8e30-1686575df2ce None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:36.993485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f784071-c63a-4ba2-8e30-1686575df2ce None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:36.993485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 444/885] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:36.993867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f784071-c63a-4ba2-8e30-1686575df2ce None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:37.005066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f12a10-7588-40a1-b51e-60427f80b9b8 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:37.039815 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e7f9a-4a5c-466f-8ab8-3287be1f20de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:37.040431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7f9a-4a5c-466f-8ab8-3287be1f20de None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:37.040702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7f9a-4a5c-466f-8ab8-3287be1f20de None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:37.040973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7f9a-4a5c-466f-8ab8-3287be1f20de None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:37.041624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e7f9a-4a5c-466f-8ab8-3287be1f20de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:37.043045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e7f9a-4a5c-466f-8ab8-3287be1f20de None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:37.059957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 442/886] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Aug 9 11:13:36 2022] POST /identity/v3/services => generated 269 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:13:37.060724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e7f9a-4a5c-466f-8ab8-3287be1f20de None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:37.063397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:37.120609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f784071-c63a-4ba2-8e30-1686575df2ce None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:37.153278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:37.160310 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701cfdd-c17e-41ee-9cb6-14d52d573a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:37.160954 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701cfdd-c17e-41ee-9cb6-14d52d573a3c None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:37.161224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701cfdd-c17e-41ee-9cb6-14d52d573a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:37.161487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701cfdd-c17e-41ee-9cb6-14d52d573a3c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:37.170180 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701cfdd-c17e-41ee-9cb6-14d52d573a3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:37.171709 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701cfdd-c17e-41ee-9cb6-14d52d573a3c None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-c701cfdd-c17e-41ee-9cb6-14d52d573a3c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:37.184604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:37.186087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:37.187127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:37.187127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:37.187127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:37.187127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:37.187127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:37.187127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:37.187127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:37.187127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:37.187127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:13:37.187127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:37.187127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 445/887] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Aug 9 11:13:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:37.187773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0fea8-815e-4dbe-95ff-b8b94d7ed952 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:37.187773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0fea8-815e-4dbe-95ff-b8b94d7ed952 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:37.187911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0fea8-815e-4dbe-95ff-b8b94d7ed952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:37.207476 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-14c0fea8-815e-4dbe-95ff-b8b94d7ed952 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:37.208682 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-14c0fea8-815e-4dbe-95ff-b8b94d7ed952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:37.220147 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e7f9a-4a5c-466f-8ab8-3287be1f20de None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:37.260208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db046210-666b-493c-9811-37bc783e40cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:37.260819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db046210-666b-493c-9811-37bc783e40cb None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:37.261085 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db046210-666b-493c-9811-37bc783e40cb None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:37.261348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db046210-666b-493c-9811-37bc783e40cb None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:37.261975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db046210-666b-493c-9811-37bc783e40cb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:37.262274 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db046210-666b-493c-9811-37bc783e40cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:37.263686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db046210-666b-493c-9811-37bc783e40cb None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:37.268881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 443/888] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Aug 9 11:13:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:37.269522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db046210-666b-493c-9811-37bc783e40cb None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:37.289759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 446/889] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:37.290620 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0fea8-815e-4dbe-95ff-b8b94d7ed952 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:37.346095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:37.387699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db046210-666b-493c-9811-37bc783e40cb None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:37.394919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0fea8-815e-4dbe-95ff-b8b94d7ed952 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:37.418975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:37.428749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1454d06-6616-4779-8c5e-682ead9a08fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:37.429372 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1454d06-6616-4779-8c5e-682ead9a08fc None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:37.429646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1454d06-6616-4779-8c5e-682ead9a08fc None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:37.429920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1454d06-6616-4779-8c5e-682ead9a08fc None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:37.430652 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1454d06-6616-4779-8c5e-682ead9a08fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:37.430984 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1454d06-6616-4779-8c5e-682ead9a08fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:37.432438 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1454d06-6616-4779-8c5e-682ead9a08fc None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:37.435055 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92780a94-8488-454f-b308-c404e7b3db56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:37.435661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92780a94-8488-454f-b308-c404e7b3db56 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:37.435932 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92780a94-8488-454f-b308-c404e7b3db56 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:37.436260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92780a94-8488-454f-b308-c404e7b3db56 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:37.436893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92780a94-8488-454f-b308-c404e7b3db56 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:37.437189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92780a94-8488-454f-b308-c404e7b3db56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:37.438541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92780a94-8488-454f-b308-c404e7b3db56 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:37.443609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 447/890] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Aug 9 11:13:37 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:37.444413 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92780a94-8488-454f-b308-c404e7b3db56 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:37.468042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 444/891] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Aug 9 11:13:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:37.469344 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1454d06-6616-4779-8c5e-682ead9a08fc None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:37.577389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92780a94-8488-454f-b308-c404e7b3db56 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:37.622678 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1454d06-6616-4779-8c5e-682ead9a08fc None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:37.626647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28a547-e404-43da-af5e-580b84d66827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:37.627446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28a547-e404-43da-af5e-580b84d66827 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:37.627888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28a547-e404-43da-af5e-580b84d66827 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:37.628247 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28a547-e404-43da-af5e-580b84d66827 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:37.628938 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28a547-e404-43da-af5e-580b84d66827 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:37.630415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28a547-e404-43da-af5e-580b84d66827 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-1a28a547-e404-43da-af5e-580b84d66827 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:37.640063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:37.641113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:37.642204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 448/892] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:13:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:37.647339 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28a547-e404-43da-af5e-580b84d66827 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:37.668997 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806631a-e736-4d21-a2c0-6fb3fca1201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:37.669685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806631a-e736-4d21-a2c0-6fb3fca1201c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:37.670118 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:37.670914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806631a-e736-4d21-a2c0-6fb3fca1201c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:37.671117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806631a-e736-4d21-a2c0-6fb3fca1201c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:37.716673 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:37.762559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806631a-e736-4d21-a2c0-6fb3fca1201c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:37.764054 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806631a-e736-4d21-a2c0-6fb3fca1201c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:37.795272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28a547-e404-43da-af5e-580b84d66827 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:37.840466 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d907e5-656b-4c8c-9d87-298667ca11db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:37.841976 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d907e5-656b-4c8c-9d87-298667ca11db None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:37.842453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d907e5-656b-4c8c-9d87-298667ca11db None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:37.842953 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d907e5-656b-4c8c-9d87-298667ca11db None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:37.844155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d907e5-656b-4c8c-9d87-298667ca11db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:37.844962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d907e5-656b-4c8c-9d87-298667ca11db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:37.846947 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d907e5-656b-4c8c-9d87-298667ca11db None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:37.854003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 449/893] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:13:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:37.860592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d907e5-656b-4c8c-9d87-298667ca11db None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:37.874265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 445/894] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:37 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 11:13:37.879845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806631a-e736-4d21-a2c0-6fb3fca1201c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:37.913631 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:37.991797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d907e5-656b-4c8c-9d87-298667ca11db None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:38.008070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:38.016952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806631a-e736-4d21-a2c0-6fb3fca1201c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:38.050573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7ee8f-ec05-43d2-a2db-1f6beb27bf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:38.051601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7ee8f-ec05-43d2-a2db-1f6beb27bf67 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:38.052100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7ee8f-ec05-43d2-a2db-1f6beb27bf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:38.053300 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7ee8f-ec05-43d2-a2db-1f6beb27bf67 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:38.054180 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7ee8f-ec05-43d2-a2db-1f6beb27bf67 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:38.054965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7ee8f-ec05-43d2-a2db-1f6beb27bf67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:38.056744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7ee8f-ec05-43d2-a2db-1f6beb27bf67 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:38.064173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 450/895] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:13:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:38.070791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7ee8f-ec05-43d2-a2db-1f6beb27bf67 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:38.072177 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab85686-f9a9-4976-b76b-93e19c42b8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:38.072817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85686-f9a9-4976-b76b-93e19c42b8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:38.073089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85686-f9a9-4976-b76b-93e19c42b8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:38.073355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85686-f9a9-4976-b76b-93e19c42b8c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:38.086649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab85686-f9a9-4976-b76b-93e19c42b8c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:38.088192 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab85686-f9a9-4976-b76b-93e19c42b8c4 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-cab85686-f9a9-4976-b76b-93e19c42b8c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:38.107508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:38.108555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:38.109463 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:38.109463 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:38.109463 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:38.109463 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 446/896] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:38.114205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab85686-f9a9-4976-b76b-93e19c42b8c4 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:38.184331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7ee8f-ec05-43d2-a2db-1f6beb27bf67 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:38.212667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:38.227314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bd919-43c5-4c95-b23c-ffb39be683e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:38.228376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bd919-43c5-4c95-b23c-ffb39be683e4 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:38.228934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bd919-43c5-4c95-b23c-ffb39be683e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:38.229377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bd919-43c5-4c95-b23c-ffb39be683e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:38.230312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bd919-43c5-4c95-b23c-ffb39be683e4 None admin] RBAC: Adding query filter params (interface=public, service_id=5de317ceae2a47beadf43660a5e76888, region_id=RegionOne) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:38.230849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bd919-43c5-4c95-b23c-ffb39be683e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:38.232687 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bd919-43c5-4c95-b23c-ffb39be683e4 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:38.243496 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab85686-f9a9-4976-b76b-93e19c42b8c4 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:38.244088 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 451/897] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Aug 9 11:13:38 2022] GET /identity/v3/endpoints?service_id=5de317ceae2a47beadf43660a5e76888&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:38.245631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bd919-43c5-4c95-b23c-ffb39be683e4 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:38.287574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc648f4b-0b7b-4969-a55d-4f5a051968f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:38.288193 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc648f4b-0b7b-4969-a55d-4f5a051968f6 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:38.288468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc648f4b-0b7b-4969-a55d-4f5a051968f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:38.288737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc648f4b-0b7b-4969-a55d-4f5a051968f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:38.289389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc648f4b-0b7b-4969-a55d-4f5a051968f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:38.289690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc648f4b-0b7b-4969-a55d-4f5a051968f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:38.291158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc648f4b-0b7b-4969-a55d-4f5a051968f6 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:38.294718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:38.310336 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 447/898] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:38.315584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc648f4b-0b7b-4969-a55d-4f5a051968f6 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:38.366095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bd919-43c5-4c95-b23c-ffb39be683e4 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:38.402671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0af95-c6d0-40a0-b309-5bc15d8a7829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:38.403588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0af95-c6d0-40a0-b309-5bc15d8a7829 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:38.404009 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0af95-c6d0-40a0-b309-5bc15d8a7829 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:38.404510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0af95-c6d0-40a0-b309-5bc15d8a7829 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:38.405283 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0af95-c6d0-40a0-b309-5bc15d8a7829 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:38.407064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0af95-c6d0-40a0-b309-5bc15d8a7829 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:38.419144 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 452/899] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Aug 9 11:13:38 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:13:38.451042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc648f4b-0b7b-4969-a55d-4f5a051968f6 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:38.491859 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d3d7b-a53c-425b-aa78-f84bbcb8da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:38.492530 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d3d7b-a53c-425b-aa78-f84bbcb8da7a None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:38.492891 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d3d7b-a53c-425b-aa78-f84bbcb8da7a None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:38.493164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d3d7b-a53c-425b-aa78-f84bbcb8da7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:38.497076 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:38.502458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d3d7b-a53c-425b-aa78-f84bbcb8da7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:38.504429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d3d7b-a53c-425b-aa78-f84bbcb8da7a None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-3e3d3d7b-a53c-425b-aa78-f84bbcb8da7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:38.517570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:38.518647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:38.519599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:38.519599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:38.519599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:38.519599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:38.519599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:38.519599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:38.519599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:38.519599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:38.519599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 448/900] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:38.525137 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0af95-c6d0-40a0-b309-5bc15d8a7829 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:38.640631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0af95-c6d0-40a0-b309-5bc15d8a7829 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:38.643618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:38.677271 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b85fe-8ded-4ebe-9c06-56fc6ff348dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:38.678178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b85fe-8ded-4ebe-9c06-56fc6ff348dc None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:38.678599 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b85fe-8ded-4ebe-9c06-56fc6ff348dc None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:38.679040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b85fe-8ded-4ebe-9c06-56fc6ff348dc None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:38.679897 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b85fe-8ded-4ebe-9c06-56fc6ff348dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:38.680352 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b85fe-8ded-4ebe-9c06-56fc6ff348dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:38.681946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b85fe-8ded-4ebe-9c06-56fc6ff348dc None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:38.695785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 453/901] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:38.704293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d3d7b-a53c-425b-aa78-f84bbcb8da7a None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:38.804500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d3d7b-a53c-425b-aa78-f84bbcb8da7a None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:38.839691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10002ede-7201-498c-a336-0fe85837a6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:38.840303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10002ede-7201-498c-a336-0fe85837a6ac None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:38.840571 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10002ede-7201-498c-a336-0fe85837a6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:38.840837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10002ede-7201-498c-a336-0fe85837a6ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:38.841574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10002ede-7201-498c-a336-0fe85837a6ac None admin] RBAC: Adding query filter params (role.id=3af90443fd0d4f55a3440b82ea610fff, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=2c0549bc0a3445b48aa7fa7e341f8900) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:38.841875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10002ede-7201-498c-a336-0fe85837a6ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:38.843332 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10002ede-7201-498c-a336-0fe85837a6ac None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:38.849594 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 449/902] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:38 2022] GET /identity/v3/role_assignments?user.id=2c0549bc0a3445b48aa7fa7e341f8900&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=3af90443fd0d4f55a3440b82ea610fff => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:39.127563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d259c59-3b1c-4fbc-8786-0cf173ca6252 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:39.128205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d259c59-3b1c-4fbc-8786-0cf173ca6252 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:39.128205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d259c59-3b1c-4fbc-8786-0cf173ca6252 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:39.129710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 454/903] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:39.135607 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd297f6-99d6-4eb6-97b7-9a34946772a9 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:39.136554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd297f6-99d6-4eb6-97b7-9a34946772a9 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:39.137023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd297f6-99d6-4eb6-97b7-9a34946772a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:39.157215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-dcd297f6-99d6-4eb6-97b7-9a34946772a9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:39.158796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-dcd297f6-99d6-4eb6-97b7-9a34946772a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:39.241973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:39.261857 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 450/904] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:39.284126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d259c59-3b1c-4fbc-8786-0cf173ca6252 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:39.404421 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d259c59-3b1c-4fbc-8786-0cf173ca6252 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:39.439770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c1602-5334-4194-8990-47402c2bf207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:39.440454 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c1602-5334-4194-8990-47402c2bf207 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:39.440727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c1602-5334-4194-8990-47402c2bf207 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:39.440994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c1602-5334-4194-8990-47402c2bf207 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:39.441587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c1602-5334-4194-8990-47402c2bf207 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:39.443027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c1602-5334-4194-8990-47402c2bf207 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-ae6c1602-5334-4194-8990-47402c2bf207 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:39.452743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:39.453754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:39.454631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 455/905] 10.222.0.59 () {56 vars in 1132 bytes} [Tue Aug 9 11:13:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:39.462047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd297f6-99d6-4eb6-97b7-9a34946772a9 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:39.552204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c650b82-32ae-485a-81c4-ee06604844f3 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:39.552550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c650b82-32ae-485a-81c4-ee06604844f3 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:39.552737 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c650b82-32ae-485a-81c4-ee06604844f3 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:39.554418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 456/906] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:13:39.560466 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcd48d-8378-496b-8349-6d2912712179 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:39.560785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcd48d-8378-496b-8349-6d2912712179 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:39.561027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcd48d-8378-496b-8349-6d2912712179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:39.583964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-dabcd48d-8378-496b-8349-6d2912712179 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:39.585362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-dabcd48d-8378-496b-8349-6d2912712179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:39.595171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd297f6-99d6-4eb6-97b7-9a34946772a9 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:39.613922 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:39.639863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fd95e-1d09-4517-a0a0-fc9f705a7bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:39.640526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fd95e-1d09-4517-a0a0-fc9f705a7bfd None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:39.641247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fd95e-1d09-4517-a0a0-fc9f705a7bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:39.641520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fd95e-1d09-4517-a0a0-fc9f705a7bfd None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:39.642497 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fd95e-1d09-4517-a0a0-fc9f705a7bfd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:39.642800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fd95e-1d09-4517-a0a0-fc9f705a7bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:39.644643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fd95e-1d09-4517-a0a0-fc9f705a7bfd None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:39.652573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 451/907] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Aug 9 11:13:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:39.658480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fd95e-1d09-4517-a0a0-fc9f705a7bfd None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:39.678634 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 457/908] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:39.700659 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcd48d-8378-496b-8349-6d2912712179 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:39.731053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:39.789644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fd95e-1d09-4517-a0a0-fc9f705a7bfd None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:39.810300 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcd48d-8378-496b-8349-6d2912712179 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:39.832634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ff96-933e-4e37-8c9c-cfb096576572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:39.833256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ff96-933e-4e37-8c9c-cfb096576572 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:39.833823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ff96-933e-4e37-8c9c-cfb096576572 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:39.834101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ff96-933e-4e37-8c9c-cfb096576572 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:39.834732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2ff96-933e-4e37-8c9c-cfb096576572 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:39.835228 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2ff96-933e-4e37-8c9c-cfb096576572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:39.837203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2ff96-933e-4e37-8c9c-cfb096576572 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:39.847523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94f1b9-4cfd-4b56-ad57-a2f22d075abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:39.848281 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94f1b9-4cfd-4b56-ad57-a2f22d075abe None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:39.848553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 452/909] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Aug 9 11:13:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:39.849114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94f1b9-4cfd-4b56-ad57-a2f22d075abe None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:39.849577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94f1b9-4cfd-4b56-ad57-a2f22d075abe None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:39.849993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ff96-933e-4e37-8c9c-cfb096576572 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:39.850528 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94f1b9-4cfd-4b56-ad57-a2f22d075abe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:39.852191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94f1b9-4cfd-4b56-ad57-a2f22d075abe None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:39.875145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 458/910] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Aug 9 11:13:39 2022] POST /identity/v3/services => generated 241 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:13:39.966689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ff96-933e-4e37-8c9c-cfb096576572 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:39.986552 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:40.012357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd619aeb-c5d9-4f64-bc8a-2c6c9ad69b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:40.012996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd619aeb-c5d9-4f64-bc8a-2c6c9ad69b2c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:40.013278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd619aeb-c5d9-4f64-bc8a-2c6c9ad69b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:40.013550 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd619aeb-c5d9-4f64-bc8a-2c6c9ad69b2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:40.014278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd619aeb-c5d9-4f64-bc8a-2c6c9ad69b2c None admin] RBAC: Adding query filter params (interface=public, service_id=cbdbc5c50ed14e8e8e83bcc1e440b129, region_id=RegionOne) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:40.014590 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd619aeb-c5d9-4f64-bc8a-2c6c9ad69b2c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:40.016064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd619aeb-c5d9-4f64-bc8a-2c6c9ad69b2c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:40.025902 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 453/911] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Aug 9 11:13:39 2022] GET /identity/v3/endpoints?service_id=cbdbc5c50ed14e8e8e83bcc1e440b129&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:40.031815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94f1b9-4cfd-4b56-ad57-a2f22d075abe None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:40.054040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:40.147879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94f1b9-4cfd-4b56-ad57-a2f22d075abe None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:40.183545 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204983f-0c42-4173-9b89-2c609d1a5c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:40.184169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204983f-0c42-4173-9b89-2c609d1a5c4e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:40.184442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204983f-0c42-4173-9b89-2c609d1a5c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:40.184711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204983f-0c42-4173-9b89-2c609d1a5c4e None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:40.185326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204983f-0c42-4173-9b89-2c609d1a5c4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:40.186717 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204983f-0c42-4173-9b89-2c609d1a5c4e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:40.193745 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 459/912] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Aug 9 11:13:40 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:13:40.597990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b78ba0-b444-4270-8f5d-2002f6042917 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:40.599078 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b78ba0-b444-4270-8f5d-2002f6042917 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:40.599578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b78ba0-b444-4270-8f5d-2002f6042917 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:40.601413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 454/913] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:40.607324 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcb6bd-3dab-435b-84ff-22bbe98aa1f4 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:40.607891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcb6bd-3dab-435b-84ff-22bbe98aa1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:40.608385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcb6bd-3dab-435b-84ff-22bbe98aa1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:40.628088 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-e4bcb6bd-3dab-435b-84ff-22bbe98aa1f4 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:40.629641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e4bcb6bd-3dab-435b-84ff-22bbe98aa1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:40.704373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 460/914] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:40.726570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b78ba0-b444-4270-8f5d-2002f6042917 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:40.837785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b78ba0-b444-4270-8f5d-2002f6042917 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:40.873502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641043c-09d5-4b0b-999b-505ec57f5d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:40.874138 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641043c-09d5-4b0b-999b-505ec57f5d63 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:40.874412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641043c-09d5-4b0b-999b-505ec57f5d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:40.874682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641043c-09d5-4b0b-999b-505ec57f5d63 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:40.875299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641043c-09d5-4b0b-999b-505ec57f5d63 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:40.876675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641043c-09d5-4b0b-999b-505ec57f5d63 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-6641043c-09d5-4b0b-999b-505ec57f5d63 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:40.885975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:40.887019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:40.887896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 455/915] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:13:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:40.896152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcb6bd-3dab-435b-84ff-22bbe98aa1f4 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:40.915211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:40.994967 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a05b-05fc-4b1c-a2aa-4679a364ad37 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:40.995565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a05b-05fc-4b1c-a2aa-4679a364ad37 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:40.995836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a05b-05fc-4b1c-a2aa-4679a364ad37 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:40.997378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 456/916] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:13:41.003852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa0d36-3a00-4314-9123-d78865b067ec None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:41.004275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa0d36-3a00-4314-9123-d78865b067ec None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:41.004420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcb6bd-3dab-435b-84ff-22bbe98aa1f4 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:41.004721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa0d36-3a00-4314-9123-d78865b067ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:41.033006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-b8aa0d36-3a00-4314-9123-d78865b067ec None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:41.035034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b8aa0d36-3a00-4314-9123-d78865b067ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:41.047062 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dead9-42a0-4511-94c8-6719d341ae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:41.047771 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dead9-42a0-4511-94c8-6719d341ae22 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:41.048509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dead9-42a0-4511-94c8-6719d341ae22 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:41.048787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dead9-42a0-4511-94c8-6719d341ae22 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:41.049878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dead9-42a0-4511-94c8-6719d341ae22 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:41.050190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dead9-42a0-4511-94c8-6719d341ae22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:41.051944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dead9-42a0-4511-94c8-6719d341ae22 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:41.058947 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 461/917] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:13:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:41.064791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dead9-42a0-4511-94c8-6719d341ae22 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:41.077419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:41.117212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 457/918] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:41.139941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa0d36-3a00-4314-9123-d78865b067ec None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:41.168936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:41.198742 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dead9-42a0-4511-94c8-6719d341ae22 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:41.237487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec689120-d0ef-4857-859a-67081595b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:41.238418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec689120-d0ef-4857-859a-67081595b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:41.238930 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec689120-d0ef-4857-859a-67081595b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:41.239257 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec689120-d0ef-4857-859a-67081595b5b1 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:41.239902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec689120-d0ef-4857-859a-67081595b5b1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:41.240209 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec689120-d0ef-4857-859a-67081595b5b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:41.241591 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec689120-d0ef-4857-859a-67081595b5b1 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:41.250431 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 462/919] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Aug 9 11:13:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:41.260076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec689120-d0ef-4857-859a-67081595b5b1 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:41.277290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa0d36-3a00-4314-9123-d78865b067ec None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:41.314993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000edea-c7be-48e4-a964-82d87da6a1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:41.315743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000edea-c7be-48e4-a964-82d87da6a1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:41.316014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000edea-c7be-48e4-a964-82d87da6a1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:41.316324 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000edea-c7be-48e4-a964-82d87da6a1a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:41.329665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000edea-c7be-48e4-a964-82d87da6a1a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-8000edea-c7be-48e4-a964-82d87da6a1a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:41.335858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:41.336845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:41.337682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:41.337682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:41.337682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:41.337682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:41.337682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:41.337682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:41.337682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:41.337682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:41.337682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:41.337682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:41.337682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:13:41.337682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:41.337682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 458/920] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Aug 9 11:13:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:41.343300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000edea-c7be-48e4-a964-82d87da6a1a7 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:41.384821 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:41.404409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec689120-d0ef-4857-859a-67081595b5b1 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:41.445925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c19046-d7bd-48d9-be38-92af2e8f930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:41.446795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19046-d7bd-48d9-be38-92af2e8f930c None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:41.447238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19046-d7bd-48d9-be38-92af2e8f930c None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:41.447668 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19046-d7bd-48d9-be38-92af2e8f930c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:41.448467 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c19046-d7bd-48d9-be38-92af2e8f930c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:41.450565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c19046-d7bd-48d9-be38-92af2e8f930c None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:41.463508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:41.485279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000edea-c7be-48e4-a964-82d87da6a1a7 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:41.496236 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 463/921] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:13:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:13:41.548020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b055d-9a7e-4580-a37e-4da2c99762ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:41.548602 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b055d-9a7e-4580-a37e-4da2c99762ff None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:41.548932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b055d-9a7e-4580-a37e-4da2c99762ff None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:41.549203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b055d-9a7e-4580-a37e-4da2c99762ff None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:41.549952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b055d-9a7e-4580-a37e-4da2c99762ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:41.550253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b055d-9a7e-4580-a37e-4da2c99762ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:41.551939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b055d-9a7e-4580-a37e-4da2c99762ff None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:41.563117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 459/922] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Aug 9 11:13:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:41.571806 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c19046-d7bd-48d9-be38-92af2e8f930c None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:41.709502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c19046-d7bd-48d9-be38-92af2e8f930c None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:41.753934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86854946-5424-4bd0-b804-dd312779e955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:41.755027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86854946-5424-4bd0-b804-dd312779e955 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:41.755440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86854946-5424-4bd0-b804-dd312779e955 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:41.755844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86854946-5424-4bd0-b804-dd312779e955 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:41.771270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86854946-5424-4bd0-b804-dd312779e955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:41.772982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86854946-5424-4bd0-b804-dd312779e955 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-86854946-5424-4bd0-b804-dd312779e955 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:41.789766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:41.791091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:41.792206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:41.792206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:41.792206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:41.793956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 464/923] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:41.799778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b055d-9a7e-4580-a37e-4da2c99762ff None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:41.906147 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b055d-9a7e-4580-a37e-4da2c99762ff None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:41.911158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:41.944030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f0dc2-12e4-4c56-ba58-d9804f91a591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:41.944643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f0dc2-12e4-4c56-ba58-d9804f91a591 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:41.944908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f0dc2-12e4-4c56-ba58-d9804f91a591 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:41.945169 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f0dc2-12e4-4c56-ba58-d9804f91a591 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:41.945811 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f0dc2-12e4-4c56-ba58-d9804f91a591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:41.946148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f0dc2-12e4-4c56-ba58-d9804f91a591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:41.947557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f0dc2-12e4-4c56-ba58-d9804f91a591 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:41.960202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 460/924] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:41.965811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86854946-5424-4bd0-b804-dd312779e955 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:42.021156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:42.030265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850f54b-95bf-4f07-a6c5-abe86ed51ab8 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:42.030580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850f54b-95bf-4f07-a6c5-abe86ed51ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:42.030855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850f54b-95bf-4f07-a6c5-abe86ed51ab8 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:42.032909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 461/925] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:13:42.038024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8619f3-874c-43d9-8117-aa80cfacb307 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:42.038606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8619f3-874c-43d9-8117-aa80cfacb307 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:42.039119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8619f3-874c-43d9-8117-aa80cfacb307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:42.059572 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-fc8619f3-874c-43d9-8117-aa80cfacb307 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:42.061304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-fc8619f3-874c-43d9-8117-aa80cfacb307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:42.094575 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86854946-5424-4bd0-b804-dd312779e955 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:42.136948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683c222-315f-4cae-b7fe-71c095eabce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:42.138090 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683c222-315f-4cae-b7fe-71c095eabce8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:42.138561 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683c222-315f-4cae-b7fe-71c095eabce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:42.139077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683c222-315f-4cae-b7fe-71c095eabce8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:42.147080 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 462/926] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:42.148885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683c222-315f-4cae-b7fe-71c095eabce8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:42.150614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683c222-315f-4cae-b7fe-71c095eabce8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:42.169329 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8619f3-874c-43d9-8117-aa80cfacb307 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-b683c222-315f-4cae-b7fe-71c095eabce8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:42.170107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:42.171389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:42.172349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:42.172349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:42.172349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:42.172349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:42.172349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:42.172349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:42.172349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:42.172349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:42.172349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:13:42.172349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:42.175308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 465/927] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Aug 9 11:13:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:42.184249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683c222-315f-4cae-b7fe-71c095eabce8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:42.313958 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683c222-315f-4cae-b7fe-71c095eabce8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:42.317203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:42.324254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:42.350911 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8619f3-874c-43d9-8117-aa80cfacb307 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:42.351154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3367a-0a5e-4b57-bcaf-c1858465bf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:42.351576 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3367a-0a5e-4b57-bcaf-c1858465bf16 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:42.351849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3367a-0a5e-4b57-bcaf-c1858465bf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:42.352111 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3367a-0a5e-4b57-bcaf-c1858465bf16 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:42.352855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3367a-0a5e-4b57-bcaf-c1858465bf16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:42.353155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3367a-0a5e-4b57-bcaf-c1858465bf16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:42.354608 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3367a-0a5e-4b57-bcaf-c1858465bf16 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:42.379778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 466/928] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Aug 9 11:13:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:42.379778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f45e11-b14c-4597-a174-905453fb5467 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:42.379778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f45e11-b14c-4597-a174-905453fb5467 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:42.379778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f45e11-b14c-4597-a174-905453fb5467 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:42.382802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 467/929] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:42.384021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6d56f-b742-4e02-9239-9885b149b827 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:42.384295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6d56f-b742-4e02-9239-9885b149b827 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:42.384564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6d56f-b742-4e02-9239-9885b149b827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:42.403905 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-fcd6d56f-b742-4e02-9239-9885b149b827 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:42.405113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-fcd6d56f-b742-4e02-9239-9885b149b827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:42.411657 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c346b-79e7-448c-9fd8-4c962c234e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:42.412729 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c346b-79e7-448c-9fd8-4c962c234e5e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:42.413176 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c346b-79e7-448c-9fd8-4c962c234e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:42.413765 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c346b-79e7-448c-9fd8-4c962c234e5e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:42.414736 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c346b-79e7-448c-9fd8-4c962c234e5e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:42.417332 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c346b-79e7-448c-9fd8-4c962c234e5e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-5d0c346b-79e7-448c-9fd8-4c962c234e5e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:42.431524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:42.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:42.433972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 463/930] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Aug 9 11:13:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:42.435055 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c346b-79e7-448c-9fd8-4c962c234e5e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:42.505882 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 468/931] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:42.505882 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6d56f-b742-4e02-9239-9885b149b827 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:42.568125 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c346b-79e7-448c-9fd8-4c962c234e5e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:42.608507 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd9983-284a-48a5-a80a-d092862d907d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:42.609144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd9983-284a-48a5-a80a-d092862d907d None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:42.609429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd9983-284a-48a5-a80a-d092862d907d None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:42.609700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd9983-284a-48a5-a80a-d092862d907d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:42.622341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd9983-284a-48a5-a80a-d092862d907d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:42.623898 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd9983-284a-48a5-a80a-d092862d907d None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:42.626924 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:42.628824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:42.637161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6d56f-b742-4e02-9239-9885b149b827 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-9ffd9983-284a-48a5-a80a-d092862d907d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:42.640172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:42.641130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:42.642024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:42.642024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:42.642024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:42.642024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 464/932] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:42.642258 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd9983-284a-48a5-a80a-d092862d907d None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:42.683606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b9041-b75c-4018-970b-3015e23eacdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:42.684231 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b9041-b75c-4018-970b-3015e23eacdb None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:42.684633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b9041-b75c-4018-970b-3015e23eacdb None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:42.684879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b9041-b75c-4018-970b-3015e23eacdb None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:42.685648 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b9041-b75c-4018-970b-3015e23eacdb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:42.685804 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b9041-b75c-4018-970b-3015e23eacdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:42.687235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b9041-b75c-4018-970b-3015e23eacdb None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:42.697415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 469/933] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Aug 9 11:13:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:42.697415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b9041-b75c-4018-970b-3015e23eacdb None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:42.772889 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd9983-284a-48a5-a80a-d092862d907d None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:42.809810 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8f12d-0435-4b5d-a186-aeadc419fad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:42.810571 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8f12d-0435-4b5d-a186-aeadc419fad0 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:42.810731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8f12d-0435-4b5d-a186-aeadc419fad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:42.811072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8f12d-0435-4b5d-a186-aeadc419fad0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:42.811587 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8f12d-0435-4b5d-a186-aeadc419fad0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:42.812975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8f12d-0435-4b5d-a186-aeadc419fad0 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:42.814387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b9041-b75c-4018-970b-3015e23eacdb None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-7fe8f12d-0435-4b5d-a186-aeadc419fad0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:42.824909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:42.825973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:42.826896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 465/934] 10.222.0.59 () {56 vars in 1132 bytes} [Tue Aug 9 11:13:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:42.828728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8f12d-0435-4b5d-a186-aeadc419fad0 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:42.858904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754fba4-d400-4db5-ac66-611eb2d51c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:42.859487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754fba4-d400-4db5-ac66-611eb2d51c0e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:42.859819 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754fba4-d400-4db5-ac66-611eb2d51c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:42.860014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754fba4-d400-4db5-ac66-611eb2d51c0e None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:42.860663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754fba4-d400-4db5-ac66-611eb2d51c0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:42.860957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754fba4-d400-4db5-ac66-611eb2d51c0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:42.862381 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754fba4-d400-4db5-ac66-611eb2d51c0e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:42.880802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 470/935] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:42.880802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754fba4-d400-4db5-ac66-611eb2d51c0e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:42.897210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:42.905763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:42.942067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8f12d-0435-4b5d-a186-aeadc419fad0 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:42.978513 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c920a5-c073-4235-89ed-1abf9ab41f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:42.979174 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c920a5-c073-4235-89ed-1abf9ab41f73 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:42.979448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c920a5-c073-4235-89ed-1abf9ab41f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:42.980071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c920a5-c073-4235-89ed-1abf9ab41f73 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:42.980334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c920a5-c073-4235-89ed-1abf9ab41f73 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:42.980628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c920a5-c073-4235-89ed-1abf9ab41f73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:42.981999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c920a5-c073-4235-89ed-1abf9ab41f73 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:42.987496 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 466/936] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Aug 9 11:13:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:42.988078 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c920a5-c073-4235-89ed-1abf9ab41f73 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:42.998214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754fba4-d400-4db5-ac66-611eb2d51c0e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:43.033076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8bb5d-bad3-4278-970a-ecb976eb6fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:43.033689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8bb5d-bad3-4278-970a-ecb976eb6fcb None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:43.034027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8bb5d-bad3-4278-970a-ecb976eb6fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:43.034322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8bb5d-bad3-4278-970a-ecb976eb6fcb None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:43.034982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8bb5d-bad3-4278-970a-ecb976eb6fcb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:43.035328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8bb5d-bad3-4278-970a-ecb976eb6fcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:43.036715 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8bb5d-bad3-4278-970a-ecb976eb6fcb None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:43.046964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 471/937] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Aug 9 11:13:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:43.046964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8bb5d-bad3-4278-970a-ecb976eb6fcb None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:43.095143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c920a5-c073-4235-89ed-1abf9ab41f73 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:43.119560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:43.132738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faa881-2412-43b9-9d7b-30b9902d0450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:43.133376 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faa881-2412-43b9-9d7b-30b9902d0450 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:43.133650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faa881-2412-43b9-9d7b-30b9902d0450 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:43.133917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faa881-2412-43b9-9d7b-30b9902d0450 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:43.139845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:43.140998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faa881-2412-43b9-9d7b-30b9902d0450 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:43.142541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faa881-2412-43b9-9d7b-30b9902d0450 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-34faa881-2412-43b9-9d7b-30b9902d0450 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:43.154020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:43.155024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:43.155971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:43.155971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:43.155971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:43.155971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:43.155971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:43.155971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:43.155971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:43.155971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:43.155971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 467/938] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:43.155971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faa881-2412-43b9-9d7b-30b9902d0450 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:43.164460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8bb5d-bad3-4278-970a-ecb976eb6fcb None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:43.202156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc759b-6742-42b6-9cf3-29f375e7c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:43.202859 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc759b-6742-42b6-9cf3-29f375e7c9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:43.203140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc759b-6742-42b6-9cf3-29f375e7c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:43.203407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc759b-6742-42b6-9cf3-29f375e7c9a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:43.204348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc759b-6742-42b6-9cf3-29f375e7c9a7 None admin] RBAC: Adding query filter params (interface=public, service_id=dfb532c0344e4206b7bcc1a875ba61cc, region_id=RegionOne) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:43.204460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc759b-6742-42b6-9cf3-29f375e7c9a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:43.206198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc759b-6742-42b6-9cf3-29f375e7c9a7 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:43.212102 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 472/939] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Aug 9 11:13:43 2022] GET /identity/v3/endpoints?service_id=dfb532c0344e4206b7bcc1a875ba61cc&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:43.212840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc759b-6742-42b6-9cf3-29f375e7c9a7 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:43.273267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faa881-2412-43b9-9d7b-30b9902d0450 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:43.309097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfa292-b211-4787-ad67-1d014afb250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:43.309721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfa292-b211-4787-ad67-1d014afb250f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:43.310008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfa292-b211-4787-ad67-1d014afb250f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:43.310267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfa292-b211-4787-ad67-1d014afb250f None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:43.311055 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfa292-b211-4787-ad67-1d014afb250f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:43.311358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfa292-b211-4787-ad67-1d014afb250f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:43.312847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfa292-b211-4787-ad67-1d014afb250f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:43.323114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 468/940] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Aug 9 11:13:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:43.323114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfa292-b211-4787-ad67-1d014afb250f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:43.323400 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc759b-6742-42b6-9cf3-29f375e7c9a7 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:43.358408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e93d3b-0ca8-42fe-8884-e3a32f8b3567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:43.359050 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e93d3b-0ca8-42fe-8884-e3a32f8b3567 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:43.359321 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e93d3b-0ca8-42fe-8884-e3a32f8b3567 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:43.359584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e93d3b-0ca8-42fe-8884-e3a32f8b3567 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:43.360272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e93d3b-0ca8-42fe-8884-e3a32f8b3567 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:43.360567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e93d3b-0ca8-42fe-8884-e3a32f8b3567 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:43.362026 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e93d3b-0ca8-42fe-8884-e3a32f8b3567 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:43.374431 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 473/941] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:43.375303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:43.376142 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e93d3b-0ca8-42fe-8884-e3a32f8b3567 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:43.389261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:43.437524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfa292-b211-4787-ad67-1d014afb250f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:43.493007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7eaed-17d1-44d7-b47c-794e64d3349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:43.494015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7eaed-17d1-44d7-b47c-794e64d3349a None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:43.494516 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7eaed-17d1-44d7-b47c-794e64d3349a None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:43.495046 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7eaed-17d1-44d7-b47c-794e64d3349a None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:43.496431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7eaed-17d1-44d7-b47c-794e64d3349a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:43.498149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7eaed-17d1-44d7-b47c-794e64d3349a None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:43.518853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 469/942] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Aug 9 11:13:43 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:13:43.519081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e93d3b-0ca8-42fe-8884-e3a32f8b3567 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:43.519205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7eaed-17d1-44d7-b47c-794e64d3349a None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:43.567324 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6ee70-1684-48c1-badf-7cae3dc8bacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:43.568010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6ee70-1684-48c1-badf-7cae3dc8bacd None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:43.568282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6ee70-1684-48c1-badf-7cae3dc8bacd None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:43.568585 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6ee70-1684-48c1-badf-7cae3dc8bacd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:43.569957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6ee70-1684-48c1-badf-7cae3dc8bacd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:43.571426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6ee70-1684-48c1-badf-7cae3dc8bacd None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:43.602754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 474/943] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:13:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:13:43.631948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc11f3e-d361-4c36-b2a4-0f09cf5520b2 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:43.632184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc11f3e-d361-4c36-b2a4-0f09cf5520b2 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:43.632392 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc11f3e-d361-4c36-b2a4-0f09cf5520b2 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:43.634054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 475/944] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:13:43.639844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40873d3-60de-4fab-8f9f-a1d6673e7c58 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:43.640124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40873d3-60de-4fab-8f9f-a1d6673e7c58 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:43.640400 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40873d3-60de-4fab-8f9f-a1d6673e7c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:43.660472 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c40873d3-60de-4fab-8f9f-a1d6673e7c58 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:43.660745 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7eaed-17d1-44d7-b47c-794e64d3349a None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:43.661727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c40873d3-60de-4fab-8f9f-a1d6673e7c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:43.684101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:43.726273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7f9e1-d2f1-4b2e-914f-09324ec4ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:43.727126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7f9e1-d2f1-4b2e-914f-09324ec4ad3f None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:43.727408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7f9e1-d2f1-4b2e-914f-09324ec4ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:43.728736 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7f9e1-d2f1-4b2e-914f-09324ec4ad3f None admin] PATH_INFO: `/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/2c0549bc0a3445b48aa7fa7e341f8900/roles/3af90443fd0d4f55a3440b82ea610fff` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:43.731100 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7f9e1-d2f1-4b2e-914f-09324ec4ad3f None admin] RBAC: Authorizing `identity:create_grant(project_id=f53fb3d6b68b4654ae7247c9b74015e7, user_id=2c0549bc0a3445b48aa7fa7e341f8900, role_id=3af90443fd0d4f55a3440b82ea610fff)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:43.732734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7f9e1-d2f1-4b2e-914f-09324ec4ad3f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:43.749595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:43.756835 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 470/945] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:13:43 2022] PUT /identity/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/2c0549bc0a3445b48aa7fa7e341f8900/roles/3af90443fd0d4f55a3440b82ea610fff => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:13:43.769547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 476/946] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:43.794493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7f9e1-d2f1-4b2e-914f-09324ec4ad3f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:43.924921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7f9e1-d2f1-4b2e-914f-09324ec4ad3f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:43.967127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0180ab0-8e79-4005-a383-6041875d212e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:43.967744 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0180ab0-8e79-4005-a383-6041875d212e None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:43.968015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0180ab0-8e79-4005-a383-6041875d212e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:43.968280 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0180ab0-8e79-4005-a383-6041875d212e None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:43.968997 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0180ab0-8e79-4005-a383-6041875d212e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:43.970437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0180ab0-8e79-4005-a383-6041875d212e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:43.973101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: WARNING keystone.server.flask.common [None req-d0180ab0-8e79-4005-a383-6041875d212e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 09 11:13:43.994852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.sql.core [None req-d0180ab0-8e79-4005-a383-6041875d212e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 11:13:43.994852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 11:13:43.994852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [parameters: {'id': 'e0cb1625ee894da89111691616739fd2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 11:13:43.994852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80054) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 11:13:44.002529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-d0180ab0-8e79-4005-a383-6041875d212e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e0cb1625ee894da89111691616739fd2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e0cb1625ee894da89111691616739fd2. Aug 09 11:13:44.002529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:44.002529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 11:13:44.002529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 11:13:44.002529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 11:13:44.002529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 11:13:44.002529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 11:13:44.002529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 11:13:44.002529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 11:13:44.002529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application conn.query(q) Aug 09 11:13:44.002529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 11:13:44.002529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 11:13:44.002529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application result.read() Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 09 11:13:44.003428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application next(self.gen) Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application yield resource Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application next(self.gen) Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise self.value Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application session.commit() Aug 09 11:13:44.004397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.session.flush() Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application compat.raise_( Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 11:13:44.005302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 11:13:44.006208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application conn.query(q) Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application result.read() Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 11:13:44.007126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [parameters: {'id': 'e0cb1625ee894da89111691616739fd2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:44.009120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:44.011017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:44.013141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:44.013141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 09 11:13:44.013141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 09 11:13:44.013141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:44.013141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:44.013141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 09 11:13:44.013141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 09 11:13:44.013141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e0cb1625ee894da89111691616739fd2. Aug 09 11:13:44.013141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:44.013141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 471/947] 10.222.0.59 () {60 vars in 1140 bytes} [Tue Aug 9 11:13:43 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:44.015910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40873d3-60de-4fab-8f9f-a1d6673e7c58 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:44.129279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40873d3-60de-4fab-8f9f-a1d6673e7c58 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:44.166541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6af201-12c8-41ca-9bff-adb9eb16e677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:44.167206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af201-12c8-41ca-9bff-adb9eb16e677 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:44.167478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af201-12c8-41ca-9bff-adb9eb16e677 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:44.167744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af201-12c8-41ca-9bff-adb9eb16e677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:44.175268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6af201-12c8-41ca-9bff-adb9eb16e677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:44.176661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6af201-12c8-41ca-9bff-adb9eb16e677 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-1b6af201-12c8-41ca-9bff-adb9eb16e677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:44.188666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:44.189628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:44.190606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:44.190606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:44.190606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:44.190606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:44.190606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:44.190606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:44.190606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:44.190606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:44.190606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 477/948] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:44.195929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0180ab0-8e79-4005-a383-6041875d212e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:44.224620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:44.306158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0180ab0-8e79-4005-a383-6041875d212e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:44.340803 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b90e1-3f54-484b-8336-a7a5d7762c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:44.341461 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b90e1-3f54-484b-8336-a7a5d7762c20 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:44.341740 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b90e1-3f54-484b-8336-a7a5d7762c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:44.341999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b90e1-3f54-484b-8336-a7a5d7762c20 None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:44.342666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b90e1-3f54-484b-8336-a7a5d7762c20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:44.342994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b90e1-3f54-484b-8336-a7a5d7762c20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:44.344689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b90e1-3f54-484b-8336-a7a5d7762c20 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:44.366728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 472/949] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Aug 9 11:13:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:45.725270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5e8a1-b439-4450-a81b-7e2b6af2956e None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:45.725780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5e8a1-b439-4450-a81b-7e2b6af2956e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:45.725780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5e8a1-b439-4450-a81b-7e2b6af2956e None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:45.727480 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 478/950] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:45.733238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf69a25-2059-4675-85f6-75995df36453 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:45.733724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf69a25-2059-4675-85f6-75995df36453 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:45.733813 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf69a25-2059-4675-85f6-75995df36453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:45.753050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-0bf69a25-2059-4675-85f6-75995df36453 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:45.754555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-0bf69a25-2059-4675-85f6-75995df36453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:45.831013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 473/951] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:45.838853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a696d-6b80-49f9-b158-4d8d4a0944d5 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:45.839158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a696d-6b80-49f9-b158-4d8d4a0944d5 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:45.839631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a696d-6b80-49f9-b158-4d8d4a0944d5 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:45.841406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 479/952] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:45.847136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d2097-9321-4d54-9e0e-dbc9531f2aff None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:45.847409 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d2097-9321-4d54-9e0e-dbc9531f2aff None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:45.847679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d2097-9321-4d54-9e0e-dbc9531f2aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:45.852388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a696d-6b80-49f9-b158-4d8d4a0944d5 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:45.867312 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-9b4d2097-9321-4d54-9e0e-dbc9531f2aff None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:45.868600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9b4d2097-9321-4d54-9e0e-dbc9531f2aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:45.914142 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:45.920970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:45.940347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 474/953] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:45.942001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9955d6-40c7-4489-b0bf-bb38733b756b None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:45.942484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9955d6-40c7-4489-b0bf-bb38733b756b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:45.942986 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9955d6-40c7-4489-b0bf-bb38733b756b None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:45.944855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 475/954] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:45.950028 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aec3a-9f42-45e2-b197-c46a3fd0244a None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:45.950304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aec3a-9f42-45e2-b197-c46a3fd0244a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:45.950573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aec3a-9f42-45e2-b197-c46a3fd0244a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:45.970109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-945aec3a-9f42-45e2-b197-c46a3fd0244a None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:45.971547 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-945aec3a-9f42-45e2-b197-c46a3fd0244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:45.975598 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a696d-6b80-49f9-b158-4d8d4a0944d5 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:46.011578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d916d-6343-48fe-8333-cbd9b39ec169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:46.012161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d916d-6343-48fe-8333-cbd9b39ec169 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:46.012437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d916d-6343-48fe-8333-cbd9b39ec169 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:46.012705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d916d-6343-48fe-8333-cbd9b39ec169 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:46.013298 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d916d-6343-48fe-8333-cbd9b39ec169 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:46.014696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d916d-6343-48fe-8333-cbd9b39ec169 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-941d916d-6343-48fe-8333-cbd9b39ec169 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:46.024500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:46.031288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:46.032351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 480/955] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Aug 9 11:13:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:46.033228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d916d-6343-48fe-8333-cbd9b39ec169 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:46.053261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 476/956] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:46.054199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aec3a-9f42-45e2-b197-c46a3fd0244a None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:46.138574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d916d-6343-48fe-8333-cbd9b39ec169 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:46.145549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:46.159579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:46.175339 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aec3a-9f42-45e2-b197-c46a3fd0244a None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:46.178125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469ecb9-f23c-4f22-a570-ae02b1da53d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:46.178768 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469ecb9-f23c-4f22-a570-ae02b1da53d7 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:46.179141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469ecb9-f23c-4f22-a570-ae02b1da53d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:46.179408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469ecb9-f23c-4f22-a570-ae02b1da53d7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:46.179999 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469ecb9-f23c-4f22-a570-ae02b1da53d7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:46.181387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469ecb9-f23c-4f22-a570-ae02b1da53d7 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-b469ecb9-f23c-4f22-a570-ae02b1da53d7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:46.190536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:46.191853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:46.193190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 481/957] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:46.193985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469ecb9-f23c-4f22-a570-ae02b1da53d7 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:46.221842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bb5ab-1df9-4942-9da1-7ddf65cc7f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:46.222489 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bb5ab-1df9-4942-9da1-7ddf65cc7f23 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:46.222791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bb5ab-1df9-4942-9da1-7ddf65cc7f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:46.223069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bb5ab-1df9-4942-9da1-7ddf65cc7f23 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:46.223717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bb5ab-1df9-4942-9da1-7ddf65cc7f23 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:46.224015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bb5ab-1df9-4942-9da1-7ddf65cc7f23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:46.225407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bb5ab-1df9-4942-9da1-7ddf65cc7f23 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:46.235249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 477/958] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Aug 9 11:13:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:46.235249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bb5ab-1df9-4942-9da1-7ddf65cc7f23 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:46.305885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469ecb9-f23c-4f22-a570-ae02b1da53d7 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:46.339979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bb5ab-1df9-4942-9da1-7ddf65cc7f23 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:46.340910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc74bd0-0ad8-4c30-983b-304a9ddb8271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:46.341585 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc74bd0-0ad8-4c30-983b-304a9ddb8271 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:46.341863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc74bd0-0ad8-4c30-983b-304a9ddb8271 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:46.342132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc74bd0-0ad8-4c30-983b-304a9ddb8271 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:46.353722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc74bd0-0ad8-4c30-983b-304a9ddb8271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-fcc74bd0-0ad8-4c30-983b-304a9ddb8271 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:46.358981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:46.360011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:46.366260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:46.366260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:46.366260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:46.366260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:46.366260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:46.366260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:46.366260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:46.366260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:46.366260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:46.366260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:46.366260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:13:46.366260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:46.366260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 482/959] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Aug 9 11:13:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:46.366260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc74bd0-0ad8-4c30-983b-304a9ddb8271 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:46.383649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73d4e8-4e59-4d4a-8068-91153f71e624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:46.384209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d4e8-4e59-4d4a-8068-91153f71e624 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:46.384482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d4e8-4e59-4d4a-8068-91153f71e624 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:46.384751 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d4e8-4e59-4d4a-8068-91153f71e624 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:46.385365 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73d4e8-4e59-4d4a-8068-91153f71e624 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:46.385681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73d4e8-4e59-4d4a-8068-91153f71e624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:46.387074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73d4e8-4e59-4d4a-8068-91153f71e624 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:46.392511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 478/960] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Aug 9 11:13:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:46.393267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73d4e8-4e59-4d4a-8068-91153f71e624 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:46.396101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:46.420979 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:46.488294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc74bd0-0ad8-4c30-983b-304a9ddb8271 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:46.503644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73d4e8-4e59-4d4a-8068-91153f71e624 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:46.521934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05da88-6b68-4d53-9df3-05b0502f02ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:46.522543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05da88-6b68-4d53-9df3-05b0502f02ba None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:46.522829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05da88-6b68-4d53-9df3-05b0502f02ba None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:46.523113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05da88-6b68-4d53-9df3-05b0502f02ba None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:46.523746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05da88-6b68-4d53-9df3-05b0502f02ba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:46.524045 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05da88-6b68-4d53-9df3-05b0502f02ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:46.525442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05da88-6b68-4d53-9df3-05b0502f02ba None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:46.530695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 483/961] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Aug 9 11:13:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:46.531507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05da88-6b68-4d53-9df3-05b0502f02ba None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:46.537630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b0e40-7d70-47bb-91ee-fb2add2ab0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:46.538273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b0e40-7d70-47bb-91ee-fb2add2ab0ea None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:46.538546 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b0e40-7d70-47bb-91ee-fb2add2ab0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:46.538831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b0e40-7d70-47bb-91ee-fb2add2ab0ea None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:46.539471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b0e40-7d70-47bb-91ee-fb2add2ab0ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:46.539771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b0e40-7d70-47bb-91ee-fb2add2ab0ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:46.541168 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b0e40-7d70-47bb-91ee-fb2add2ab0ea None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:46.554045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 479/962] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Aug 9 11:13:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:46.554045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de3941-600e-41d8-905b-6ffd0667bc70 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:46.554045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de3941-600e-41d8-905b-6ffd0667bc70 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:46.554045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de3941-600e-41d8-905b-6ffd0667bc70 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:46.554045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 480/963] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:46.554045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de3941-600e-41d8-905b-6ffd0667bc70 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:46.619173 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:46.639124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05da88-6b68-4d53-9df3-05b0502f02ba None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:46.646005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:46.660847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de3941-600e-41d8-905b-6ffd0667bc70 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:46.672944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594e4d1-348e-4661-b6bb-de90c4188309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:46.673557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594e4d1-348e-4661-b6bb-de90c4188309 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:46.673835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594e4d1-348e-4661-b6bb-de90c4188309 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:46.674102 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594e4d1-348e-4661-b6bb-de90c4188309 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:46.674797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594e4d1-348e-4661-b6bb-de90c4188309 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:46.675122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594e4d1-348e-4661-b6bb-de90c4188309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:46.676609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594e4d1-348e-4661-b6bb-de90c4188309 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:46.680998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 484/964] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Aug 9 11:13:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:46.681774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594e4d1-348e-4661-b6bb-de90c4188309 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:46.705974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e9c6f-032c-4404-90fc-ab458be7bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:46.706699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e9c6f-032c-4404-90fc-ab458be7bb55 None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:46.707033 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e9c6f-032c-4404-90fc-ab458be7bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:46.707303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e9c6f-032c-4404-90fc-ab458be7bb55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:46.707999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e9c6f-032c-4404-90fc-ab458be7bb55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:46.709434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e9c6f-032c-4404-90fc-ab458be7bb55 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:46.746948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 481/965] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:13:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:13:46.746948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a875f7-2b59-4c19-bacf-c9a8290018cb None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:46.746948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a875f7-2b59-4c19-bacf-c9a8290018cb None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:46.746948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a875f7-2b59-4c19-bacf-c9a8290018cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:46.764486 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-f8a875f7-2b59-4c19-bacf-c9a8290018cb None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:46.765758 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f8a875f7-2b59-4c19-bacf-c9a8290018cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:46.845377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594e4d1-348e-4661-b6bb-de90c4188309 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:46.869934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 482/966] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:46.890974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb629a2-0d1f-43aa-9b9d-d6f742157166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:46.891905 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb629a2-0d1f-43aa-9b9d-d6f742157166 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:46.892176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb629a2-0d1f-43aa-9b9d-d6f742157166 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:46.892447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb629a2-0d1f-43aa-9b9d-d6f742157166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:46.897481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a875f7-2b59-4c19-bacf-c9a8290018cb None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:46.905529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb629a2-0d1f-43aa-9b9d-d6f742157166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:46.909538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb629a2-0d1f-43aa-9b9d-d6f742157166 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-cfb629a2-0d1f-43aa-9b9d-d6f742157166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:46.926881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:46.927903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:46.928801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:46.928801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:46.928801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:46.928801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 485/967] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:46.933671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb629a2-0d1f-43aa-9b9d-d6f742157166 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:46.964019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:46.967141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:47.041581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a875f7-2b59-4c19-bacf-c9a8290018cb None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:47.066185 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb629a2-0d1f-43aa-9b9d-d6f742157166 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:47.088970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9e1d7-5043-4622-b260-5cf982e7519b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:47.089821 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9e1d7-5043-4622-b260-5cf982e7519b None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:47.090102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9e1d7-5043-4622-b260-5cf982e7519b None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:47.090393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9e1d7-5043-4622-b260-5cf982e7519b None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:47.091594 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9e1d7-5043-4622-b260-5cf982e7519b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:47.093415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9e1d7-5043-4622-b260-5cf982e7519b None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:47.101834 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cf343-13d2-481c-8cd3-cd8d69cfbcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:47.102584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cf343-13d2-481c-8cd3-cd8d69cfbcff None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:47.103000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cf343-13d2-481c-8cd3-cd8d69cfbcff None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:47.103358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cf343-13d2-481c-8cd3-cd8d69cfbcff None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:47.104100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cf343-13d2-481c-8cd3-cd8d69cfbcff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:47.104490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cf343-13d2-481c-8cd3-cd8d69cfbcff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:47.105975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cf343-13d2-481c-8cd3-cd8d69cfbcff None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:47.110856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.sql.core [None req-63f9e1d7-5043-4622-b260-5cf982e7519b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 11:13:47.110856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 11:13:47.110856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [parameters: {'user_id': '90a76fc015fa49b3838f9d4f32fdc015', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 11:13:47.110856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80054) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-63f9e1d7-5043-4622-b260-5cf982e7519b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application conn.query(q) Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application result.read() Aug 09 11:13:47.118674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 11:13:47.119663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application next(self.gen) Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application yield resource Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application next(self.gen) Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise self.value Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application session.commit() Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 11:13:47.121010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.session.flush() Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application compat.raise_( Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 11:13:47.121919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 11:13:47.123422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application conn.query(q) Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application result.read() Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 11:13:47.124601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [parameters: {'user_id': '90a76fc015fa49b3838f9d4f32fdc015', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:47.125466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 09 11:13:47.126432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 09 11:13:47.135669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 09 11:13:47.135669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 09 11:13:47.135669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 11:13:47.135669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 11:13:47.135669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 11:13:47.135669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:47.135669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 483/968] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Aug 9 11:13:46 2022] POST /identity/v3/users => generated 160 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:47.136072 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 486/969] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:47.136160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9e1d7-5043-4622-b260-5cf982e7519b None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:47.136232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cf343-13d2-481c-8cd3-cd8d69cfbcff None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:47.240055 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:47.261135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cf343-13d2-481c-8cd3-cd8d69cfbcff None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:47.269946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9e1d7-5043-4622-b260-5cf982e7519b None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:47.282296 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:47.308073 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3f620-3b71-499d-8ed1-1189901b071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:47.309241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f620-3b71-499d-8ed1-1189901b071d None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:47.309921 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f620-3b71-499d-8ed1-1189901b071d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:47.310360 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f620-3b71-499d-8ed1-1189901b071d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:47.320525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3f620-3b71-499d-8ed1-1189901b071d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:47.321425 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d32770-e7c0-4cf6-8f47-b4fae8c215b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:47.322615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3f620-3b71-499d-8ed1-1189901b071d None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:47.322891 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d32770-e7c0-4cf6-8f47-b4fae8c215b7 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:47.323505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d32770-e7c0-4cf6-8f47-b4fae8c215b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:47.323938 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d32770-e7c0-4cf6-8f47-b4fae8c215b7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:47.333604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d32770-e7c0-4cf6-8f47-b4fae8c215b7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-0de3f620-3b71-499d-8ed1-1189901b071d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:47.335652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:47.336554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:47.337535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:47.337535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:47.337535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:47.337535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:47.337535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:47.337535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:47.337535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:47.337535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:47.337535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:13:47.337535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:47.337535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 487/970] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Aug 9 11:13:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:47.338353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d32770-e7c0-4cf6-8f47-b4fae8c215b7 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:47.342613 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3f620-3b71-499d-8ed1-1189901b071d None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-25d32770-e7c0-4cf6-8f47-b4fae8c215b7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:47.352757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:47.353779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:47.354722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:47.354722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:47.354722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:47.354722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:47.354722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:47.354722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:47.354722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:47.354722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:47.354722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:13:47.354722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:47.354722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 484/971] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:13:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:47.361339 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d32770-e7c0-4cf6-8f47-b4fae8c215b7 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:47.481427 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3f620-3b71-499d-8ed1-1189901b071d None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:47.522804 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d32770-e7c0-4cf6-8f47-b4fae8c215b7 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:47.525682 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd1f9c-d0f3-4734-8d7d-af5d90d3e788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:47.526552 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd1f9c-d0f3-4734-8d7d-af5d90d3e788 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:47.527037 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd1f9c-d0f3-4734-8d7d-af5d90d3e788 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:47.527572 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd1f9c-d0f3-4734-8d7d-af5d90d3e788 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:47.528508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd1f9c-d0f3-4734-8d7d-af5d90d3e788 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:47.529001 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd1f9c-d0f3-4734-8d7d-af5d90d3e788 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:47.530644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd1f9c-d0f3-4734-8d7d-af5d90d3e788 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:47.547749 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:47.554593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 488/972] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Aug 9 11:13:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:47.560114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd1f9c-d0f3-4734-8d7d-af5d90d3e788 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:47.565401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1740ac-2ba1-4dea-9a31-5390ef3f4da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:47.565401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1740ac-2ba1-4dea-9a31-5390ef3f4da2 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:47.565687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1740ac-2ba1-4dea-9a31-5390ef3f4da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:47.565765 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1740ac-2ba1-4dea-9a31-5390ef3f4da2 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:47.566479 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1740ac-2ba1-4dea-9a31-5390ef3f4da2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:47.566962 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1740ac-2ba1-4dea-9a31-5390ef3f4da2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:47.568459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1740ac-2ba1-4dea-9a31-5390ef3f4da2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:47.614843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 485/973] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Aug 9 11:13:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:47.681018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd1f9c-d0f3-4734-8d7d-af5d90d3e788 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:47.725781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea09781-4c4f-420a-8826-cde107940efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:47.726409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea09781-4c4f-420a-8826-cde107940efe None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:47.726682 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea09781-4c4f-420a-8826-cde107940efe None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:47.726980 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea09781-4c4f-420a-8826-cde107940efe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:47.804667 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea09781-4c4f-420a-8826-cde107940efe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:47.805307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:47.807062 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea09781-4c4f-420a-8826-cde107940efe None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:47.925951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 489/974] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:47 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:13:47.931468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1740ac-2ba1-4dea-9a31-5390ef3f4da2 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:47.960997 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:48.045517 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1740ac-2ba1-4dea-9a31-5390ef3f4da2 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:48.082329 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72120448-f2ad-4b1b-a9ee-187168911cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:48.083004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72120448-f2ad-4b1b-a9ee-187168911cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:48.083281 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72120448-f2ad-4b1b-a9ee-187168911cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:48.083547 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72120448-f2ad-4b1b-a9ee-187168911cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:48.094613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72120448-f2ad-4b1b-a9ee-187168911cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:48.096208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72120448-f2ad-4b1b-a9ee-187168911cd3 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-72120448-f2ad-4b1b-a9ee-187168911cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:48.111206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:48.112242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:48.113209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:48.113209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:48.113209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:48.113209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 486/975] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:48.118154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea09781-4c4f-420a-8826-cde107940efe None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:48.217654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:48.221314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea09781-4c4f-420a-8826-cde107940efe None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:48.257292 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd062cd-0c30-4c69-89c6-bbd45f4bc3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:48.257906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd062cd-0c30-4c69-89c6-bbd45f4bc3fe None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:48.258181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd062cd-0c30-4c69-89c6-bbd45f4bc3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:48.258444 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd062cd-0c30-4c69-89c6-bbd45f4bc3fe None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:48.259120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd062cd-0c30-4c69-89c6-bbd45f4bc3fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:48.259414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd062cd-0c30-4c69-89c6-bbd45f4bc3fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:48.260790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd062cd-0c30-4c69-89c6-bbd45f4bc3fe None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:48.272925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 490/976] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:48.278519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72120448-f2ad-4b1b-a9ee-187168911cd3 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:48.363753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:48.387116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72120448-f2ad-4b1b-a9ee-187168911cd3 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:48.428912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fffce-2b12-4ba6-abfb-7f5e093277e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:48.429568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fffce-2b12-4ba6-abfb-7f5e093277e2 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:48.429841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fffce-2b12-4ba6-abfb-7f5e093277e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:48.430109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fffce-2b12-4ba6-abfb-7f5e093277e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:48.438518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fffce-2b12-4ba6-abfb-7f5e093277e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:48.440059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fffce-2b12-4ba6-abfb-7f5e093277e2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-8e8fffce-2b12-4ba6-abfb-7f5e093277e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:48.453198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:48.454419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:48.455923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:48.455923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:48.455923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:48.455923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:48.455923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:48.455923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:48.455923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:48.455923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:48.459050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 487/977] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:48.460768 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd062cd-0c30-4c69-89c6-bbd45f4bc3fe None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:48.579833 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd062cd-0c30-4c69-89c6-bbd45f4bc3fe None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:48.614731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14b551-edfe-4766-98f6-ee44da7ba7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:48.615375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14b551-edfe-4766-98f6-ee44da7ba7ce None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:48.615648 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14b551-edfe-4766-98f6-ee44da7ba7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:48.615914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14b551-edfe-4766-98f6-ee44da7ba7ce None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:48.616608 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14b551-edfe-4766-98f6-ee44da7ba7ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:48.616906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14b551-edfe-4766-98f6-ee44da7ba7ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:48.618355 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14b551-edfe-4766-98f6-ee44da7ba7ce None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:48.636243 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 491/978] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:48.637702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fffce-2b12-4ba6-abfb-7f5e093277e2 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:48.741573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fffce-2b12-4ba6-abfb-7f5e093277e2 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:48.776678 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe740c-6016-4624-9711-92a3870165c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:48.777290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe740c-6016-4624-9711-92a3870165c3 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:48.777561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe740c-6016-4624-9711-92a3870165c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:48.777835 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe740c-6016-4624-9711-92a3870165c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:48.778553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe740c-6016-4624-9711-92a3870165c3 None admin] RBAC: Adding query filter params (role.id=3af90443fd0d4f55a3440b82ea610fff, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=2c0549bc0a3445b48aa7fa7e341f8900) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:48.778905 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe740c-6016-4624-9711-92a3870165c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:48.780332 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe740c-6016-4624-9711-92a3870165c3 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:48.786847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 488/979] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:48 2022] GET /identity/v3/role_assignments?user.id=2c0549bc0a3445b48aa7fa7e341f8900&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=3af90443fd0d4f55a3440b82ea610fff => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:48.826417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee87136-c9d8-4244-ba0b-0ff2746ba9a6 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:48.826767 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee87136-c9d8-4244-ba0b-0ff2746ba9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:48.827018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee87136-c9d8-4244-ba0b-0ff2746ba9a6 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:48.828546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 492/980] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:48.834648 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8ae0e-5e12-4bfb-944e-b5940c3d0143 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:48.835003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8ae0e-5e12-4bfb-944e-b5940c3d0143 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:48.835097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8ae0e-5e12-4bfb-944e-b5940c3d0143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:48.842025 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:48.857471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-1ad8ae0e-5e12-4bfb-944e-b5940c3d0143 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:48.859120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-1ad8ae0e-5e12-4bfb-944e-b5940c3d0143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:48.940896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 489/981] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:48.963092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee87136-c9d8-4244-ba0b-0ff2746ba9a6 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:48.986074 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:49.020365 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95369d2f-201d-4ff4-9f57-2c68e0400013 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:49.020986 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95369d2f-201d-4ff4-9f57-2c68e0400013 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:49.021777 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95369d2f-201d-4ff4-9f57-2c68e0400013 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:49.024608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 490/982] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:49.029791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de292dc3-b203-4d25-9b18-d35122a871d4 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:49.030172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de292dc3-b203-4d25-9b18-d35122a871d4 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:49.030653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de292dc3-b203-4d25-9b18-d35122a871d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:49.048642 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-de292dc3-b203-4d25-9b18-d35122a871d4 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:49.050264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-de292dc3-b203-4d25-9b18-d35122a871d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:49.075514 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee87136-c9d8-4244-ba0b-0ff2746ba9a6 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:49.115306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b6af6-2dc4-42df-97aa-d90bcd482d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:49.115939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b6af6-2dc4-42df-97aa-d90bcd482d5f None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:49.116202 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b6af6-2dc4-42df-97aa-d90bcd482d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:49.116468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b6af6-2dc4-42df-97aa-d90bcd482d5f None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:49.117113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b6af6-2dc4-42df-97aa-d90bcd482d5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:49.118494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b6af6-2dc4-42df-97aa-d90bcd482d5f None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:49.130887 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 491/983] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:49.138842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 493/984] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Aug 9 11:13:48 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:13:49.154010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de292dc3-b203-4d25-9b18-d35122a871d4 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:49.226623 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:49.272948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de292dc3-b203-4d25-9b18-d35122a871d4 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:49.321992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf551c64-d2c7-4dfa-a371-b2d626556774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:49.322978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551c64-d2c7-4dfa-a371-b2d626556774 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:49.322978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551c64-d2c7-4dfa-a371-b2d626556774 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:49.323877 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551c64-d2c7-4dfa-a371-b2d626556774 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:49.324106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf551c64-d2c7-4dfa-a371-b2d626556774 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:49.325582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf551c64-d2c7-4dfa-a371-b2d626556774 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-bf551c64-d2c7-4dfa-a371-b2d626556774 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:49.335434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:49.336643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:49.337783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:49.337783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:49.337783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:49.337783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:49.337783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:49.337783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:49.337783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:49.337783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:49.337783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:49.337783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:49.337783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:49.337783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:49.337783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:49.337783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:49.341665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 492/985] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Aug 9 11:13:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:49.343140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b6af6-2dc4-42df-97aa-d90bcd482d5f None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:49.432552 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:49.458005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b6af6-2dc4-42df-97aa-d90bcd482d5f None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:49.515283 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a684aa8-428d-4456-bac0-e0063e158878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:49.515922 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a684aa8-428d-4456-bac0-e0063e158878 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:49.516195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a684aa8-428d-4456-bac0-e0063e158878 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:49.516456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a684aa8-428d-4456-bac0-e0063e158878 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:49.517100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a684aa8-428d-4456-bac0-e0063e158878 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:49.517404 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a684aa8-428d-4456-bac0-e0063e158878 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:49.518876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a684aa8-428d-4456-bac0-e0063e158878 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:49.529362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 494/986] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Aug 9 11:13:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:49.531013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf551c64-d2c7-4dfa-a371-b2d626556774 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:49.635676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf551c64-d2c7-4dfa-a371-b2d626556774 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:49.658697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:49.671734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abfd93-c41c-4640-97c7-a5c052fadce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:49.672363 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abfd93-c41c-4640-97c7-a5c052fadce7 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:49.672607 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abfd93-c41c-4640-97c7-a5c052fadce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:49.672870 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abfd93-c41c-4640-97c7-a5c052fadce7 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:49.673529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abfd93-c41c-4640-97c7-a5c052fadce7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:49.673779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abfd93-c41c-4640-97c7-a5c052fadce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:49.675251 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abfd93-c41c-4640-97c7-a5c052fadce7 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:49.680464 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 493/987] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Aug 9 11:13:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:49.686834 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a684aa8-428d-4456-bac0-e0063e158878 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:49.791129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a684aa8-428d-4456-bac0-e0063e158878 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:49.825698 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a1532-4d9a-4d22-a9a4-340b18c4b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:49.826302 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1532-4d9a-4d22-a9a4-340b18c4b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:49.826568 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1532-4d9a-4d22-a9a4-340b18c4b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:49.826840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1532-4d9a-4d22-a9a4-340b18c4b5b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:49.827552 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a1532-4d9a-4d22-a9a4-340b18c4b5b1 None admin] RBAC: Adding query filter params (interface=admin, service_id=dfb532c0344e4206b7bcc1a875ba61cc, region_id=RegionOne) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:49.827851 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a1532-4d9a-4d22-a9a4-340b18c4b5b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:49.829220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a1532-4d9a-4d22-a9a4-340b18c4b5b1 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:49.835164 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 495/988] 10.222.0.59 () {56 vars in 1249 bytes} [Tue Aug 9 11:13:49 2022] GET /identity/v3/endpoints?service_id=dfb532c0344e4206b7bcc1a875ba61cc&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:49.840633 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abfd93-c41c-4640-97c7-a5c052fadce7 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:49.958298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abfd93-c41c-4640-97c7-a5c052fadce7 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:49.993506 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94210c7f-8b57-42a6-8f0b-1c5958e296ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:49.994114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94210c7f-8b57-42a6-8f0b-1c5958e296ad None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:49.994383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94210c7f-8b57-42a6-8f0b-1c5958e296ad None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:49.994645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94210c7f-8b57-42a6-8f0b-1c5958e296ad None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:49.995627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94210c7f-8b57-42a6-8f0b-1c5958e296ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:49.996992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94210c7f-8b57-42a6-8f0b-1c5958e296ad None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:50.005702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 494/989] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Aug 9 11:13:49 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:13:50.838564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45694c2e-c1f4-4035-aa13-17c09cf3137a None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:50.839132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45694c2e-c1f4-4035-aa13-17c09cf3137a None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:50.839132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45694c2e-c1f4-4035-aa13-17c09cf3137a None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:50.840828 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 496/990] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:50.846534 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371d2a2-cf97-43fe-8cc7-9aebaf20ea8c None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:50.846849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371d2a2-cf97-43fe-8cc7-9aebaf20ea8c None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:50.847110 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371d2a2-cf97-43fe-8cc7-9aebaf20ea8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:50.867678 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-a371d2a2-cf97-43fe-8cc7-9aebaf20ea8c None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:50.868881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a371d2a2-cf97-43fe-8cc7-9aebaf20ea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:50.923300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:50.959411 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 495/991] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:50.998125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45694c2e-c1f4-4035-aa13-17c09cf3137a None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:51.018078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:51.130219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45694c2e-c1f4-4035-aa13-17c09cf3137a None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:51.167609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3beed3-05bd-464a-ada7-34396a5d2fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:51.168249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3beed3-05bd-464a-ada7-34396a5d2fed None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:51.168521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3beed3-05bd-464a-ada7-34396a5d2fed None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:51.168787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3beed3-05bd-464a-ada7-34396a5d2fed None admin] PATH_INFO: `/v3/services/image` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:51.169375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3beed3-05bd-464a-ada7-34396a5d2fed None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:51.170761 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3beed3-05bd-464a-ada7-34396a5d2fed None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-9e3beed3-05bd-464a-ada7-34396a5d2fed None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:51.180182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:51.181285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:51.182138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 497/992] 10.222.0.59 () {56 vars in 1105 bytes} [Tue Aug 9 11:13:50 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:51.189311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371d2a2-cf97-43fe-8cc7-9aebaf20ea8c None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:51.218132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506dc19-84b7-4323-b1b9-8fdf2b2e9b7b None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:51.218435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506dc19-84b7-4323-b1b9-8fdf2b2e9b7b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:51.218706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506dc19-84b7-4323-b1b9-8fdf2b2e9b7b None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:51.220115 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 498/993] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:13:51.225405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bf932-2852-42a6-836e-7ff5e1e6c725 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:51.225841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bf932-2852-42a6-836e-7ff5e1e6c725 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:51.225998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bf932-2852-42a6-836e-7ff5e1e6c725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:51.246024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-076bf932-2852-42a6-836e-7ff5e1e6c725 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:51.247254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-076bf932-2852-42a6-836e-7ff5e1e6c725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:51.320012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371d2a2-cf97-43fe-8cc7-9aebaf20ea8c None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:51.352547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 499/994] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:51.370910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda585ed-34e1-4d0b-82a5-70fdaca2dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:51.371545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda585ed-34e1-4d0b-82a5-70fdaca2dc37 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:51.371819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda585ed-34e1-4d0b-82a5-70fdaca2dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:51.372085 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda585ed-34e1-4d0b-82a5-70fdaca2dc37 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:51.372785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda585ed-34e1-4d0b-82a5-70fdaca2dc37 None admin] RBAC: Adding query filter params (name=image) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:51.373094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda585ed-34e1-4d0b-82a5-70fdaca2dc37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:51.374492 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda585ed-34e1-4d0b-82a5-70fdaca2dc37 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:51.380515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 496/995] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:51.386106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bf932-2852-42a6-836e-7ff5e1e6c725 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:51.389086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:51.394981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda585ed-34e1-4d0b-82a5-70fdaca2dc37 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:51.460254 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:51.506159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bf932-2852-42a6-836e-7ff5e1e6c725 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:51.524946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda585ed-34e1-4d0b-82a5-70fdaca2dc37 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:51.543847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8d985-a84b-40cd-90a0-97e0d44875f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:51.544464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8d985-a84b-40cd-90a0-97e0d44875f2 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:51.544739 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8d985-a84b-40cd-90a0-97e0d44875f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:51.545000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8d985-a84b-40cd-90a0-97e0d44875f2 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:51.546092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8d985-a84b-40cd-90a0-97e0d44875f2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:51.546404 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8d985-a84b-40cd-90a0-97e0d44875f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:51.547861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8d985-a84b-40cd-90a0-97e0d44875f2 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:51.562853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 500/996] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:51.563067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1861b7a-b006-4921-a912-588f04de48ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:51.563067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861b7a-b006-4921-a912-588f04de48ed None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:51.563067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861b7a-b006-4921-a912-588f04de48ed None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:51.563067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861b7a-b006-4921-a912-588f04de48ed None admin] PATH_INFO: `/v3/services/compute` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:51.563417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1861b7a-b006-4921-a912-588f04de48ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:51.564005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1861b7a-b006-4921-a912-588f04de48ed None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-f1861b7a-b006-4921-a912-588f04de48ed None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:51.574869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:51.575978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:51.576865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:51.576865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:51.576865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:51.576865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:51.576865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:51.576865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:51.576865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:51.576865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:51.576865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:51.576865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:51.576865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:51.576865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:51.576865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:13:51.576865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:51.581531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 497/997] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:51.582922 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8d985-a84b-40cd-90a0-97e0d44875f2 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:51.659257 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:51.703545 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8d985-a84b-40cd-90a0-97e0d44875f2 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:51.750494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8abf81-855d-4cb3-bac9-9170101e0fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:51.751399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8abf81-855d-4cb3-bac9-9170101e0fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:51.751774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8abf81-855d-4cb3-bac9-9170101e0fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:51.752210 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8abf81-855d-4cb3-bac9-9170101e0fc2 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:51.753176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8abf81-855d-4cb3-bac9-9170101e0fc2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:51.753572 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8abf81-855d-4cb3-bac9-9170101e0fc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:51.755167 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8abf81-855d-4cb3-bac9-9170101e0fc2 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:51.760894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 501/998] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Aug 9 11:13:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:51.766619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1861b7a-b006-4921-a912-588f04de48ed None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:51.871995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1861b7a-b006-4921-a912-588f04de48ed None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:51.883580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:51.911248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5b72e-cc9c-4edb-b196-e640d08463e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:51.911766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5b72e-cc9c-4edb-b196-e640d08463e0 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:51.912039 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5b72e-cc9c-4edb-b196-e640d08463e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:51.912308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5b72e-cc9c-4edb-b196-e640d08463e0 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:51.912945 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5b72e-cc9c-4edb-b196-e640d08463e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:51.913243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5b72e-cc9c-4edb-b196-e640d08463e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:51.914622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5b72e-cc9c-4edb-b196-e640d08463e0 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:51.925170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 498/999] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Aug 9 11:13:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:51.926656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8abf81-855d-4cb3-bac9-9170101e0fc2 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:52.040312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8abf81-855d-4cb3-bac9-9170101e0fc2 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:52.047441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc137e-5088-4e6f-bf0b-a49f73655685 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:52.047919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc137e-5088-4e6f-bf0b-a49f73655685 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:52.047997 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc137e-5088-4e6f-bf0b-a49f73655685 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:52.049537 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 499/1000] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:52.054324 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d94aa-428d-4c28-a978-5b98f2a97617 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:52.054604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d94aa-428d-4c28-a978-5b98f2a97617 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:52.054902 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d94aa-428d-4c28-a978-5b98f2a97617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:52.071263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:52.072946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-a89d94aa-428d-4c28-a978-5b98f2a97617 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:52.074067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a89d94aa-428d-4c28-a978-5b98f2a97617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:52.078112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05093043-2d8a-4838-9493-e819acc6adf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:52.078726 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093043-2d8a-4838-9493-e819acc6adf4 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:52.079174 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093043-2d8a-4838-9493-e819acc6adf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:52.079538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093043-2d8a-4838-9493-e819acc6adf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:52.080146 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05093043-2d8a-4838-9493-e819acc6adf4 None admin] RBAC: Adding query filter params (interface=public, service_id=64042a9792254e76970cbe006cae4fdf, region_id=RegionOne) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:52.080447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05093043-2d8a-4838-9493-e819acc6adf4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:52.081937 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05093043-2d8a-4838-9493-e819acc6adf4 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:52.091958 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 502/1001] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Aug 9 11:13:51 2022] GET /identity/v3/endpoints?service_id=64042a9792254e76970cbe006cae4fdf&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:52.094015 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05093043-2d8a-4838-9493-e819acc6adf4 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:52.150244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 500/1002] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:52.172326 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d94aa-428d-4c28-a978-5b98f2a97617 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:52.202943 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05093043-2d8a-4838-9493-e819acc6adf4 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:52.249265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ffb32-31e7-40f0-8a34-5d6a54fd71e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:52.249882 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ffb32-31e7-40f0-8a34-5d6a54fd71e8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:52.250156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ffb32-31e7-40f0-8a34-5d6a54fd71e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:52.250421 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ffb32-31e7-40f0-8a34-5d6a54fd71e8 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:52.251065 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ffb32-31e7-40f0-8a34-5d6a54fd71e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:52.252481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ffb32-31e7-40f0-8a34-5d6a54fd71e8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:52.261511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 503/1003] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Aug 9 11:13:52 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:13:52.312201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d94aa-428d-4c28-a978-5b98f2a97617 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:52.314358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:52.356419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e7e63-5c27-40b3-86e8-a2384b89054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:52.357072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e7e63-5c27-40b3-86e8-a2384b89054d None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:52.357341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e7e63-5c27-40b3-86e8-a2384b89054d None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:52.357664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e7e63-5c27-40b3-86e8-a2384b89054d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:52.358258 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e7e63-5c27-40b3-86e8-a2384b89054d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:52.359747 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e7e63-5c27-40b3-86e8-a2384b89054d None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-682e7e63-5c27-40b3-86e8-a2384b89054d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:52.370412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:52.371615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:52.372487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:52.372487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:52.372487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:52.372487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:52.372487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:52.372487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:52.372487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:52.372487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:52.372487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:52.372487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:52.372487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:52.372487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:52.372487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:13:52.372487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:52.375196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 501/1004] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Aug 9 11:13:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:52.378025 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ffb32-31e7-40f0-8a34-5d6a54fd71e8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:52.447424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:52.498383 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ffb32-31e7-40f0-8a34-5d6a54fd71e8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:52.533026 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8cf301-0b9e-4447-86e7-e0eb1eac853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:52.533640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cf301-0b9e-4447-86e7-e0eb1eac853f None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:52.534153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cf301-0b9e-4447-86e7-e0eb1eac853f None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:52.534393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cf301-0b9e-4447-86e7-e0eb1eac853f None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:52.535067 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8cf301-0b9e-4447-86e7-e0eb1eac853f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:52.535371 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8cf301-0b9e-4447-86e7-e0eb1eac853f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:52.536791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8cf301-0b9e-4447-86e7-e0eb1eac853f None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:52.542133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 504/1005] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Aug 9 11:13:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:52.548192 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e7e63-5c27-40b3-86e8-a2384b89054d None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:52.657326 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e7e63-5c27-40b3-86e8-a2384b89054d None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:52.695764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9f6ad-5801-4a8f-acc6-e934c6148a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:52.696377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9f6ad-5801-4a8f-acc6-e934c6148a5c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:52.696646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9f6ad-5801-4a8f-acc6-e934c6148a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:52.696909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9f6ad-5801-4a8f-acc6-e934c6148a5c None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:52.697592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9f6ad-5801-4a8f-acc6-e934c6148a5c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:52.697838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9f6ad-5801-4a8f-acc6-e934c6148a5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:52.699237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9f6ad-5801-4a8f-acc6-e934c6148a5c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:52.704487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 502/1006] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Aug 9 11:13:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:52.710190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8cf301-0b9e-4447-86e7-e0eb1eac853f None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:52.816133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8cf301-0b9e-4447-86e7-e0eb1eac853f None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:52.839746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:52.852715 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c1121-4d9e-48cb-9bf4-bee8dfef6b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:52.853463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c1121-4d9e-48cb-9bf4-bee8dfef6b53 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:52.853847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c1121-4d9e-48cb-9bf4-bee8dfef6b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:52.854212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c1121-4d9e-48cb-9bf4-bee8dfef6b53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:52.855003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c1121-4d9e-48cb-9bf4-bee8dfef6b53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:52.856519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c1121-4d9e-48cb-9bf4-bee8dfef6b53 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:52.873845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 505/1007] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:13:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:13:53.559877 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4104248-21c3-432f-87a5-4962e930d96e None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:53.560489 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4104248-21c3-432f-87a5-4962e930d96e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:53.560489 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4104248-21c3-432f-87a5-4962e930d96e None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:53.561767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 503/1008] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:53.567349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399977e2-d47b-41a6-ae39-7c76a42fb46f None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:53.567988 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399977e2-d47b-41a6-ae39-7c76a42fb46f None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:53.567988 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399977e2-d47b-41a6-ae39-7c76a42fb46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:53.594891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-399977e2-d47b-41a6-ae39-7c76a42fb46f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:53.596124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-399977e2-d47b-41a6-ae39-7c76a42fb46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:53.693731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 506/1009] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:53.732812 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4104248-21c3-432f-87a5-4962e930d96e None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:53.775173 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:53.860230 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4104248-21c3-432f-87a5-4962e930d96e None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:53.900306 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ef786-9e86-431b-b0a4-50a9db08061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:53.901400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ef786-9e86-431b-b0a4-50a9db08061e None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:53.901848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ef786-9e86-431b-b0a4-50a9db08061e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:53.902374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ef786-9e86-431b-b0a4-50a9db08061e None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:53.903318 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ef786-9e86-431b-b0a4-50a9db08061e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:53.905017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ef786-9e86-431b-b0a4-50a9db08061e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:53.935390 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 504/1010] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Aug 9 11:13:53 2022] POST /identity/v3/services => generated 242 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:13:54.305711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640260a-8dfa-4198-bff5-8465e04215f1 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:54.306092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640260a-8dfa-4198-bff5-8465e04215f1 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:54.306267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640260a-8dfa-4198-bff5-8465e04215f1 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:54.307649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 507/1011] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:54.313117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb62e4-afdc-46d6-9c0d-7e77485218d8 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:54.313406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb62e4-afdc-46d6-9c0d-7e77485218d8 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:54.313858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb62e4-afdc-46d6-9c0d-7e77485218d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:54.338915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-38cb62e4-afdc-46d6-9c0d-7e77485218d8 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:54.340087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-38cb62e4-afdc-46d6-9c0d-7e77485218d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:54.456568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 505/1012] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:54 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:54.481988 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640260a-8dfa-4198-bff5-8465e04215f1 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:54.605996 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640260a-8dfa-4198-bff5-8465e04215f1 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:54.617590 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:54.647818 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ff99-6823-47c7-b89a-bda3782a5596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:54.648475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ff99-6823-47c7-b89a-bda3782a5596 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:54.648746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ff99-6823-47c7-b89a-bda3782a5596 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:54.649017 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ff99-6823-47c7-b89a-bda3782a5596 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:54.649623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ff99-6823-47c7-b89a-bda3782a5596 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:54.651083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ff99-6823-47c7-b89a-bda3782a5596 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-1621ff99-6823-47c7-b89a-bda3782a5596 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:54.661161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:54.662884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:54.664411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:54.664411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:54.664411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:54.664411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:54.664411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:54.664411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:54.664411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:54.664411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:54.664411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:54.664411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:54.664411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:54.664411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:54.664411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:13:54.664411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:54.667110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 508/1013] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:54.668918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb62e4-afdc-46d6-9c0d-7e77485218d8 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:54.688305 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:54.779424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb62e4-afdc-46d6-9c0d-7e77485218d8 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:54.816837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443b7c0-2c99-4fcf-bbf7-434515fc2c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:54.817466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443b7c0-2c99-4fcf-bbf7-434515fc2c2e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:54.817748 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443b7c0-2c99-4fcf-bbf7-434515fc2c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:54.818014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443b7c0-2c99-4fcf-bbf7-434515fc2c2e None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:54.818654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443b7c0-2c99-4fcf-bbf7-434515fc2c2e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:54.819064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443b7c0-2c99-4fcf-bbf7-434515fc2c2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:54.820471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443b7c0-2c99-4fcf-bbf7-434515fc2c2e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:54.826378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 506/1014] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Aug 9 11:13:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:54.832687 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ff99-6823-47c7-b89a-bda3782a5596 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:54.951406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ff99-6823-47c7-b89a-bda3782a5596 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:54.952800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d514371-edef-472e-bcb4-0b1b91dedbc2 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:54.953092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d514371-edef-472e-bcb4-0b1b91dedbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:54.953364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d514371-edef-472e-bcb4-0b1b91dedbc2 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:54.954738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 507/1015] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:13:54.960454 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77941b1b-51d9-4ca8-a6ba-e1daa45c9bf9 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:54.960757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77941b1b-51d9-4ca8-a6ba-e1daa45c9bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:54.960999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77941b1b-51d9-4ca8-a6ba-e1daa45c9bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:54.981507 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-77941b1b-51d9-4ca8-a6ba-e1daa45c9bf9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:54.982733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-77941b1b-51d9-4ca8-a6ba-e1daa45c9bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:54.989264 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbc7c1-f84c-40b4-8672-2b77739ac75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:54.989876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbc7c1-f84c-40b4-8672-2b77739ac75e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:54.990152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbc7c1-f84c-40b4-8672-2b77739ac75e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:54.990422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbc7c1-f84c-40b4-8672-2b77739ac75e None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:54.991092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbc7c1-f84c-40b4-8672-2b77739ac75e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:54.991394 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbc7c1-f84c-40b4-8672-2b77739ac75e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:54.992824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbc7c1-f84c-40b4-8672-2b77739ac75e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:55.002872 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 509/1016] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Aug 9 11:13:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:55.005631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbc7c1-f84c-40b4-8672-2b77739ac75e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:55.050658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:55.066466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 508/1017] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:54 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:55.089392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77941b1b-51d9-4ca8-a6ba-e1daa45c9bf9 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:55.105013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:55.142941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbc7c1-f84c-40b4-8672-2b77739ac75e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:55.197227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845d6e2-0277-45fc-a4b5-f568ed8678fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:55.198214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845d6e2-0277-45fc-a4b5-f568ed8678fd None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:55.198651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845d6e2-0277-45fc-a4b5-f568ed8678fd None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:55.199125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845d6e2-0277-45fc-a4b5-f568ed8678fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:55.200205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845d6e2-0277-45fc-a4b5-f568ed8678fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:55.202466 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845d6e2-0277-45fc-a4b5-f568ed8678fd None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:55.242854 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 510/1018] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:13:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:13:55.272132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77941b1b-51d9-4ca8-a6ba-e1daa45c9bf9 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:55.323483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf8043-b7a2-46c1-bd35-594124ee6259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:55.324152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8043-b7a2-46c1-bd35-594124ee6259 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:55.324425 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8043-b7a2-46c1-bd35-594124ee6259 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:55.324694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8043-b7a2-46c1-bd35-594124ee6259 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:55.326023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf8043-b7a2-46c1-bd35-594124ee6259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:55.327581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf8043-b7a2-46c1-bd35-594124ee6259 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:55.329716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 509/1019] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:55.336291 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845d6e2-0277-45fc-a4b5-f568ed8678fd None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:55.469639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:55.486585 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845d6e2-0277-45fc-a4b5-f568ed8678fd None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:55.531415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39953036-143d-40c9-aded-8f08eb76ef0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:55.532038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39953036-143d-40c9-aded-8f08eb76ef0d None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:55.532307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39953036-143d-40c9-aded-8f08eb76ef0d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:55.532580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39953036-143d-40c9-aded-8f08eb76ef0d None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:55.533242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39953036-143d-40c9-aded-8f08eb76ef0d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:55.534932 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39953036-143d-40c9-aded-8f08eb76ef0d None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:55.568303 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 511/1020] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Aug 9 11:13:55 2022] POST /identity/v3/projects => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:13:56.124013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66811b-c110-48de-bb43-a68e79a54323 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:56.124549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66811b-c110-48de-bb43-a68e79a54323 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:56.124549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66811b-c110-48de-bb43-a68e79a54323 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:56.126066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 510/1021] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:56.132873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb785dd-4d8d-43ba-b8cf-6b557e4fd307 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:56.133408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb785dd-4d8d-43ba-b8cf-6b557e4fd307 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:56.133790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb785dd-4d8d-43ba-b8cf-6b557e4fd307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:56.158582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-2fb785dd-4d8d-43ba-b8cf-6b557e4fd307 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:56.160507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-2fb785dd-4d8d-43ba-b8cf-6b557e4fd307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:56.249326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 512/1022] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:56.272325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66811b-c110-48de-bb43-a68e79a54323 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:56.394297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:56.438599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66811b-c110-48de-bb43-a68e79a54323 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:56.489720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1c2b0-ff8e-4472-bd5b-ffdb45311393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:56.490207 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1c2b0-ff8e-4472-bd5b-ffdb45311393 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:56.490503 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1c2b0-ff8e-4472-bd5b-ffdb45311393 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:56.490954 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1c2b0-ff8e-4472-bd5b-ffdb45311393 None admin] PATH_INFO: `/v3/services/image` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:56.491720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1c2b0-ff8e-4472-bd5b-ffdb45311393 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:56.493256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1c2b0-ff8e-4472-bd5b-ffdb45311393 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-d2d1c2b0-ff8e-4472-bd5b-ffdb45311393 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:56.503760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:56.505106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:56.506564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 511/1023] 10.222.0.59 () {56 vars in 1105 bytes} [Tue Aug 9 11:13:56 2022] GET /identity/v3/services/image => generated 86 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:56.513337 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb785dd-4d8d-43ba-b8cf-6b557e4fd307 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:56.597151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:56.632554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb785dd-4d8d-43ba-b8cf-6b557e4fd307 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:56.673051 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b834ec4-63cc-46f6-92ce-8a94226d4771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:56.673569 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b834ec4-63cc-46f6-92ce-8a94226d4771 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:56.673844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b834ec4-63cc-46f6-92ce-8a94226d4771 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:56.674128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b834ec4-63cc-46f6-92ce-8a94226d4771 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:56.674849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b834ec4-63cc-46f6-92ce-8a94226d4771 None admin] RBAC: Adding query filter params (name=image) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:56.675173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b834ec4-63cc-46f6-92ce-8a94226d4771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:56.676574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b834ec4-63cc-46f6-92ce-8a94226d4771 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:56.688688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 513/1024] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:56.689952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1c2b0-ff8e-4472-bd5b-ffdb45311393 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:56.804546 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1c2b0-ff8e-4472-bd5b-ffdb45311393 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:56.850578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9f6ff-983d-4dc7-b115-0152e6111f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:56.851386 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9f6ff-983d-4dc7-b115-0152e6111f12 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:56.851760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9f6ff-983d-4dc7-b115-0152e6111f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:56.852252 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9f6ff-983d-4dc7-b115-0152e6111f12 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:56.852863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9f6ff-983d-4dc7-b115-0152e6111f12 None admin] RBAC: Adding query filter params (type=image) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:56.853323 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9f6ff-983d-4dc7-b115-0152e6111f12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:56.854829 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9f6ff-983d-4dc7-b115-0152e6111f12 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:56.860650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 512/1025] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:56.866534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b834ec4-63cc-46f6-92ce-8a94226d4771 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:56.994770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b834ec4-63cc-46f6-92ce-8a94226d4771 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:57.033569 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5b3cc-b408-4959-8e13-610b272e2516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:57.034252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b3cc-b408-4959-8e13-610b272e2516 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:57.034528 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b3cc-b408-4959-8e13-610b272e2516 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:57.034827 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b3cc-b408-4959-8e13-610b272e2516 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:57.035534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5b3cc-b408-4959-8e13-610b272e2516 None admin] RBAC: Adding query filter params (interface=public, service_id=596f7f3b21f940ca8e761d844ec3a541, region_id=RegionOne) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:57.035835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5b3cc-b408-4959-8e13-610b272e2516 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:57.037270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5b3cc-b408-4959-8e13-610b272e2516 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:57.043033 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 514/1026] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Aug 9 11:13:56 2022] GET /identity/v3/endpoints?service_id=596f7f3b21f940ca8e761d844ec3a541&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:57.048532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9f6ff-983d-4dc7-b115-0152e6111f12 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:57.051618 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:57.183210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9f6ff-983d-4dc7-b115-0152e6111f12 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:57.225574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0127985-6b6a-4ac5-a14f-b77643ab7d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:57.226477 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0127985-6b6a-4ac5-a14f-b77643ab7d1d None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:57.226753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0127985-6b6a-4ac5-a14f-b77643ab7d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:57.227056 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0127985-6b6a-4ac5-a14f-b77643ab7d1d None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:57.227942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0127985-6b6a-4ac5-a14f-b77643ab7d1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:57.229569 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0127985-6b6a-4ac5-a14f-b77643ab7d1d None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:57.237432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 513/1027] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Aug 9 11:13:57 2022] GET /identity/v3/services => generated 1957 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:13:57.468069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45e55-f38c-4c88-9b18-211d5d78c080 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:57.468609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45e55-f38c-4c88-9b18-211d5d78c080 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:57.468609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45e55-f38c-4c88-9b18-211d5d78c080 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:57.470131 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 515/1028] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:57.476402 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab4c1-c2f8-4d11-8884-0362c63e5b01 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:57.476678 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab4c1-c2f8-4d11-8884-0362c63e5b01 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:57.477477 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab4c1-c2f8-4d11-8884-0362c63e5b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:57.499841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-a47ab4c1-c2f8-4d11-8884-0362c63e5b01 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:57.501018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a47ab4c1-c2f8-4d11-8884-0362c63e5b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:57.571772 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:57.585132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 514/1029] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:57.608591 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a45e55-f38c-4c88-9b18-211d5d78c080 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:57.611703 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:57.712565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3758ca5-2eae-4800-91de-8aa606ca5b1e None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:57.712786 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3758ca5-2eae-4800-91de-8aa606ca5b1e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:57.713004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3758ca5-2eae-4800-91de-8aa606ca5b1e None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:57.714371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 515/1030] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:13:57.720928 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3c5d3-a91f-434b-a120-fc76b422d81b None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:57.721444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3c5d3-a91f-434b-a120-fc76b422d81b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:57.721886 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3c5d3-a91f-434b-a120-fc76b422d81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:57.728946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a45e55-f38c-4c88-9b18-211d5d78c080 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:57.744143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-d4e3c5d3-a91f-434b-a120-fc76b422d81b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:57.745790 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d4e3c5d3-a91f-434b-a120-fc76b422d81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:57.782540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093690c-6212-495e-889d-b9947d9dcc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:57.783231 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093690c-6212-495e-889d-b9947d9dcc1d None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:57.783508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093690c-6212-495e-889d-b9947d9dcc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:57.783869 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093690c-6212-495e-889d-b9947d9dcc1d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:57.795184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093690c-6212-495e-889d-b9947d9dcc1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-a093690c-6212-495e-889d-b9947d9dcc1d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:13:57.800031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:57.801274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:57.802268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:57.802268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:57.802268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:57.802268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:57.802268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:13:57.802268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:13:57.802268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:13:57.802268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:13:57.802268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:13:57.802268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:13:57.802268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:13:57.802268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:57.802268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 516/1031] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Aug 9 11:13:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:57.807619 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093690c-6212-495e-889d-b9947d9dcc1d None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:57.839242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 516/1032] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:13:57.881264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3c5d3-a91f-434b-a120-fc76b422d81b None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:57.887971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:57.937743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093690c-6212-495e-889d-b9947d9dcc1d None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:57.977984 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2540e-cc2c-46da-ba4e-24becea024fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:57.978580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2540e-cc2c-46da-ba4e-24becea024fc None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:57.978940 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2540e-cc2c-46da-ba4e-24becea024fc None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:57.979377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2540e-cc2c-46da-ba4e-24becea024fc None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:57.980234 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2540e-cc2c-46da-ba4e-24becea024fc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:57.980600 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2540e-cc2c-46da-ba4e-24becea024fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:57.982018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2540e-cc2c-46da-ba4e-24becea024fc None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:57.997777 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 517/1033] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Aug 9 11:13:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:57.999002 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2540e-cc2c-46da-ba4e-24becea024fc None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:58.005856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3c5d3-a91f-434b-a120-fc76b422d81b None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:58.035251 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:58.048739 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d10e-e0e1-4400-bc6f-4054055ade4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:58.049439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d10e-e0e1-4400-bc6f-4054055ade4e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:58.049738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d10e-e0e1-4400-bc6f-4054055ade4e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:58.050007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d10e-e0e1-4400-bc6f-4054055ade4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:58.051456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6d10e-e0e1-4400-bc6f-4054055ade4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:58.052681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6d10e-e0e1-4400-bc6f-4054055ade4e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:58.054321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 517/1034] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:58.060926 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d10e-e0e1-4400-bc6f-4054055ade4e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:58.123063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2540e-cc2c-46da-ba4e-24becea024fc None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:58.151462 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:58.162616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d10e-e0e1-4400-bc6f-4054055ade4e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:58.166045 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4edbe2-d877-4af1-9d77-3cde6cd1bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:58.167039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4edbe2-d877-4af1-9d77-3cde6cd1bb7f None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:58.167486 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4edbe2-d877-4af1-9d77-3cde6cd1bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:58.167896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4edbe2-d877-4af1-9d77-3cde6cd1bb7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:58.181418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4edbe2-d877-4af1-9d77-3cde6cd1bb7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:58.183654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4edbe2-d877-4af1-9d77-3cde6cd1bb7f None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:58.196689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b344ed3-6525-4494-934e-fe96bae9e135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:58.197338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b344ed3-6525-4494-934e-fe96bae9e135 None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:58.197554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b344ed3-6525-4494-934e-fe96bae9e135 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:58.197820 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b344ed3-6525-4494-934e-fe96bae9e135 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:58.198464 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b344ed3-6525-4494-934e-fe96bae9e135 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:58.199946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b344ed3-6525-4494-934e-fe96bae9e135 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-bf4edbe2-d877-4af1-9d77-3cde6cd1bb7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:58.200230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:58.201160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:58.202081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:58.202081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:58.202081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:58.202081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 518/1035] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:13:58.207193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4edbe2-d877-4af1-9d77-3cde6cd1bb7f None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:58.234947 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 518/1036] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:13:58 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:13:58.349881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4edbe2-d877-4af1-9d77-3cde6cd1bb7f None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:58.398067 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eed7fd-f9fe-43b0-acca-49227fb8470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:58.398688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eed7fd-f9fe-43b0-acca-49227fb8470b None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:58.399000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eed7fd-f9fe-43b0-acca-49227fb8470b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:58.399268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eed7fd-f9fe-43b0-acca-49227fb8470b None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:58.399926 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eed7fd-f9fe-43b0-acca-49227fb8470b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:58.400222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eed7fd-f9fe-43b0-acca-49227fb8470b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:58.404352 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eed7fd-f9fe-43b0-acca-49227fb8470b None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:58.419154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 519/1037] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:58.425051 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b344ed3-6525-4494-934e-fe96bae9e135 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:58.483688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:58.540743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b344ed3-6525-4494-934e-fe96bae9e135 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:58.576345 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069ef7d-5bd5-4ca4-9485-349066dc8145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:58.576984 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069ef7d-5bd5-4ca4-9485-349066dc8145 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:58.577261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069ef7d-5bd5-4ca4-9485-349066dc8145 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:58.577526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069ef7d-5bd5-4ca4-9485-349066dc8145 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:58.585374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069ef7d-5bd5-4ca4-9485-349066dc8145 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:58.586846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069ef7d-5bd5-4ca4-9485-349066dc8145 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-0069ef7d-5bd5-4ca4-9485-349066dc8145 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:13:58.598366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:58.599604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:58.600592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:58.600592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:58.600592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:13:58.600592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:13:58.600592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:13:58.600592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:13:58.600592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:13:58.600592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:13:58.600592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:13:58.600592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:58.600592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 519/1038] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Aug 9 11:13:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:58.607043 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eed7fd-f9fe-43b0-acca-49227fb8470b None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:58.643977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:58.726277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eed7fd-f9fe-43b0-acca-49227fb8470b None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:58.765322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cb571-e853-4966-b27d-eda1cd26f2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:58.765956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cb571-e853-4966-b27d-eda1cd26f2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:58.766226 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cb571-e853-4966-b27d-eda1cd26f2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:58.766495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cb571-e853-4966-b27d-eda1cd26f2b5 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:58.767283 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cb571-e853-4966-b27d-eda1cd26f2b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:58.767584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cb571-e853-4966-b27d-eda1cd26f2b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:58.769119 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cb571-e853-4966-b27d-eda1cd26f2b5 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:58.788030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 520/1039] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Aug 9 11:13:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:58.793792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069ef7d-5bd5-4ca4-9485-349066dc8145 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:58.900412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069ef7d-5bd5-4ca4-9485-349066dc8145 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:58.911239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:58.937559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81ea3c-8cc5-4b1a-98f4-e10e95cd7d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:58.938171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81ea3c-8cc5-4b1a-98f4-e10e95cd7d6a None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:58.938446 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81ea3c-8cc5-4b1a-98f4-e10e95cd7d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:58.938716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81ea3c-8cc5-4b1a-98f4-e10e95cd7d6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:59.011106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81ea3c-8cc5-4b1a-98f4-e10e95cd7d6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:59.012565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81ea3c-8cc5-4b1a-98f4-e10e95cd7d6a None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:59.162379 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 520/1040] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:13:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:13:59.168167 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cb571-e853-4966-b27d-eda1cd26f2b5 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:59.266801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:59.275197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cb571-e853-4966-b27d-eda1cd26f2b5 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:59.311106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a831d-49d7-4ea4-98ed-d7c90d95752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:59.311773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a831d-49d7-4ea4-98ed-d7c90d95752d None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:59.312187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a831d-49d7-4ea4-98ed-d7c90d95752d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:59.312414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a831d-49d7-4ea4-98ed-d7c90d95752d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:59.312669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd86821-d1e5-450a-86d4-760a2136b026 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:59.313140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd86821-d1e5-450a-86d4-760a2136b026 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:59.313231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd86821-d1e5-450a-86d4-760a2136b026 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:59.314756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 521/1041] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:13:59.320285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5ece1-4788-47a2-87f3-5ffe0029972d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:59.320563 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5ece1-4788-47a2-87f3-5ffe0029972d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:59.320829 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5ece1-4788-47a2-87f3-5ffe0029972d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:59.325321 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a831d-49d7-4ea4-98ed-d7c90d95752d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:59.326936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a831d-49d7-4ea4-98ed-d7c90d95752d None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:59.340645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-99b5ece1-4788-47a2-87f3-5ffe0029972d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:59.341941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-99b5ece1-4788-47a2-87f3-5ffe0029972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-5f9a831d-49d7-4ea4-98ed-d7c90d95752d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:13:59.343368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:59.344307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:13:59.345374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:13:59.345374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:13:59.345374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:59.347731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 521/1042] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:59.347875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:59.350567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a831d-49d7-4ea4-98ed-d7c90d95752d None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:59.424704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 522/1043] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:13:59.446868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5ece1-4788-47a2-87f3-5ffe0029972d None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:59.479148 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a831d-49d7-4ea4-98ed-d7c90d95752d None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:59.526720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172a772-6792-4916-8ba1-f18e819ecaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:59.527375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172a772-6792-4916-8ba1-f18e819ecaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:59.527643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172a772-6792-4916-8ba1-f18e819ecaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:59.527905 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172a772-6792-4916-8ba1-f18e819ecaf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:59.528543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172a772-6792-4916-8ba1-f18e819ecaf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:59.528832 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172a772-6792-4916-8ba1-f18e819ecaf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:59.530535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172a772-6792-4916-8ba1-f18e819ecaf6 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:59.548656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 522/1044] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:59.550755 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172a772-6792-4916-8ba1-f18e819ecaf6 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:59.559139 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5ece1-4788-47a2-87f3-5ffe0029972d None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:59.560038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:59.598386 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43217605-575f-439d-ae64-18b3e751e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:59.599051 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43217605-575f-439d-ae64-18b3e751e21c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:59.599360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43217605-575f-439d-ae64-18b3e751e21c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:59.599590 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43217605-575f-439d-ae64-18b3e751e21c None admin] PATH_INFO: `/v3/services/image` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:59.600386 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43217605-575f-439d-ae64-18b3e751e21c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:59.601553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43217605-575f-439d-ae64-18b3e751e21c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-43217605-575f-439d-ae64-18b3e751e21c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:59.610491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:59.611595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:13:59.612557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 523/1045] 10.222.0.59 () {56 vars in 1105 bytes} [Tue Aug 9 11:13:59 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:59.617867 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43217605-575f-439d-ae64-18b3e751e21c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:59.623264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:59.663048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172a772-6792-4916-8ba1-f18e819ecaf6 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:59.699505 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbeb68-30e4-4a59-96b3-ae470860a209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:59.700045 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbeb68-30e4-4a59-96b3-ae470860a209 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:59.700325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbeb68-30e4-4a59-96b3-ae470860a209 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:59.700575 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbeb68-30e4-4a59-96b3-ae470860a209 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:59.708103 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbeb68-30e4-4a59-96b3-ae470860a209 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:59.709598 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbeb68-30e4-4a59-96b3-ae470860a209 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-bcbbeb68-30e4-4a59-96b3-ae470860a209 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:13:59.722265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:13:59.723510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:13:59.724403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:13:59.724403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:13:59.724403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:13:59.724403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:13:59.724403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:13:59.724403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:13:59.724403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:13:59.724403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:13:59.724403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 523/1046] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:13:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:13:59.729666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbeb68-30e4-4a59-96b3-ae470860a209 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:59.738613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43217605-575f-439d-ae64-18b3e751e21c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:59.777159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d17d81-209b-47c9-a26f-f1f5f262cfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:59.778601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d17d81-209b-47c9-a26f-f1f5f262cfff None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:59.779522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d17d81-209b-47c9-a26f-f1f5f262cfff None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:59.780134 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d17d81-209b-47c9-a26f-f1f5f262cfff None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:59.781083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d17d81-209b-47c9-a26f-f1f5f262cfff None admin] RBAC: Adding query filter params (name=image) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:59.781619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d17d81-209b-47c9-a26f-f1f5f262cfff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:59.784379 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d17d81-209b-47c9-a26f-f1f5f262cfff None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:59.791453 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 524/1047] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:59.797397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d17d81-209b-47c9-a26f-f1f5f262cfff None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:59.807548 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:59.848377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbeb68-30e4-4a59-96b3-ae470860a209 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:59.879371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:59.886740 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab195faa-86f2-4b3e-b11c-d4c196682e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:59.887393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195faa-86f2-4b3e-b11c-d4c196682e77 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:59.887668 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195faa-86f2-4b3e-b11c-d4c196682e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:59.887937 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195faa-86f2-4b3e-b11c-d4c196682e77 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:59.888644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab195faa-86f2-4b3e-b11c-d4c196682e77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:59.889055 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab195faa-86f2-4b3e-b11c-d4c196682e77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:59.890987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab195faa-86f2-4b3e-b11c-d4c196682e77 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:59.910314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 524/1048] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:13:59.911550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab195faa-86f2-4b3e-b11c-d4c196682e77 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:59.920961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d17d81-209b-47c9-a26f-f1f5f262cfff None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:59.957526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55460a87-4f39-47ac-bec6-b9f6381ad740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:59.958056 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55460a87-4f39-47ac-bec6-b9f6381ad740 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:59.958332 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55460a87-4f39-47ac-bec6-b9f6381ad740 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:59.958600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55460a87-4f39-47ac-bec6-b9f6381ad740 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:59.959275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55460a87-4f39-47ac-bec6-b9f6381ad740 None admin] RBAC: Adding query filter params (type=image) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:13:59.959601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55460a87-4f39-47ac-bec6-b9f6381ad740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:59.960956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55460a87-4f39-47ac-bec6-b9f6381ad740 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:59.966888 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 525/1049] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:13:59.972423 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55460a87-4f39-47ac-bec6-b9f6381ad740 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:00.031545 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab195faa-86f2-4b3e-b11c-d4c196682e77 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:00.061612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:00.072257 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfc5c1-6c76-47bb-8638-c68c5465507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:00.072679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfc5c1-6c76-47bb-8638-c68c5465507a None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:00.072992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfc5c1-6c76-47bb-8638-c68c5465507a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:00.073272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfc5c1-6c76-47bb-8638-c68c5465507a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:00.074021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfc5c1-6c76-47bb-8638-c68c5465507a None admin] RBAC: Adding query filter params (role.id=3af90443fd0d4f55a3440b82ea610fff, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=2136cf1160a64951ad780424cb28403b) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:00.074309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfc5c1-6c76-47bb-8638-c68c5465507a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:00.075776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfc5c1-6c76-47bb-8638-c68c5465507a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:00.090849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 525/1050] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:13:59 2022] GET /identity/v3/role_assignments?user.id=2136cf1160a64951ad780424cb28403b&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=3af90443fd0d4f55a3440b82ea610fff => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:00.095086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55460a87-4f39-47ac-bec6-b9f6381ad740 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:00.130550 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:00.137269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940973b-e863-4929-af46-84a776109d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:00.138097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940973b-e863-4929-af46-84a776109d04 None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:00.138470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940973b-e863-4929-af46-84a776109d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:00.138873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940973b-e863-4929-af46-84a776109d04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:00.139668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940973b-e863-4929-af46-84a776109d04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:00.141208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940973b-e863-4929-af46-84a776109d04 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:00.173482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 526/1051] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:13:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:14:00.305279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27df30d-b130-407e-ab98-1075c7e19814 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:00.305459 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27df30d-b130-407e-ab98-1075c7e19814 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:00.305846 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27df30d-b130-407e-ab98-1075c7e19814 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:00.307423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 526/1052] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:00.313552 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185aabff-e658-4173-b8a4-ba0149ba836a None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:00.314131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185aabff-e658-4173-b8a4-ba0149ba836a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:00.314131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185aabff-e658-4173-b8a4-ba0149ba836a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:00.334622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-185aabff-e658-4173-b8a4-ba0149ba836a None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:00.335853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-185aabff-e658-4173-b8a4-ba0149ba836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:00.420336 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 527/1053] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:00.442747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27df30d-b130-407e-ab98-1075c7e19814 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:00.560779 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27df30d-b130-407e-ab98-1075c7e19814 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:00.596015 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213120c-b2f7-4f92-b4d6-f62a24c99219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:00.598952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213120c-b2f7-4f92-b4d6-f62a24c99219 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:00.598952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213120c-b2f7-4f92-b4d6-f62a24c99219 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:00.598952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213120c-b2f7-4f92-b4d6-f62a24c99219 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:00.608773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213120c-b2f7-4f92-b4d6-f62a24c99219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-e213120c-b2f7-4f92-b4d6-f62a24c99219 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:14:00.613542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:00.614617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:00.616744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:00.616744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:00.616744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:00.616744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:00.616744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:14:00.616744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:14:00.616744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:14:00.616744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:14:00.616744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:14:00.616744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:14:00.616744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:00.616744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:14:00.618738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 527/1054] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:14:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:00.621223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185aabff-e658-4173-b8a4-ba0149ba836a None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:00.733736 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185aabff-e658-4173-b8a4-ba0149ba836a None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:00.749188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:00.772875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bf0c1-9018-4e61-a8de-45f3e3062e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:00.773492 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bf0c1-9018-4e61-a8de-45f3e3062e8b None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:00.773767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bf0c1-9018-4e61-a8de-45f3e3062e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:00.774039 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bf0c1-9018-4e61-a8de-45f3e3062e8b None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:00.774710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bf0c1-9018-4e61-a8de-45f3e3062e8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:00.775051 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bf0c1-9018-4e61-a8de-45f3e3062e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:00.776444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bf0c1-9018-4e61-a8de-45f3e3062e8b None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:00.785372 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 528/1055] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:00.791788 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213120c-b2f7-4f92-b4d6-f62a24c99219 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:00.848959 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:00.901735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213120c-b2f7-4f92-b4d6-f62a24c99219 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:00.937814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d844a-99b6-4001-8391-bd1ee5d380a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:00.938697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d844a-99b6-4001-8391-bd1ee5d380a8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:00.939147 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d844a-99b6-4001-8391-bd1ee5d380a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:00.939544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d844a-99b6-4001-8391-bd1ee5d380a8 None admin] PATH_INFO: `/v3/users/847fae5f55fb4f69877d0f4b73286360` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:00.954790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d844a-99b6-4001-8391-bd1ee5d380a8 None admin] RBAC: Authorizing `identity:get_user(user_id=847fae5f55fb4f69877d0f4b73286360)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:00.956375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d844a-99b6-4001-8391-bd1ee5d380a8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:00.958302 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 528/1056] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:00 2022] GET /identity/v3/users/847fae5f55fb4f69877d0f4b73286360 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:00.964215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bf0c1-9018-4e61-a8de-45f3e3062e8b None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:01.078698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bf0c1-9018-4e61-a8de-45f3e3062e8b None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:01.111892 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09317ad0-5134-4a7b-ac6e-52ae34732a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:01.112498 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09317ad0-5134-4a7b-ac6e-52ae34732a93 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:01.112775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09317ad0-5134-4a7b-ac6e-52ae34732a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:01.113046 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09317ad0-5134-4a7b-ac6e-52ae34732a93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:01.159816 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:01.184396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09317ad0-5134-4a7b-ac6e-52ae34732a93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:01.185859 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09317ad0-5134-4a7b-ac6e-52ae34732a93 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:01.292565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 529/1057] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:14:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:14:01.298434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d844a-99b6-4001-8391-bd1ee5d380a8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:01.426529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d844a-99b6-4001-8391-bd1ee5d380a8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:01.435995 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:01.462860 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fd5ae-d8f5-4bad-b961-a69f82e4b047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:01.463738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fd5ae-d8f5-4bad-b961-a69f82e4b047 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:01.464152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fd5ae-d8f5-4bad-b961-a69f82e4b047 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:01.464558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fd5ae-d8f5-4bad-b961-a69f82e4b047 None admin] PATH_INFO: `/v3/projects/449e146113c542d0b4a43190804c5e8a` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:01.465798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fd5ae-d8f5-4bad-b961-a69f82e4b047 None admin] RBAC: Authorizing `identity:get_project(project_id=449e146113c542d0b4a43190804c5e8a)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:01.467543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fd5ae-d8f5-4bad-b961-a69f82e4b047 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:01.469671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 529/1058] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:14:01 2022] GET /identity/v3/projects/449e146113c542d0b4a43190804c5e8a => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:01.476091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09317ad0-5134-4a7b-ac6e-52ae34732a93 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:01.558197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:01.582720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09317ad0-5134-4a7b-ac6e-52ae34732a93 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:01.618631 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56912797-acfa-4250-a515-208a02788a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:01.619274 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56912797-acfa-4250-a515-208a02788a65 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:01.619555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56912797-acfa-4250-a515-208a02788a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:01.619810 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56912797-acfa-4250-a515-208a02788a65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:01.621011 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56912797-acfa-4250-a515-208a02788a65 None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=449e146113c542d0b4a43190804c5e8a, user.id=847fae5f55fb4f69877d0f4b73286360) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:01.621328 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56912797-acfa-4250-a515-208a02788a65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:01.622762 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56912797-acfa-4250-a515-208a02788a65 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:01.628739 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 530/1059] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:14:01 2022] GET /identity/v3/role_assignments?user.id=847fae5f55fb4f69877d0f4b73286360&scope.project.id=449e146113c542d0b4a43190804c5e8a&role.id=169d11e171d04c87af71475295957618 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:02.135663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51ff0-9d44-4ee9-a277-d0b908cc7b37 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:02.136232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51ff0-9d44-4ee9-a277-d0b908cc7b37 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:02.136232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51ff0-9d44-4ee9-a277-d0b908cc7b37 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:02.137748 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 530/1060] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:02.142944 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d324-91cc-4000-aa20-d8928b0810a1 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:02.143253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d324-91cc-4000-aa20-d8928b0810a1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:02.143549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d324-91cc-4000-aa20-d8928b0810a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:02.162104 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-7164d324-91cc-4000-aa20-d8928b0810a1 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:02.163314 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7164d324-91cc-4000-aa20-d8928b0810a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:02.189061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a1423-f848-49fc-b8b4-0b116b455617 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:02.189379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a1423-f848-49fc-b8b4-0b116b455617 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:02.189583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a1423-f848-49fc-b8b4-0b116b455617 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:02.191251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 531/1061] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:14:02.195903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b1d94-4597-4511-884f-fab937db49c9 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:02.196164 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b1d94-4597-4511-884f-fab937db49c9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:02.196442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b1d94-4597-4511-884f-fab937db49c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:02.214232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-3f0b1d94-4597-4511-884f-fab937db49c9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:02.215773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-3f0b1d94-4597-4511-884f-fab937db49c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:02.236995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 531/1062] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:02.260547 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164d324-91cc-4000-aa20-d8928b0810a1 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:02.290284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 532/1063] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:14:02.312089 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b1d94-4597-4511-884f-fab937db49c9 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:02.333920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:02.371159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164d324-91cc-4000-aa20-d8928b0810a1 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:02.411889 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f7f20-8cc4-4250-9833-35beb0fcc9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:02.412541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f7f20-8cc4-4250-9833-35beb0fcc9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:02.412806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f7f20-8cc4-4250-9833-35beb0fcc9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:02.413066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f7f20-8cc4-4250-9833-35beb0fcc9e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:02.417018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b1d94-4597-4511-884f-fab937db49c9 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:02.423472 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f7f20-8cc4-4250-9833-35beb0fcc9e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:14:02.424879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-d43f7f20-8cc4-4250-9833-35beb0fcc9e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:14:02.428240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:02.429243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:02.430091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:02.430091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:02.430091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:02.430091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:02.430091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:14:02.430091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:14:02.430091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:14:02.430091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:14:02.430091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:14:02.430091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:14:02.430091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:14:02.430091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:14:02.430091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 532/1064] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Aug 9 11:14:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:02.435392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f7f20-8cc4-4250-9833-35beb0fcc9e9 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:02.458338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931da980-aad8-4a06-91f7-1ed43f03e76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:02.459267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da980-aad8-4a06-91f7-1ed43f03e76c None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:02.459544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da980-aad8-4a06-91f7-1ed43f03e76c None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:02.459806 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da980-aad8-4a06-91f7-1ed43f03e76c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:02.536491 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931da980-aad8-4a06-91f7-1ed43f03e76c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:02.538085 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931da980-aad8-4a06-91f7-1ed43f03e76c None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:02.547491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f7f20-8cc4-4250-9833-35beb0fcc9e9 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:02.576878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:02.585157 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19302754-86c7-4234-87ac-6f32ca5c1c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:02.585779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19302754-86c7-4234-87ac-6f32ca5c1c6f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:02.586047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19302754-86c7-4234-87ac-6f32ca5c1c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:02.586617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19302754-86c7-4234-87ac-6f32ca5c1c6f None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:02.587395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19302754-86c7-4234-87ac-6f32ca5c1c6f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:02.587615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19302754-86c7-4234-87ac-6f32ca5c1c6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:02.588992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19302754-86c7-4234-87ac-6f32ca5c1c6f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:02.597881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 533/1065] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Aug 9 11:14:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:02.603470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19302754-86c7-4234-87ac-6f32ca5c1c6f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:02.654393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 533/1066] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:14:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 11:14:02.655243 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931da980-aad8-4a06-91f7-1ed43f03e76c None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:02.664483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:02.715057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19302754-86c7-4234-87ac-6f32ca5c1c6f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:02.752846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717d8f6-3188-495a-a438-c7ba7de46a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:02.753482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717d8f6-3188-495a-a438-c7ba7de46a79 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:02.753760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717d8f6-3188-495a-a438-c7ba7de46a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:02.754032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717d8f6-3188-495a-a438-c7ba7de46a79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:02.765586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717d8f6-3188-495a-a438-c7ba7de46a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:02.767163 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717d8f6-3188-495a-a438-c7ba7de46a79 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:02.771976 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931da980-aad8-4a06-91f7-1ed43f03e76c None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-e717d8f6-3188-495a-a438-c7ba7de46a79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:14:02.785045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:02.786094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:14:02.792093 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:14:02.792093 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:14:02.792093 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:14:02.792093 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 534/1067] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:02.793067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717d8f6-3188-495a-a438-c7ba7de46a79 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:02.815541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcabff-7319-45c9-b9fe-644a3a1ab7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:02.816214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcabff-7319-45c9-b9fe-644a3a1ab7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:02.816489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcabff-7319-45c9-b9fe-644a3a1ab7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:02.816730 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcabff-7319-45c9-b9fe-644a3a1ab7e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:02.828845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcabff-7319-45c9-b9fe-644a3a1ab7e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:02.830446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcabff-7319-45c9-b9fe-644a3a1ab7e3 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-50bcabff-7319-45c9-b9fe-644a3a1ab7e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:14:02.848849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:02.849865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:14:02.851488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:14:02.851488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:14:02.851488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:14:02.851488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 534/1068] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:14:02.852687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:02.857048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcabff-7319-45c9-b9fe-644a3a1ab7e3 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:02.912091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717d8f6-3188-495a-a438-c7ba7de46a79 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:02.926500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:02.947698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb694e-7cde-4f28-8a66-5f1d09fcbce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:02.948306 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb694e-7cde-4f28-8a66-5f1d09fcbce3 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:02.948583 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb694e-7cde-4f28-8a66-5f1d09fcbce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:02.948853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb694e-7cde-4f28-8a66-5f1d09fcbce3 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:02.949547 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb694e-7cde-4f28-8a66-5f1d09fcbce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:02.949853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb694e-7cde-4f28-8a66-5f1d09fcbce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:02.951269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb694e-7cde-4f28-8a66-5f1d09fcbce3 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:02.963459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 535/1069] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:14:02.969012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb694e-7cde-4f28-8a66-5f1d09fcbce3 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:02.980985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcabff-7319-45c9-b9fe-644a3a1ab7e3 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:03.016378 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3843579-cc39-4c20-8807-1781934f675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:03.017119 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843579-cc39-4c20-8807-1781934f675a None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:03.017281 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843579-cc39-4c20-8807-1781934f675a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:03.017519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843579-cc39-4c20-8807-1781934f675a None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:03.018161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3843579-cc39-4c20-8807-1781934f675a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:03.018461 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3843579-cc39-4c20-8807-1781934f675a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:03.020017 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3843579-cc39-4c20-8807-1781934f675a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:03.033892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 535/1070] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:03.095226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb694e-7cde-4f28-8a66-5f1d09fcbce3 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:03.099251 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:03.148617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b542749-c42d-491f-adc6-e1db75d60e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:03.149325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b542749-c42d-491f-adc6-e1db75d60e9c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:03.149592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b542749-c42d-491f-adc6-e1db75d60e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:03.149861 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b542749-c42d-491f-adc6-e1db75d60e9c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:03.158874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b542749-c42d-491f-adc6-e1db75d60e9c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:03.160394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b542749-c42d-491f-adc6-e1db75d60e9c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-9b542749-c42d-491f-adc6-e1db75d60e9c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:14:03.174391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:03.176851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:03.178511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:03.178511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:03.178511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:14:03.178511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:14:03.178511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:14:03.178511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:14:03.178511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:14:03.178511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:14:03.178511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:14:03.178511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:14:03.178511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 536/1071] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Aug 9 11:14:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:14:03.181663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3843579-cc39-4c20-8807-1781934f675a None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:03.295889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3843579-cc39-4c20-8807-1781934f675a None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:03.317084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:03.335183 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21472e-4060-4011-b323-5f187b07520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:03.336170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21472e-4060-4011-b323-5f187b07520b None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:03.336657 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21472e-4060-4011-b323-5f187b07520b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:03.337128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21472e-4060-4011-b323-5f187b07520b None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:03.338053 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21472e-4060-4011-b323-5f187b07520b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:03.338549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21472e-4060-4011-b323-5f187b07520b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:03.340251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21472e-4060-4011-b323-5f187b07520b None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:03.358640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 536/1072] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Aug 9 11:14:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:03.364504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b542749-c42d-491f-adc6-e1db75d60e9c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:03.464858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b542749-c42d-491f-adc6-e1db75d60e9c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:03.500544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e4527-c26d-4dd2-9812-a1954c179be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:03.501166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e4527-c26d-4dd2-9812-a1954c179be6 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:03.501436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e4527-c26d-4dd2-9812-a1954c179be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:03.501698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e4527-c26d-4dd2-9812-a1954c179be6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:03.512361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e4527-c26d-4dd2-9812-a1954c179be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:03.513816 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e4527-c26d-4dd2-9812-a1954c179be6 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-4e2e4527-c26d-4dd2-9812-a1954c179be6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:14:03.529023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:03.530066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:14:03.531024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:14:03.531024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:14:03.531024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:14:03.535038 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 537/1073] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:03.536095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21472e-4060-4011-b323-5f187b07520b None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:03.612554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa3595-0709-47e1-b657-e39c63da5d2c None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:03.613119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa3595-0709-47e1-b657-e39c63da5d2c None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:03.613119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa3595-0709-47e1-b657-e39c63da5d2c None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:03.614422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 538/1074] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:14:03.619446 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a66df-7e82-46d3-aab5-0cc9f069cc80 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:03.619728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a66df-7e82-46d3-aab5-0cc9f069cc80 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:03.620371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a66df-7e82-46d3-aab5-0cc9f069cc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:03.637166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21472e-4060-4011-b323-5f187b07520b None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:03.638222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ac0a66df-7e82-46d3-aab5-0cc9f069cc80 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:03.639430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ac0a66df-7e82-46d3-aab5-0cc9f069cc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:03.650329 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:03.671717 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d12b6-3a4d-47fa-9fbf-ad0e323fc3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:03.672317 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d12b6-3a4d-47fa-9fbf-ad0e323fc3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:03.672592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d12b6-3a4d-47fa-9fbf-ad0e323fc3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:03.672849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d12b6-3a4d-47fa-9fbf-ad0e323fc3e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:03.673538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d12b6-3a4d-47fa-9fbf-ad0e323fc3e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:03.673761 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d12b6-3a4d-47fa-9fbf-ad0e323fc3e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:03.675198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d12b6-3a4d-47fa-9fbf-ad0e323fc3e1 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:03.686472 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 537/1075] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:14:03.692456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d12b6-3a4d-47fa-9fbf-ad0e323fc3e1 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:03.711968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 539/1076] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:14:03.731378 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:03.734130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a66df-7e82-46d3-aab5-0cc9f069cc80 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:03.800158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d12b6-3a4d-47fa-9fbf-ad0e323fc3e1 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:03.836796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8480b-a786-4b86-83dd-a10beaae02c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:03.837402 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a66df-7e82-46d3-aab5-0cc9f069cc80 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:03.837513 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8480b-a786-4b86-83dd-a10beaae02c5 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:03.837684 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8480b-a786-4b86-83dd-a10beaae02c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:03.837951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8480b-a786-4b86-83dd-a10beaae02c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:03.845017 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8480b-a786-4b86-83dd-a10beaae02c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:03.846582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8480b-a786-4b86-83dd-a10beaae02c5 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-e9d8480b-a786-4b86-83dd-a10beaae02c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:14:03.857952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:03.859116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:03.860044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:14:03.860044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:14:03.860044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:14:03.860044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:14:03.860044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:14:03.860044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:14:03.860044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:14:03.860044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:14:03.860044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 538/1077] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:14:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:14:03.865003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8480b-a786-4b86-83dd-a10beaae02c5 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:03.874521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067435ea-a215-4868-89f2-d97f3d0642bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:03.875199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067435ea-a215-4868-89f2-d97f3d0642bc None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:03.875474 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067435ea-a215-4868-89f2-d97f3d0642bc None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:03.875826 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067435ea-a215-4868-89f2-d97f3d0642bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:03.886630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067435ea-a215-4868-89f2-d97f3d0642bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-067435ea-a215-4868-89f2-d97f3d0642bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:14:03.891358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:03.892321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:03.893183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:03.893183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:03.893183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:03.893183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:03.893183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:14:03.893183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:14:03.893183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:14:03.893183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:14:03.893183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:14:03.893183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:14:03.893183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:03.893183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:14:03.893183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 540/1078] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:14:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:03.899196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067435ea-a215-4868-89f2-d97f3d0642bc None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:03.909804 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:03.964209 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:03.970239 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8480b-a786-4b86-83dd-a10beaae02c5 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:04.003876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067435ea-a215-4868-89f2-d97f3d0642bc None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:04.007368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3754912-afa3-4e93-b511-f9337af9ef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:04.007993 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3754912-afa3-4e93-b511-f9337af9ef1c None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:04.008272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3754912-afa3-4e93-b511-f9337af9ef1c None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:04.008549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3754912-afa3-4e93-b511-f9337af9ef1c None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:04.009228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3754912-afa3-4e93-b511-f9337af9ef1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:04.009528 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3754912-afa3-4e93-b511-f9337af9ef1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:04.011031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3754912-afa3-4e93-b511-f9337af9ef1c None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:04.024649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 539/1079] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:14:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:04.030733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3754912-afa3-4e93-b511-f9337af9ef1c None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:04.040879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335ab48-905a-4f91-a5dd-2d0fad39b15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:04.041485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335ab48-905a-4f91-a5dd-2d0fad39b15f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:04.041753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335ab48-905a-4f91-a5dd-2d0fad39b15f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:04.042019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335ab48-905a-4f91-a5dd-2d0fad39b15f None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:04.042677 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335ab48-905a-4f91-a5dd-2d0fad39b15f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:04.043052 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335ab48-905a-4f91-a5dd-2d0fad39b15f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:04.044426 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335ab48-905a-4f91-a5dd-2d0fad39b15f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:04.053294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 541/1080] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:14:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:04.059081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335ab48-905a-4f91-a5dd-2d0fad39b15f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:04.126682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:04.134739 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3754912-afa3-4e93-b511-f9337af9ef1c None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:04.161334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335ab48-905a-4f91-a5dd-2d0fad39b15f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:04.169577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c129a7-752a-4656-878c-4c3537e887fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:04.170226 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c129a7-752a-4656-878c-4c3537e887fb None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:04.170522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c129a7-752a-4656-878c-4c3537e887fb None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:04.170776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c129a7-752a-4656-878c-4c3537e887fb None admin] PATH_INFO: `/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/2136cf1160a64951ad780424cb28403b/roles/3af90443fd0d4f55a3440b82ea610fff` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:04.173229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c129a7-752a-4656-878c-4c3537e887fb None admin] RBAC: Authorizing `identity:create_grant(project_id=f53fb3d6b68b4654ae7247c9b74015e7, user_id=2136cf1160a64951ad780424cb28403b, role_id=3af90443fd0d4f55a3440b82ea610fff)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:04.174947 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c129a7-752a-4656-878c-4c3537e887fb None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:04.189649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 540/1081] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:14:04 2022] PUT /identity/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/2136cf1160a64951ad780424cb28403b/roles/3af90443fd0d4f55a3440b82ea610fff => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:14:04.203490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4d49c-9eb8-4f5e-8343-c5100a5e8bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:04.203490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4d49c-9eb8-4f5e-8343-c5100a5e8bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:04.203490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4d49c-9eb8-4f5e-8343-c5100a5e8bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:04.203490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4d49c-9eb8-4f5e-8343-c5100a5e8bd9 None admin] PATH_INFO: `/v3/users/847fae5f55fb4f69877d0f4b73286360` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:04.203963 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4d49c-9eb8-4f5e-8343-c5100a5e8bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=847fae5f55fb4f69877d0f4b73286360)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:04.203963 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4d49c-9eb8-4f5e-8343-c5100a5e8bd9 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:04.203963 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 542/1082] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:04 2022] GET /identity/v3/users/847fae5f55fb4f69877d0f4b73286360 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:14:04.207510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c129a7-752a-4656-878c-4c3537e887fb None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:04.228211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:04.319702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c129a7-752a-4656-878c-4c3537e887fb None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:04.356417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbe4e0-0018-475d-b628-58ad9276f9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:04.357056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbe4e0-0018-475d-b628-58ad9276f9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:04.357323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbe4e0-0018-475d-b628-58ad9276f9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:04.357584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbe4e0-0018-475d-b628-58ad9276f9b6 None admin] PATH_INFO: `/v3/projects/449e146113c542d0b4a43190804c5e8a` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:04.358737 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbe4e0-0018-475d-b628-58ad9276f9b6 None admin] RBAC: Authorizing `identity:get_project(project_id=449e146113c542d0b4a43190804c5e8a)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:04.360207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbe4e0-0018-475d-b628-58ad9276f9b6 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:04.361919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 541/1083] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:14:04 2022] GET /identity/v3/projects/449e146113c542d0b4a43190804c5e8a => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:04.368384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4d49c-9eb8-4f5e-8343-c5100a5e8bd9 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:04.472834 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4d49c-9eb8-4f5e-8343-c5100a5e8bd9 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:04.511496 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c1c53-7ebe-43f1-b951-028561cc8026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:04.512158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c1c53-7ebe-43f1-b951-028561cc8026 None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:04.512435 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c1c53-7ebe-43f1-b951-028561cc8026 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:04.512700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c1c53-7ebe-43f1-b951-028561cc8026 None admin] PATH_INFO: `/v3/projects/449e146113c542d0b4a43190804c5e8a/users/847fae5f55fb4f69877d0f4b73286360/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:04.514645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c1c53-7ebe-43f1-b951-028561cc8026 None admin] RBAC: Authorizing `identity:create_grant(project_id=449e146113c542d0b4a43190804c5e8a, user_id=847fae5f55fb4f69877d0f4b73286360, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:04.516133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c1c53-7ebe-43f1-b951-028561cc8026 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:04.519297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:04.531881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 543/1084] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:14:04 2022] PUT /identity/v3/projects/449e146113c542d0b4a43190804c5e8a/users/847fae5f55fb4f69877d0f4b73286360/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:14:06.159486 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f4204-2240-4b52-8065-b1787f14e055 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:06.160054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f4204-2240-4b52-8065-b1787f14e055 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:06.160141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f4204-2240-4b52-8065-b1787f14e055 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:06.161627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 542/1085] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:06.167055 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a595a-1460-42ef-a7aa-65cadc2db075 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:06.167493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a595a-1460-42ef-a7aa-65cadc2db075 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:06.167609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a595a-1460-42ef-a7aa-65cadc2db075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:06.186058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-391a595a-1460-42ef-a7aa-65cadc2db075 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:06.187250 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-391a595a-1460-42ef-a7aa-65cadc2db075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:06.258355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 544/1086] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:06.282344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f4204-2240-4b52-8065-b1787f14e055 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:06.371470 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:06.388883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f4204-2240-4b52-8065-b1787f14e055 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:06.423925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141c3c0-6447-411e-966d-39180746f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:06.424587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141c3c0-6447-411e-966d-39180746f3af None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:06.424862 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141c3c0-6447-411e-966d-39180746f3af None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:06.425125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141c3c0-6447-411e-966d-39180746f3af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:06.435516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141c3c0-6447-411e-966d-39180746f3af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-f141c3c0-6447-411e-966d-39180746f3af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:14:06.440189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:06.441368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:06.442417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:06.442417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:06.442417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:06.442417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:06.442417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:14:06.442417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:14:06.442417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:14:06.442417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:14:06.442417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:14:06.442417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:14:06.442417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:14:06.442417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:14:06.446341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 543/1087] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Aug 9 11:14:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:06.447412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a595a-1460-42ef-a7aa-65cadc2db075 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:06.551938 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a595a-1460-42ef-a7aa-65cadc2db075 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:06.570193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49e0e7-9e6c-43bf-8c13-2c8cda90250e None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:06.570464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49e0e7-9e6c-43bf-8c13-2c8cda90250e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:06.570780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49e0e7-9e6c-43bf-8c13-2c8cda90250e None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:06.572136 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 544/1088] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:06.577279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35024fb-37a7-4b38-a7d3-60d96e926ca9 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:06.577589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35024fb-37a7-4b38-a7d3-60d96e926ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:06.577856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35024fb-37a7-4b38-a7d3-60d96e926ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:06.585619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:06.598221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f35024fb-37a7-4b38-a7d3-60d96e926ca9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:06.598445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226f207-3d0b-47ec-832b-b0ef46f3469e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:06.599015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226f207-3d0b-47ec-832b-b0ef46f3469e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:06.599292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226f207-3d0b-47ec-832b-b0ef46f3469e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:06.599446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f35024fb-37a7-4b38-a7d3-60d96e926ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:06.599633 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226f207-3d0b-47ec-832b-b0ef46f3469e None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:06.600216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226f207-3d0b-47ec-832b-b0ef46f3469e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:06.600528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226f207-3d0b-47ec-832b-b0ef46f3469e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:06.601919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226f207-3d0b-47ec-832b-b0ef46f3469e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:06.610708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 545/1089] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Aug 9 11:14:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:06.617024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226f207-3d0b-47ec-832b-b0ef46f3469e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:06.669689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 545/1090] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:14:06.692976 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35024fb-37a7-4b38-a7d3-60d96e926ca9 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:06.718321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226f207-3d0b-47ec-832b-b0ef46f3469e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:06.756320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557285b-7661-4907-ba7a-47af98d3ee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:06.756837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557285b-7661-4907-ba7a-47af98d3ee29 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:06.756837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557285b-7661-4907-ba7a-47af98d3ee29 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:06.757040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557285b-7661-4907-ba7a-47af98d3ee29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:06.768733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557285b-7661-4907-ba7a-47af98d3ee29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:06.770222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557285b-7661-4907-ba7a-47af98d3ee29 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:06.773790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-8557285b-7661-4907-ba7a-47af98d3ee29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:14:06.784908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:06.785904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:14:06.786851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:14:06.786851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:14:06.786851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:14:06.786851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 546/1091] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:06.792008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557285b-7661-4907-ba7a-47af98d3ee29 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:06.802315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35024fb-37a7-4b38-a7d3-60d96e926ca9 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:06.837994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:06.841110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a41bc-a100-4d39-8032-9db82e777427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:06.842101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a41bc-a100-4d39-8032-9db82e777427 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:06.842593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a41bc-a100-4d39-8032-9db82e777427 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:06.843306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a41bc-a100-4d39-8032-9db82e777427 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:06.859712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a41bc-a100-4d39-8032-9db82e777427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-cb7a41bc-a100-4d39-8032-9db82e777427 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:14:06.864440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:06.865450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:06.866367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:06.866367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:06.866367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:06.866367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:06.866367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:14:06.866367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:14:06.866367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:14:06.866367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:14:06.866367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:14:06.866367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:14:06.866367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:06.866367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:14:06.866367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 546/1092] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:14:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:06.872053 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a41bc-a100-4d39-8032-9db82e777427 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:06.904623 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557285b-7661-4907-ba7a-47af98d3ee29 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:06.938767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2bd49-3a39-431e-a02e-335f08b84254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:06.939399 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2bd49-3a39-431e-a02e-335f08b84254 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:06.939674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2bd49-3a39-431e-a02e-335f08b84254 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:06.939993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2bd49-3a39-431e-a02e-335f08b84254 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:06.940621 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2bd49-3a39-431e-a02e-335f08b84254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:06.940926 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2bd49-3a39-431e-a02e-335f08b84254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:06.942304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2bd49-3a39-431e-a02e-335f08b84254 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:06.954920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 547/1093] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:14:06.960638 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2bd49-3a39-431e-a02e-335f08b84254 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:06.975759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a41bc-a100-4d39-8032-9db82e777427 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:07.009724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6766a8b-0957-4a52-a747-2adbb8c84196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:07.010340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6766a8b-0957-4a52-a747-2adbb8c84196 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:07.010616 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6766a8b-0957-4a52-a747-2adbb8c84196 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:07.010923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6766a8b-0957-4a52-a747-2adbb8c84196 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:07.011595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6766a8b-0957-4a52-a747-2adbb8c84196 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:07.011895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6766a8b-0957-4a52-a747-2adbb8c84196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:07.013281 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6766a8b-0957-4a52-a747-2adbb8c84196 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:07.014676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:07.023988 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 547/1094] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:14:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:07.033036 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6766a8b-0957-4a52-a747-2adbb8c84196 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:07.066910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:07.070663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2bd49-3a39-431e-a02e-335f08b84254 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:07.107394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ced126-e102-4551-9d79-ea8bbc45dd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:07.108208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced126-e102-4551-9d79-ea8bbc45dd95 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:07.108498 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced126-e102-4551-9d79-ea8bbc45dd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:07.108761 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced126-e102-4551-9d79-ea8bbc45dd95 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:07.116361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ced126-e102-4551-9d79-ea8bbc45dd95 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:07.117806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ced126-e102-4551-9d79-ea8bbc45dd95 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-27ced126-e102-4551-9d79-ea8bbc45dd95 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:14:07.130068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:07.131341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:07.132346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:07.132346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:07.132346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:14:07.132346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:14:07.132346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:14:07.132346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:14:07.132346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:14:07.132346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:14:07.132346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:14:07.132346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:14:07.132346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 548/1095] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Aug 9 11:14:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:14:07.136898 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ced126-e102-4551-9d79-ea8bbc45dd95 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:07.146636 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6766a8b-0957-4a52-a747-2adbb8c84196 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:07.183423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ceb81-3661-40c6-80f6-1156387e4f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:07.184266 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ceb81-3661-40c6-80f6-1156387e4f00 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:07.184266 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ceb81-3661-40c6-80f6-1156387e4f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:07.184542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ceb81-3661-40c6-80f6-1156387e4f00 None admin] PATH_INFO: `/v3/users/847fae5f55fb4f69877d0f4b73286360` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:07.185698 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ceb81-3661-40c6-80f6-1156387e4f00 None admin] RBAC: Authorizing `identity:get_user(user_id=847fae5f55fb4f69877d0f4b73286360)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:07.187176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ceb81-3661-40c6-80f6-1156387e4f00 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:07.188763 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 548/1096] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:07 2022] GET /identity/v3/users/847fae5f55fb4f69877d0f4b73286360 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:07.194790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ceb81-3661-40c6-80f6-1156387e4f00 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:07.237911 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ced126-e102-4551-9d79-ea8bbc45dd95 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:07.257939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:07.271526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792e1ff-f0fc-4f8c-a228-987f3e15ed52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:07.272132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792e1ff-f0fc-4f8c-a228-987f3e15ed52 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:07.272402 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792e1ff-f0fc-4f8c-a228-987f3e15ed52 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:07.272669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792e1ff-f0fc-4f8c-a228-987f3e15ed52 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:07.273388 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792e1ff-f0fc-4f8c-a228-987f3e15ed52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:07.273686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792e1ff-f0fc-4f8c-a228-987f3e15ed52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:07.275131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792e1ff-f0fc-4f8c-a228-987f3e15ed52 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:07.293109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 549/1097] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Aug 9 11:14:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:14:07.296174 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ceb81-3661-40c6-80f6-1156387e4f00 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:07.299110 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792e1ff-f0fc-4f8c-a228-987f3e15ed52 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:07.319239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:07.333781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4107a5-87b6-4715-887f-9fd9a2ce3478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:07.334397 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4107a5-87b6-4715-887f-9fd9a2ce3478 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:07.334671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4107a5-87b6-4715-887f-9fd9a2ce3478 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:07.334976 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4107a5-87b6-4715-887f-9fd9a2ce3478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:07.400804 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792e1ff-f0fc-4f8c-a228-987f3e15ed52 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:07.403213 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4107a5-87b6-4715-887f-9fd9a2ce3478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:07.404699 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4107a5-87b6-4715-887f-9fd9a2ce3478 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:07.438407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdb446-0d8f-4d78-9567-673558650a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:07.439033 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdb446-0d8f-4d78-9567-673558650a00 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:07.439297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdb446-0d8f-4d78-9567-673558650a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:07.439560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdb446-0d8f-4d78-9567-673558650a00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:07.465065 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:07.509788 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 549/1098] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:14:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 11:14:07.512795 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdb446-0d8f-4d78-9567-673558650a00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:07.514256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdb446-0d8f-4d78-9567-673558650a00 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:07.515595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4107a5-87b6-4715-887f-9fd9a2ce3478 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:07.533017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:07.617067 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4107a5-87b6-4715-887f-9fd9a2ce3478 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:07.618059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 550/1099] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:14:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 11:14:07.624202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdb446-0d8f-4d78-9567-673558650a00 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:07.653686 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662bf87-1807-4481-a0c2-cd6c183b456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:07.654678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662bf87-1807-4481-a0c2-cd6c183b456e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:07.654990 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662bf87-1807-4481-a0c2-cd6c183b456e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:07.655256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662bf87-1807-4481-a0c2-cd6c183b456e None admin] PATH_INFO: `/v3/projects/449e146113c542d0b4a43190804c5e8a` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:07.656661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662bf87-1807-4481-a0c2-cd6c183b456e None admin] RBAC: Authorizing `identity:get_project(project_id=449e146113c542d0b4a43190804c5e8a)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:07.659223 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662bf87-1807-4481-a0c2-cd6c183b456e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:07.661831 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 550/1100] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:14:07 2022] GET /identity/v3/projects/449e146113c542d0b4a43190804c5e8a => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:14:07.668385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662bf87-1807-4481-a0c2-cd6c183b456e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:07.704971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:07.761838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdb446-0d8f-4d78-9567-673558650a00 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:07.774103 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662bf87-1807-4481-a0c2-cd6c183b456e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:07.791218 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:07.808514 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894e05a-2ea8-4696-8780-6a30a42f35a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:07.809114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894e05a-2ea8-4696-8780-6a30a42f35a1 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:07.809361 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894e05a-2ea8-4696-8780-6a30a42f35a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:07.809627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894e05a-2ea8-4696-8780-6a30a42f35a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:07.810345 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894e05a-2ea8-4696-8780-6a30a42f35a1 None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=449e146113c542d0b4a43190804c5e8a, user.id=847fae5f55fb4f69877d0f4b73286360) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:07.810651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894e05a-2ea8-4696-8780-6a30a42f35a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:07.812135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894e05a-2ea8-4696-8780-6a30a42f35a1 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:07.813469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181c0ea-0058-4e60-a352-0f44f8cd9ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:07.814101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181c0ea-0058-4e60-a352-0f44f8cd9ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:07.814373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181c0ea-0058-4e60-a352-0f44f8cd9ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:07.814645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181c0ea-0058-4e60-a352-0f44f8cd9ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:07.818136 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 551/1101] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:14:07 2022] GET /identity/v3/role_assignments?user.id=847fae5f55fb4f69877d0f4b73286360&scope.project.id=449e146113c542d0b4a43190804c5e8a&role.id=169d11e171d04c87af71475295957618 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:14:07.824831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181c0ea-0058-4e60-a352-0f44f8cd9ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:07.826305 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181c0ea-0058-4e60-a352-0f44f8cd9ae2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-1181c0ea-0058-4e60-a352-0f44f8cd9ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:14:07.843108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:07.844201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:14:07.845542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:14:07.845542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:14:07.845542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:14:07.845542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 551/1102] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:07.850734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894e05a-2ea8-4696-8780-6a30a42f35a1 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:07.957094 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:07.972308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894e05a-2ea8-4696-8780-6a30a42f35a1 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:08.011555 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd826f8c-9653-4319-8d00-488cca19a6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:08.012331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd826f8c-9653-4319-8d00-488cca19a6dc None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:08.012475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd826f8c-9653-4319-8d00-488cca19a6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:08.012907 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd826f8c-9653-4319-8d00-488cca19a6dc None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:08.013335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd826f8c-9653-4319-8d00-488cca19a6dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:08.013629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd826f8c-9653-4319-8d00-488cca19a6dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:08.015047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd826f8c-9653-4319-8d00-488cca19a6dc None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:08.027963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 552/1103] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:08.034751 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181c0ea-0058-4e60-a352-0f44f8cd9ae2 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:08.153654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181c0ea-0058-4e60-a352-0f44f8cd9ae2 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:08.188304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f9172-ba31-4d71-a83e-ba2673943495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:08.188933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9172-ba31-4d71-a83e-ba2673943495 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:08.189194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9172-ba31-4d71-a83e-ba2673943495 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:08.189470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9172-ba31-4d71-a83e-ba2673943495 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:08.196514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f9172-ba31-4d71-a83e-ba2673943495 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:08.197987 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f9172-ba31-4d71-a83e-ba2673943495 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-573f9172-ba31-4d71-a83e-ba2673943495 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:14:08.209322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:08.210508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:08.211792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:14:08.211792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:14:08.211792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:14:08.211792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:14:08.211792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:14:08.211792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:14:08.211792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:14:08.211792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:14:08.211792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 552/1104] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:14:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:14:08.216402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd826f8c-9653-4319-8d00-488cca19a6dc None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:08.335109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd826f8c-9653-4319-8d00-488cca19a6dc None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:08.372965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea38f3-642c-4242-8500-8fc926bc1ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:08.373729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea38f3-642c-4242-8500-8fc926bc1ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:08.373895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea38f3-642c-4242-8500-8fc926bc1ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:08.374089 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea38f3-642c-4242-8500-8fc926bc1ee9 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:08.374775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea38f3-642c-4242-8500-8fc926bc1ee9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:08.375099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea38f3-642c-4242-8500-8fc926bc1ee9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:08.376842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea38f3-642c-4242-8500-8fc926bc1ee9 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:08.395579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 553/1105] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:08.397326 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f9172-ba31-4d71-a83e-ba2673943495 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:08.431347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:08.506272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f9172-ba31-4d71-a83e-ba2673943495 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:08.540621 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d20ab5-a350-4b26-9d33-4a8cf38672ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:08.541211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20ab5-a350-4b26-9d33-4a8cf38672ca None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:08.541488 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20ab5-a350-4b26-9d33-4a8cf38672ca None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:08.541748 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20ab5-a350-4b26-9d33-4a8cf38672ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:08.542480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d20ab5-a350-4b26-9d33-4a8cf38672ca None admin] RBAC: Adding query filter params (role.id=3af90443fd0d4f55a3440b82ea610fff, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=2136cf1160a64951ad780424cb28403b) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:08.542779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d20ab5-a350-4b26-9d33-4a8cf38672ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:08.544241 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d20ab5-a350-4b26-9d33-4a8cf38672ca None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:08.550640 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 553/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:14:08 2022] GET /identity/v3/role_assignments?user.id=2136cf1160a64951ad780424cb28403b&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=3af90443fd0d4f55a3440b82ea610fff => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:09.823749 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261607ef-45a4-4a8f-aa4b-bf556459d56e None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:09.824280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261607ef-45a4-4a8f-aa4b-bf556459d56e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:09.824280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261607ef-45a4-4a8f-aa4b-bf556459d56e None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:09.825528 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 554/1107] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:09.831035 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16878a3-5979-4028-b642-71bbfcd6cc36 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:09.831480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16878a3-5979-4028-b642-71bbfcd6cc36 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:09.831575 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16878a3-5979-4028-b642-71bbfcd6cc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:09.850745 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c16878a3-5979-4028-b642-71bbfcd6cc36 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:09.851980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c16878a3-5979-4028-b642-71bbfcd6cc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:09.921126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 554/1108] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:09.945637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261607ef-45a4-4a8f-aa4b-bf556459d56e None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:09.966485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:10.052106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261607ef-45a4-4a8f-aa4b-bf556459d56e None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:10.085713 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726cc85-8f1d-4737-b10d-c9d042f0d6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:10.086251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726cc85-8f1d-4737-b10d-c9d042f0d6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:10.086599 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726cc85-8f1d-4737-b10d-c9d042f0d6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:10.086775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726cc85-8f1d-4737-b10d-c9d042f0d6f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:10.087935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726cc85-8f1d-4737-b10d-c9d042f0d6f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:10.089371 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726cc85-8f1d-4737-b10d-c9d042f0d6f9 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:10.090959 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 555/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:14:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:10.096938 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16878a3-5979-4028-b642-71bbfcd6cc36 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:10.121988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:10.198445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16878a3-5979-4028-b642-71bbfcd6cc36 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:10.233566 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db30dc-b007-4a05-9ee6-2412b23e1c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:10.234166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db30dc-b007-4a05-9ee6-2412b23e1c79 None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:10.234445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db30dc-b007-4a05-9ee6-2412b23e1c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:10.234713 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db30dc-b007-4a05-9ee6-2412b23e1c79 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:10.235391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db30dc-b007-4a05-9ee6-2412b23e1c79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:10.236886 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db30dc-b007-4a05-9ee6-2412b23e1c79 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:10.260154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 555/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:14:10 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:14:12.274597 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d85f71-5445-4d12-b111-c268681d71d8 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:12.275194 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d85f71-5445-4d12-b111-c268681d71d8 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:12.275194 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d85f71-5445-4d12-b111-c268681d71d8 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:12.276528 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 556/1111] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:12.282322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818db34-1419-4898-8489-791a1eaec33e None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:12.282868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818db34-1419-4898-8489-791a1eaec33e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:12.282868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818db34-1419-4898-8489-791a1eaec33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:12.302397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-f818db34-1419-4898-8489-791a1eaec33e None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:12.303645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f818db34-1419-4898-8489-791a1eaec33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:12.373953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 556/1112] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:12.397246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d85f71-5445-4d12-b111-c268681d71d8 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:12.487013 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:12.505181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d85f71-5445-4d12-b111-c268681d71d8 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:12.538199 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d51623-ee4b-492d-8def-d073829ee9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:12.538716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d51623-ee4b-492d-8def-d073829ee9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:12.539036 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d51623-ee4b-492d-8def-d073829ee9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:12.539301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d51623-ee4b-492d-8def-d073829ee9c8 None admin] PATH_INFO: `/v3/roles/6b72aeaf7c3646bdb33b40a371cc4d44` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:12.540688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d51623-ee4b-492d-8def-d073829ee9c8 None admin] RBAC: Authorizing `identity:get_role(role_id=6b72aeaf7c3646bdb33b40a371cc4d44)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:12.542060 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d51623-ee4b-492d-8def-d073829ee9c8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:12.543437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 557/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:12 2022] GET /identity/v3/roles/6b72aeaf7c3646bdb33b40a371cc4d44 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:12.549615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818db34-1419-4898-8489-791a1eaec33e None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:12.561817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:12.656370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818db34-1419-4898-8489-791a1eaec33e None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:12.691578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9e4de-cc2f-4c70-976d-485c524c9332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:12.692203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9e4de-cc2f-4c70-976d-485c524c9332 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:12.692481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9e4de-cc2f-4c70-976d-485c524c9332 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:12.692746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9e4de-cc2f-4c70-976d-485c524c9332 None admin] PATH_INFO: `/v3/users/5ccf058a6abf4ae0abbc52dc15f91d37` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:12.707122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9e4de-cc2f-4c70-976d-485c524c9332 None admin] RBAC: Authorizing `identity:get_user(user_id=5ccf058a6abf4ae0abbc52dc15f91d37)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:12.708573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9e4de-cc2f-4c70-976d-485c524c9332 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:12.710252 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 557/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:12 2022] GET /identity/v3/users/5ccf058a6abf4ae0abbc52dc15f91d37 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:12.716446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d51623-ee4b-492d-8def-d073829ee9c8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:12.829494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d51623-ee4b-492d-8def-d073829ee9c8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:12.862294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aa596-d0f4-4d27-bb24-7615c7d78091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:12.862933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aa596-d0f4-4d27-bb24-7615c7d78091 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:12.863196 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aa596-d0f4-4d27-bb24-7615c7d78091 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:12.863458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aa596-d0f4-4d27-bb24-7615c7d78091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:12.885182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:12.935160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287aa596-d0f4-4d27-bb24-7615c7d78091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:12.936618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287aa596-d0f4-4d27-bb24-7615c7d78091 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:13.044547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 558/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:14:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:14:13.050780 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9e4de-cc2f-4c70-976d-485c524c9332 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:13.137630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:13.179532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9e4de-cc2f-4c70-976d-485c524c9332 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:13.215296 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd877d-7d63-4fd3-a54f-5bf32c235a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:13.215926 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd877d-7d63-4fd3-a54f-5bf32c235a47 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:13.216172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd877d-7d63-4fd3-a54f-5bf32c235a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:13.216465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd877d-7d63-4fd3-a54f-5bf32c235a47 None admin] PATH_INFO: `/v3/projects/449e146113c542d0b4a43190804c5e8a` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:13.217635 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd877d-7d63-4fd3-a54f-5bf32c235a47 None admin] RBAC: Authorizing `identity:get_project(project_id=449e146113c542d0b4a43190804c5e8a)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:13.219114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd877d-7d63-4fd3-a54f-5bf32c235a47 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:13.220753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 558/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:14:13 2022] GET /identity/v3/projects/449e146113c542d0b4a43190804c5e8a => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:13.227377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aa596-d0f4-4d27-bb24-7615c7d78091 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:13.282612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:13.330166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aa596-d0f4-4d27-bb24-7615c7d78091 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:13.364048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d6c95-4258-464e-a6f5-fcc4ac75f6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:13.364646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d6c95-4258-464e-a6f5-fcc4ac75f6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:13.364914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d6c95-4258-464e-a6f5-fcc4ac75f6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:13.365173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d6c95-4258-464e-a6f5-fcc4ac75f6e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:13.365885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d6c95-4258-464e-a6f5-fcc4ac75f6e5 None admin] RBAC: Adding query filter params (role.id=6b72aeaf7c3646bdb33b40a371cc4d44, scope.project.id=449e146113c542d0b4a43190804c5e8a, user.id=5ccf058a6abf4ae0abbc52dc15f91d37) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:13.366182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d6c95-4258-464e-a6f5-fcc4ac75f6e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:13.367623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d6c95-4258-464e-a6f5-fcc4ac75f6e5 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:13.373794 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 559/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:14:13 2022] GET /identity/v3/role_assignments?user.id=5ccf058a6abf4ae0abbc52dc15f91d37&scope.project.id=449e146113c542d0b4a43190804c5e8a&role.id=6b72aeaf7c3646bdb33b40a371cc4d44 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:14:15.340329 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23354c4e-fae9-4607-94b2-56eb1015dfdd None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:15.340918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23354c4e-fae9-4607-94b2-56eb1015dfdd None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:15.340918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23354c4e-fae9-4607-94b2-56eb1015dfdd None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:15.342217 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 559/1118] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:15.347569 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69f5a4-329f-4cc7-a313-ff8561c5706a None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:15.348030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69f5a4-329f-4cc7-a313-ff8561c5706a None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:15.348132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69f5a4-329f-4cc7-a313-ff8561c5706a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:15.366913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-3f69f5a4-329f-4cc7-a313-ff8561c5706a None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:15.368109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-3f69f5a4-329f-4cc7-a313-ff8561c5706a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:15.437483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 560/1119] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:15.459996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23354c4e-fae9-4607-94b2-56eb1015dfdd None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:15.576287 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23354c4e-fae9-4607-94b2-56eb1015dfdd None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:15.614123 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664c694-b697-47c9-a6f1-f35f38434cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:15.614759 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664c694-b697-47c9-a6f1-f35f38434cec None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:15.615058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664c694-b697-47c9-a6f1-f35f38434cec None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:15.615327 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664c694-b697-47c9-a6f1-f35f38434cec None admin] PATH_INFO: `/v3/roles/6b72aeaf7c3646bdb33b40a371cc4d44` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:15.616780 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664c694-b697-47c9-a6f1-f35f38434cec None admin] RBAC: Authorizing `identity:get_role(role_id=6b72aeaf7c3646bdb33b40a371cc4d44)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:15.618163 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664c694-b697-47c9-a6f1-f35f38434cec None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:15.619535 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 560/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:15 2022] GET /identity/v3/roles/6b72aeaf7c3646bdb33b40a371cc4d44 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:15.626212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69f5a4-329f-4cc7-a313-ff8561c5706a None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:15.676656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:15.736195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69f5a4-329f-4cc7-a313-ff8561c5706a None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:15.775149 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb13d8-cb69-4779-8da0-f1f0ad83cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:15.775796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb13d8-cb69-4779-8da0-f1f0ad83cd7d None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:15.776066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb13d8-cb69-4779-8da0-f1f0ad83cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:15.776325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb13d8-cb69-4779-8da0-f1f0ad83cd7d None admin] PATH_INFO: `/v3/users/5ccf058a6abf4ae0abbc52dc15f91d37` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:15.777510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb13d8-cb69-4779-8da0-f1f0ad83cd7d None admin] RBAC: Authorizing `identity:get_user(user_id=5ccf058a6abf4ae0abbc52dc15f91d37)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:15.778992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb13d8-cb69-4779-8da0-f1f0ad83cd7d None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:15.780552 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 561/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:15 2022] GET /identity/v3/users/5ccf058a6abf4ae0abbc52dc15f91d37 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:15.787962 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664c694-b697-47c9-a6f1-f35f38434cec None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:15.792065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:15.888875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664c694-b697-47c9-a6f1-f35f38434cec None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:15.924986 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d948e-20d6-405a-bdb6-b4a343f3d3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:15.925619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d948e-20d6-405a-bdb6-b4a343f3d3fd None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:15.925896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d948e-20d6-405a-bdb6-b4a343f3d3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:15.926165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d948e-20d6-405a-bdb6-b4a343f3d3fd None admin] PATH_INFO: `/v3/projects/449e146113c542d0b4a43190804c5e8a` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:15.927333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d948e-20d6-405a-bdb6-b4a343f3d3fd None admin] RBAC: Authorizing `identity:get_project(project_id=449e146113c542d0b4a43190804c5e8a)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:15.928777 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d948e-20d6-405a-bdb6-b4a343f3d3fd None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:15.930432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 561/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:14:15 2022] GET /identity/v3/projects/449e146113c542d0b4a43190804c5e8a => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:15.936727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb13d8-cb69-4779-8da0-f1f0ad83cd7d None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:16.040247 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb13d8-cb69-4779-8da0-f1f0ad83cd7d None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:16.054800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:16.077601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367848e2-b07e-418f-bc9a-8a3a4a360f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:16.078292 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367848e2-b07e-418f-bc9a-8a3a4a360f26 None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:16.078566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367848e2-b07e-418f-bc9a-8a3a4a360f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:16.078850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367848e2-b07e-418f-bc9a-8a3a4a360f26 None admin] PATH_INFO: `/v3/projects/449e146113c542d0b4a43190804c5e8a/users/5ccf058a6abf4ae0abbc52dc15f91d37/roles/6b72aeaf7c3646bdb33b40a371cc4d44` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:16.081130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367848e2-b07e-418f-bc9a-8a3a4a360f26 None admin] RBAC: Authorizing `identity:create_grant(project_id=449e146113c542d0b4a43190804c5e8a, user_id=5ccf058a6abf4ae0abbc52dc15f91d37, role_id=6b72aeaf7c3646bdb33b40a371cc4d44)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:16.082588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367848e2-b07e-418f-bc9a-8a3a4a360f26 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:16.096625 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 562/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:14:15 2022] PUT /identity/v3/projects/449e146113c542d0b4a43190804c5e8a/users/5ccf058a6abf4ae0abbc52dc15f91d37/roles/6b72aeaf7c3646bdb33b40a371cc4d44 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:14:18.121169 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddc730-87da-4546-804c-d22bf2db2104 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:18.121805 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddc730-87da-4546-804c-d22bf2db2104 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:18.121805 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddc730-87da-4546-804c-d22bf2db2104 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:18.123073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 562/1124] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:18.128580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab1f54-f8a4-4392-9eea-0c5d2904b5e6 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:18.129023 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab1f54-f8a4-4392-9eea-0c5d2904b5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:18.129134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab1f54-f8a4-4392-9eea-0c5d2904b5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:18.148330 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b7ab1f54-f8a4-4392-9eea-0c5d2904b5e6 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:18.149526 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b7ab1f54-f8a4-4392-9eea-0c5d2904b5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:18.220484 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 563/1125] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:18.243725 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddc730-87da-4546-804c-d22bf2db2104 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:18.318978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:18.350409 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddc730-87da-4546-804c-d22bf2db2104 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:18.383369 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290e134-16ce-4859-90d4-c21527a5db76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:18.383933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290e134-16ce-4859-90d4-c21527a5db76 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:18.384202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290e134-16ce-4859-90d4-c21527a5db76 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:18.384473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290e134-16ce-4859-90d4-c21527a5db76 None admin] PATH_INFO: `/v3/roles/6b72aeaf7c3646bdb33b40a371cc4d44` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:18.385899 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290e134-16ce-4859-90d4-c21527a5db76 None admin] RBAC: Authorizing `identity:get_role(role_id=6b72aeaf7c3646bdb33b40a371cc4d44)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:18.387314 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290e134-16ce-4859-90d4-c21527a5db76 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:18.388664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 563/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:18 2022] GET /identity/v3/roles/6b72aeaf7c3646bdb33b40a371cc4d44 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:18.394972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab1f54-f8a4-4392-9eea-0c5d2904b5e6 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:18.502639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab1f54-f8a4-4392-9eea-0c5d2904b5e6 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:18.505059 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:18.539470 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea13ea2-4473-42b0-ad1d-7862f658fef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:18.540104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea13ea2-4473-42b0-ad1d-7862f658fef8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:18.540379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea13ea2-4473-42b0-ad1d-7862f658fef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:18.540618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea13ea2-4473-42b0-ad1d-7862f658fef8 None admin] PATH_INFO: `/v3/users/5ccf058a6abf4ae0abbc52dc15f91d37` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:18.541778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea13ea2-4473-42b0-ad1d-7862f658fef8 None admin] RBAC: Authorizing `identity:get_user(user_id=5ccf058a6abf4ae0abbc52dc15f91d37)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:18.543279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea13ea2-4473-42b0-ad1d-7862f658fef8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:18.544857 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 564/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:18 2022] GET /identity/v3/users/5ccf058a6abf4ae0abbc52dc15f91d37 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:18.551050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290e134-16ce-4859-90d4-c21527a5db76 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:18.666356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290e134-16ce-4859-90d4-c21527a5db76 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:18.703288 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2d152-8d87-4f0e-9a63-a5202c70cd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:18.703892 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d152-8d87-4f0e-9a63-a5202c70cd93 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:18.704164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d152-8d87-4f0e-9a63-a5202c70cd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:18.704432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d152-8d87-4f0e-9a63-a5202c70cd93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:18.715756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:18.776314 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2d152-8d87-4f0e-9a63-a5202c70cd93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:18.777759 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2d152-8d87-4f0e-9a63-a5202c70cd93 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:18.878331 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 564/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:14:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:14:18.884776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea13ea2-4473-42b0-ad1d-7862f658fef8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:18.992459 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea13ea2-4473-42b0-ad1d-7862f658fef8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:19.027464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672782cf-fd8f-4eae-baa0-f61e4ac52b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:19.028090 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672782cf-fd8f-4eae-baa0-f61e4ac52b16 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:19.028362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672782cf-fd8f-4eae-baa0-f61e4ac52b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:19.028629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672782cf-fd8f-4eae-baa0-f61e4ac52b16 None admin] PATH_INFO: `/v3/projects/449e146113c542d0b4a43190804c5e8a` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:19.029799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672782cf-fd8f-4eae-baa0-f61e4ac52b16 None admin] RBAC: Authorizing `identity:get_project(project_id=449e146113c542d0b4a43190804c5e8a)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:19.031290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672782cf-fd8f-4eae-baa0-f61e4ac52b16 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:19.032913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 565/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:14:18 2022] GET /identity/v3/projects/449e146113c542d0b4a43190804c5e8a => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:19.039521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2d152-8d87-4f0e-9a63-a5202c70cd93 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:19.083368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:19.142355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2d152-8d87-4f0e-9a63-a5202c70cd93 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:19.177478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d0cad-acaf-4a2f-a420-d6fccff31d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:19.178080 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d0cad-acaf-4a2f-a420-d6fccff31d47 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:19.178355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d0cad-acaf-4a2f-a420-d6fccff31d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:19.178623 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d0cad-acaf-4a2f-a420-d6fccff31d47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:19.179386 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d0cad-acaf-4a2f-a420-d6fccff31d47 None admin] RBAC: Adding query filter params (role.id=6b72aeaf7c3646bdb33b40a371cc4d44, scope.project.id=449e146113c542d0b4a43190804c5e8a, user.id=5ccf058a6abf4ae0abbc52dc15f91d37) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:19.179699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d0cad-acaf-4a2f-a420-d6fccff31d47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:19.181142 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d0cad-acaf-4a2f-a420-d6fccff31d47 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:19.187583 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 565/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:14:19 2022] GET /identity/v3/role_assignments?user.id=5ccf058a6abf4ae0abbc52dc15f91d37&scope.project.id=449e146113c542d0b4a43190804c5e8a&role.id=6b72aeaf7c3646bdb33b40a371cc4d44 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:21.187042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b780fa-7992-430d-8e8d-6f660a42ff1e None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:21.187637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b780fa-7992-430d-8e8d-6f660a42ff1e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:21.187637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b780fa-7992-430d-8e8d-6f660a42ff1e None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:21.188908 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 566/1131] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:21.194282 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7f13c-6687-4772-bf30-ab227d7c0749 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:21.194727 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7f13c-6687-4772-bf30-ab227d7c0749 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:21.194841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7f13c-6687-4772-bf30-ab227d7c0749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:21.213439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-afd7f13c-6687-4772-bf30-ab227d7c0749 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:21.214626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-afd7f13c-6687-4772-bf30-ab227d7c0749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:21.286301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 566/1132] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:21.310858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b780fa-7992-430d-8e8d-6f660a42ff1e None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:21.357570 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:21.418096 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b780fa-7992-430d-8e8d-6f660a42ff1e None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:21.452439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca997b0-010f-4a02-b1f9-4f5619872dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:21.452977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca997b0-010f-4a02-b1f9-4f5619872dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:21.453259 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca997b0-010f-4a02-b1f9-4f5619872dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:21.453522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca997b0-010f-4a02-b1f9-4f5619872dd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:21.454672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca997b0-010f-4a02-b1f9-4f5619872dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:21.456261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca997b0-010f-4a02-b1f9-4f5619872dd3 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:21.457812 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 567/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:14:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:21.464120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7f13c-6687-4772-bf30-ab227d7c0749 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:21.499191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:21.571216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7f13c-6687-4772-bf30-ab227d7c0749 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:21.616996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61a810-b620-42ca-98da-7d24df368936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:21.617866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61a810-b620-42ca-98da-7d24df368936 None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:21.618272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61a810-b620-42ca-98da-7d24df368936 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:21.618674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61a810-b620-42ca-98da-7d24df368936 None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:21.620034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61a810-b620-42ca-98da-7d24df368936 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:21.622203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61a810-b620-42ca-98da-7d24df368936 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:21.651909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 567/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Aug 9 11:14:21 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:14:23.689916 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82a4e8-13eb-4f20-a5f6-0113c7d5c9ab None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:23.690453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82a4e8-13eb-4f20-a5f6-0113c7d5c9ab None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:23.690453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82a4e8-13eb-4f20-a5f6-0113c7d5c9ab None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:23.691727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 568/1135] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:23.697396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa54bc3-61a3-428d-ac2a-c64230d1edff None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:23.697917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa54bc3-61a3-428d-ac2a-c64230d1edff None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:23.697917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa54bc3-61a3-428d-ac2a-c64230d1edff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:23.722525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-cfa54bc3-61a3-428d-ac2a-c64230d1edff None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:23.723778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-cfa54bc3-61a3-428d-ac2a-c64230d1edff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:23.793973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 568/1136] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:23.819303 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82a4e8-13eb-4f20-a5f6-0113c7d5c9ab None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:23.923612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82a4e8-13eb-4f20-a5f6-0113c7d5c9ab None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:23.933271 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:23.960730 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e18932-677e-4d80-915b-64b4f7305fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:23.961263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e18932-677e-4d80-915b-64b4f7305fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:23.961538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e18932-677e-4d80-915b-64b4f7305fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:23.961805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e18932-677e-4d80-915b-64b4f7305fd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:23.962979 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e18932-677e-4d80-915b-64b4f7305fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:23.964426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e18932-677e-4d80-915b-64b4f7305fd7 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:23.966062 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 569/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:14:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:23.972164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa54bc3-61a3-428d-ac2a-c64230d1edff None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:23.991677 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:24.081769 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa54bc3-61a3-428d-ac2a-c64230d1edff None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:24.116338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b260b-13c9-40a0-818e-5ba57dfcefa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:24.116939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b260b-13c9-40a0-818e-5ba57dfcefa1 None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:24.117211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b260b-13c9-40a0-818e-5ba57dfcefa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:24.117483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b260b-13c9-40a0-818e-5ba57dfcefa1 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:24.118123 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b260b-13c9-40a0-818e-5ba57dfcefa1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:24.119918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b260b-13c9-40a0-818e-5ba57dfcefa1 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:24.142973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 569/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:14:23 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:14:26.158008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f37d3-1414-42b8-989c-14e960d303b5 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:26.158618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f37d3-1414-42b8-989c-14e960d303b5 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:26.158618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f37d3-1414-42b8-989c-14e960d303b5 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:26.160036 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 570/1139] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:26.166135 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8914b-650f-4bdb-9208-53dd8af6de72 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:26.166570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8914b-650f-4bdb-9208-53dd8af6de72 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:26.166679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8914b-650f-4bdb-9208-53dd8af6de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:26.185856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-2ba8914b-650f-4bdb-9208-53dd8af6de72 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:26.187113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2ba8914b-650f-4bdb-9208-53dd8af6de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:26.259413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 570/1140] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:26.283468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f37d3-1414-42b8-989c-14e960d303b5 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:26.389017 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f37d3-1414-42b8-989c-14e960d303b5 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:26.424187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29791a31-7622-4e47-aa8c-af31d9a6575b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:26.424740 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29791a31-7622-4e47-aa8c-af31d9a6575b None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:26.425011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29791a31-7622-4e47-aa8c-af31d9a6575b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:26.425273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29791a31-7622-4e47-aa8c-af31d9a6575b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:26.435724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29791a31-7622-4e47-aa8c-af31d9a6575b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-29791a31-7622-4e47-aa8c-af31d9a6575b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:14:26.440624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:26.441716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:26.443113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:26.443113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:26.443113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:26.443113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:26.443113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:14:26.443113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:14:26.443113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:14:26.443113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:14:26.443113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:14:26.443113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:14:26.443113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:26.443113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:14:26.443113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 571/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:14:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:26.448097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8914b-650f-4bdb-9208-53dd8af6de72 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:26.450331 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:26.553963 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8914b-650f-4bdb-9208-53dd8af6de72 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:26.588506 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b7240-a8c2-4c8a-a56a-96fefdb813d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:26.589102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b7240-a8c2-4c8a-a56a-96fefdb813d1 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:26.589377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b7240-a8c2-4c8a-a56a-96fefdb813d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:26.589644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b7240-a8c2-4c8a-a56a-96fefdb813d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:26.590299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b7240-a8c2-4c8a-a56a-96fefdb813d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:26.590567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b7240-a8c2-4c8a-a56a-96fefdb813d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:26.591988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b7240-a8c2-4c8a-a56a-96fefdb813d1 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:26.600161 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 571/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:14:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:26.606361 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29791a31-7622-4e47-aa8c-af31d9a6575b None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:26.645418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:26.712485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29791a31-7622-4e47-aa8c-af31d9a6575b None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:26.748510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee538544-97f5-411f-b842-cfba610a6ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:26.749129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee538544-97f5-411f-b842-cfba610a6ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:26.749396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee538544-97f5-411f-b842-cfba610a6ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:26.749658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee538544-97f5-411f-b842-cfba610a6ea4 None admin] PATH_INFO: `/v3/users/c02996205dbe469d97a6c9db84ce85e5` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:26.764196 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee538544-97f5-411f-b842-cfba610a6ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=c02996205dbe469d97a6c9db84ce85e5)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:26.765640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee538544-97f5-411f-b842-cfba610a6ea4 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:26.767285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 572/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:26 2022] GET /identity/v3/users/c02996205dbe469d97a6c9db84ce85e5 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:26.773650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b7240-a8c2-4c8a-a56a-96fefdb813d1 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:26.838836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:26.878529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b7240-a8c2-4c8a-a56a-96fefdb813d1 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:26.912603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0435e-35bf-408f-adaf-42fdcce72442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:26.913216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0435e-35bf-408f-adaf-42fdcce72442 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:26.913483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0435e-35bf-408f-adaf-42fdcce72442 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:26.913747 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0435e-35bf-408f-adaf-42fdcce72442 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:26.982449 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0435e-35bf-408f-adaf-42fdcce72442 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:26.983878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0435e-35bf-408f-adaf-42fdcce72442 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:27.048113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:27.087687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 572/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:14:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:14:27.093918 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee538544-97f5-411f-b842-cfba610a6ea4 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:27.188483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:27.195990 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee538544-97f5-411f-b842-cfba610a6ea4 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:27.231110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeee107-693c-4799-a7e5-61120089dbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:27.231741 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeee107-693c-4799-a7e5-61120089dbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:27.232081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeee107-693c-4799-a7e5-61120089dbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:27.232369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeee107-693c-4799-a7e5-61120089dbd2 None admin] PATH_INFO: `/v3/projects/d295e95154ec4fbf923e33da53af9475` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:27.233879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeee107-693c-4799-a7e5-61120089dbd2 None admin] RBAC: Authorizing `identity:get_project(project_id=d295e95154ec4fbf923e33da53af9475)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:27.235789 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeee107-693c-4799-a7e5-61120089dbd2 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:27.237918 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 573/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:14:27 2022] GET /identity/v3/projects/d295e95154ec4fbf923e33da53af9475 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:27.244287 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0435e-35bf-408f-adaf-42fdcce72442 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:27.345555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0435e-35bf-408f-adaf-42fdcce72442 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:27.380013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010e6f2-7a1d-45a4-b5fd-4e8c9ecf6986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:27.380609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e6f2-7a1d-45a4-b5fd-4e8c9ecf6986 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:27.380884 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e6f2-7a1d-45a4-b5fd-4e8c9ecf6986 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:27.381146 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e6f2-7a1d-45a4-b5fd-4e8c9ecf6986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:27.381859 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010e6f2-7a1d-45a4-b5fd-4e8c9ecf6986 None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=d295e95154ec4fbf923e33da53af9475, user.id=c02996205dbe469d97a6c9db84ce85e5) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:27.382159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010e6f2-7a1d-45a4-b5fd-4e8c9ecf6986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:27.383622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010e6f2-7a1d-45a4-b5fd-4e8c9ecf6986 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:27.389394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 573/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:14:27 2022] GET /identity/v3/role_assignments?user.id=c02996205dbe469d97a6c9db84ce85e5&scope.project.id=d295e95154ec4fbf923e33da53af9475&role.id=169d11e171d04c87af71475295957618 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:29.332455 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b88476-c25a-45c5-b380-ea5d3a6c6645 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:29.333071 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b88476-c25a-45c5-b380-ea5d3a6c6645 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:29.333071 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b88476-c25a-45c5-b380-ea5d3a6c6645 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:29.334335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 574/1147] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:29.342414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99b600-bebe-4c0b-9bb6-41740202cddc None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:29.342931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99b600-bebe-4c0b-9bb6-41740202cddc None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:29.343422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99b600-bebe-4c0b-9bb6-41740202cddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:29.363755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ac99b600-bebe-4c0b-9bb6-41740202cddc None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:29.364892 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ac99b600-bebe-4c0b-9bb6-41740202cddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:29.388340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:29.433965 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 574/1148] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:29.462592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b88476-c25a-45c5-b380-ea5d3a6c6645 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:29.571168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b88476-c25a-45c5-b380-ea5d3a6c6645 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:29.605769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9aba9c-b676-4746-967b-230a5f978b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:29.606401 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aba9c-b676-4746-967b-230a5f978b68 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:29.606676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aba9c-b676-4746-967b-230a5f978b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:29.607008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aba9c-b676-4746-967b-230a5f978b68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:29.617465 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9aba9c-b676-4746-967b-230a5f978b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-3b9aba9c-b676-4746-967b-230a5f978b68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:14:29.622522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:29.624003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:29.625129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:29.625129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:29.625129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:29.625129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:29.625129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:14:29.625129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:14:29.625129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:14:29.625129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:14:29.625129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:14:29.625129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:14:29.625129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:29.625129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:14:29.625129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 575/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:14:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:29.630022 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99b600-bebe-4c0b-9bb6-41740202cddc None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:29.730952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99b600-bebe-4c0b-9bb6-41740202cddc None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:29.767269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad588200-d0ad-4712-a45f-6e54168523e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:29.768002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad588200-d0ad-4712-a45f-6e54168523e0 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:29.768278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad588200-d0ad-4712-a45f-6e54168523e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:29.768546 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad588200-d0ad-4712-a45f-6e54168523e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:29.769211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad588200-d0ad-4712-a45f-6e54168523e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:29.769508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad588200-d0ad-4712-a45f-6e54168523e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:29.770915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad588200-d0ad-4712-a45f-6e54168523e0 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:29.779975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 575/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:14:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:29.786501 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9aba9c-b676-4746-967b-230a5f978b68 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:29.813802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:29.895924 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9aba9c-b676-4746-967b-230a5f978b68 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:29.933347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22df86-7ad3-4987-b0e1-b92de11e7674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:29.933990 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22df86-7ad3-4987-b0e1-b92de11e7674 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:29.934262 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22df86-7ad3-4987-b0e1-b92de11e7674 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:29.934531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22df86-7ad3-4987-b0e1-b92de11e7674 None admin] PATH_INFO: `/v3/users/c02996205dbe469d97a6c9db84ce85e5` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:29.935824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22df86-7ad3-4987-b0e1-b92de11e7674 None admin] RBAC: Authorizing `identity:get_user(user_id=c02996205dbe469d97a6c9db84ce85e5)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:29.937307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22df86-7ad3-4987-b0e1-b92de11e7674 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:29.938979 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 576/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:29 2022] GET /identity/v3/users/c02996205dbe469d97a6c9db84ce85e5 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:29.945413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad588200-d0ad-4712-a45f-6e54168523e0 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:29.974292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:30.058030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad588200-d0ad-4712-a45f-6e54168523e0 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:30.093211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8f575-8d5b-4d8f-97c5-fce8c79d7782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:30.093844 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8f575-8d5b-4d8f-97c5-fce8c79d7782 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:30.094107 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8f575-8d5b-4d8f-97c5-fce8c79d7782 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:30.094383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8f575-8d5b-4d8f-97c5-fce8c79d7782 None admin] PATH_INFO: `/v3/projects/d295e95154ec4fbf923e33da53af9475` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:30.095528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8f575-8d5b-4d8f-97c5-fce8c79d7782 None admin] RBAC: Authorizing `identity:get_project(project_id=d295e95154ec4fbf923e33da53af9475)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:30.097018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8f575-8d5b-4d8f-97c5-fce8c79d7782 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:30.098671 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 576/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:14:29 2022] GET /identity/v3/projects/d295e95154ec4fbf923e33da53af9475 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:30.105114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22df86-7ad3-4987-b0e1-b92de11e7674 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:30.200507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:30.211030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22df86-7ad3-4987-b0e1-b92de11e7674 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:30.248460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbbd6f-f765-4010-b574-9db6f5114878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:30.249128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbbd6f-f765-4010-b574-9db6f5114878 None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:30.249402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbbd6f-f765-4010-b574-9db6f5114878 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:30.249672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbbd6f-f765-4010-b574-9db6f5114878 None admin] PATH_INFO: `/v3/projects/d295e95154ec4fbf923e33da53af9475/users/c02996205dbe469d97a6c9db84ce85e5/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:30.251775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbbd6f-f765-4010-b574-9db6f5114878 None admin] RBAC: Authorizing `identity:create_grant(project_id=d295e95154ec4fbf923e33da53af9475, user_id=c02996205dbe469d97a6c9db84ce85e5, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:30.253229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbbd6f-f765-4010-b574-9db6f5114878 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:30.267681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 577/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:14:30 2022] PUT /identity/v3/projects/d295e95154ec4fbf923e33da53af9475/users/c02996205dbe469d97a6c9db84ce85e5/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:14:32.251705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7fcb8-ca53-4be9-b028-0699732e8867 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:32.252338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7fcb8-ca53-4be9-b028-0699732e8867 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:32.252338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7fcb8-ca53-4be9-b028-0699732e8867 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:32.253633 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 577/1154] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:32.259068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dcaa0-a4d2-40c7-94e7-2a77524d3da8 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:32.259498 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dcaa0-a4d2-40c7-94e7-2a77524d3da8 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:32.259590 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dcaa0-a4d2-40c7-94e7-2a77524d3da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:32.278485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-1d7dcaa0-a4d2-40c7-94e7-2a77524d3da8 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:32.279721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1d7dcaa0-a4d2-40c7-94e7-2a77524d3da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:32.352038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 578/1155] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:32.375659 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7fcb8-ca53-4be9-b028-0699732e8867 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:32.476878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:32.492047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7fcb8-ca53-4be9-b028-0699732e8867 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:32.527153 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204660e-2ed1-464c-aa38-5b005120906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:32.527695 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204660e-2ed1-464c-aa38-5b005120906b None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:32.527965 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204660e-2ed1-464c-aa38-5b005120906b None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:32.528235 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204660e-2ed1-464c-aa38-5b005120906b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:32.538719 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204660e-2ed1-464c-aa38-5b005120906b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-3204660e-2ed1-464c-aa38-5b005120906b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:14:32.543419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:32.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:32.545317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:32.545317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:32.545317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:32.545317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:32.545317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:14:32.545317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:14:32.545317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:14:32.545317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:14:32.545317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:14:32.545317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:14:32.545317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:32.545317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:14:32.545317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 578/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:14:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:32.551593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dcaa0-a4d2-40c7-94e7-2a77524d3da8 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:32.636038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:32.657114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dcaa0-a4d2-40c7-94e7-2a77524d3da8 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:32.691969 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6bda1-9e15-4d86-84b3-2454cebaf5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:32.692568 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6bda1-9e15-4d86-84b3-2454cebaf5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:32.692841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6bda1-9e15-4d86-84b3-2454cebaf5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:32.693111 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6bda1-9e15-4d86-84b3-2454cebaf5e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:32.693776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6bda1-9e15-4d86-84b3-2454cebaf5e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:32.694078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6bda1-9e15-4d86-84b3-2454cebaf5e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:32.695491 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6bda1-9e15-4d86-84b3-2454cebaf5e3 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:32.703562 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 579/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:14:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:32.709860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204660e-2ed1-464c-aa38-5b005120906b None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:32.814578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204660e-2ed1-464c-aa38-5b005120906b None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:32.849849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f9e22-3644-4c7c-abe5-15012547ac8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:32.850481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9e22-3644-4c7c-abe5-15012547ac8b None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:32.850753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9e22-3644-4c7c-abe5-15012547ac8b None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:32.851051 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9e22-3644-4c7c-abe5-15012547ac8b None admin] PATH_INFO: `/v3/users/c02996205dbe469d97a6c9db84ce85e5` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:32.852227 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f9e22-3644-4c7c-abe5-15012547ac8b None admin] RBAC: Authorizing `identity:get_user(user_id=c02996205dbe469d97a6c9db84ce85e5)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:32.853665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f9e22-3644-4c7c-abe5-15012547ac8b None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:32.855309 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 579/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:32 2022] GET /identity/v3/users/c02996205dbe469d97a6c9db84ce85e5 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:32.861619 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6bda1-9e15-4d86-84b3-2454cebaf5e3 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:32.963112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6bda1-9e15-4d86-84b3-2454cebaf5e3 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:32.997573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7ba64-d9a0-4dd6-bdf7-0cab49b060c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:32.998194 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7ba64-d9a0-4dd6-bdf7-0cab49b060c3 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:32.998467 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7ba64-d9a0-4dd6-bdf7-0cab49b060c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:32.998724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7ba64-d9a0-4dd6-bdf7-0cab49b060c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:33.010771 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:33.066426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7ba64-d9a0-4dd6-bdf7-0cab49b060c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:33.067836 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7ba64-d9a0-4dd6-bdf7-0cab49b060c3 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:33.171294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 580/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:14:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:14:33.177502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f9e22-3644-4c7c-abe5-15012547ac8b None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:33.199607 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:33.300194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f9e22-3644-4c7c-abe5-15012547ac8b None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:33.334969 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28b218-cb11-416d-be7c-99310cccd57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:33.335557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28b218-cb11-416d-be7c-99310cccd57a None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:33.335835 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28b218-cb11-416d-be7c-99310cccd57a None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:33.336107 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28b218-cb11-416d-be7c-99310cccd57a None admin] PATH_INFO: `/v3/projects/d295e95154ec4fbf923e33da53af9475` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:33.337293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28b218-cb11-416d-be7c-99310cccd57a None admin] RBAC: Authorizing `identity:get_project(project_id=d295e95154ec4fbf923e33da53af9475)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:33.338915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28b218-cb11-416d-be7c-99310cccd57a None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:33.340723 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 580/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:14:33 2022] GET /identity/v3/projects/d295e95154ec4fbf923e33da53af9475 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:33.348130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7ba64-d9a0-4dd6-bdf7-0cab49b060c3 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:33.395181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:33.456070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7ba64-d9a0-4dd6-bdf7-0cab49b060c3 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:33.491439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceef37d-5a23-4782-a8e1-661dc904bba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:33.492048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceef37d-5a23-4782-a8e1-661dc904bba7 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:33.492321 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceef37d-5a23-4782-a8e1-661dc904bba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:33.492587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceef37d-5a23-4782-a8e1-661dc904bba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:33.493309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceef37d-5a23-4782-a8e1-661dc904bba7 None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=d295e95154ec4fbf923e33da53af9475, user.id=c02996205dbe469d97a6c9db84ce85e5) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:33.493610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceef37d-5a23-4782-a8e1-661dc904bba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:33.495474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceef37d-5a23-4782-a8e1-661dc904bba7 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:33.501388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 581/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:14:33 2022] GET /identity/v3/role_assignments?user.id=c02996205dbe469d97a6c9db84ce85e5&scope.project.id=d295e95154ec4fbf923e33da53af9475&role.id=169d11e171d04c87af71475295957618 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:14:35.505629 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc63ce-d8e7-406a-9f61-9e5f89eba300 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:35.506220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc63ce-d8e7-406a-9f61-9e5f89eba300 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:35.506220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc63ce-d8e7-406a-9f61-9e5f89eba300 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:35.507590 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 581/1162] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:35.512923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5b78-36a5-4bc3-ac42-358f5bf10fa4 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:35.513601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5b78-36a5-4bc3-ac42-358f5bf10fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:35.513601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5b78-36a5-4bc3-ac42-358f5bf10fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:35.531955 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-ae5a5b78-36a5-4bc3-ac42-358f5bf10fa4 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:35.533169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ae5a5b78-36a5-4bc3-ac42-358f5bf10fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:35.598247 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 582/1163] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:35.620830 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc63ce-d8e7-406a-9f61-9e5f89eba300 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:35.711367 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:35.728545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc63ce-d8e7-406a-9f61-9e5f89eba300 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:35.763432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62a78d-c50e-40b1-a4f7-bd4046d1cb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:35.764036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62a78d-c50e-40b1-a4f7-bd4046d1cb9b None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:35.764310 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62a78d-c50e-40b1-a4f7-bd4046d1cb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:35.764574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62a78d-c50e-40b1-a4f7-bd4046d1cb9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:35.834066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62a78d-c50e-40b1-a4f7-bd4046d1cb9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:35.835590 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62a78d-c50e-40b1-a4f7-bd4046d1cb9b None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:35.923362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:35.942143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 582/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:14:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:14:35.948399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a5b78-36a5-4bc3-ac42-358f5bf10fa4 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:35.988085 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:36.056475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a5b78-36a5-4bc3-ac42-358f5bf10fa4 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:36.091896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5601e6d-da6d-429a-9a14-4133137dbd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:36.092521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5601e6d-da6d-429a-9a14-4133137dbd39 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:36.092794 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5601e6d-da6d-429a-9a14-4133137dbd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:36.093052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5601e6d-da6d-429a-9a14-4133137dbd39 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:36.101584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5601e6d-da6d-429a-9a14-4133137dbd39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:36.103188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5601e6d-da6d-429a-9a14-4133137dbd39 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-b5601e6d-da6d-429a-9a14-4133137dbd39 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:36.114579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:36.115838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:14:36.116689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 583/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Aug 9 11:14:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:36.122490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62a78d-c50e-40b1-a4f7-bd4046d1cb9b None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:36.225773 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62a78d-c50e-40b1-a4f7-bd4046d1cb9b None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:36.264878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c92339-d1c6-4146-89f9-d59f4668cc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:36.265406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c92339-d1c6-4146-89f9-d59f4668cc62 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:36.265676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c92339-d1c6-4146-89f9-d59f4668cc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:36.265926 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c92339-d1c6-4146-89f9-d59f4668cc62 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:36.266564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c92339-d1c6-4146-89f9-d59f4668cc62 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:36.266886 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c92339-d1c6-4146-89f9-d59f4668cc62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:36.268312 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c92339-d1c6-4146-89f9-d59f4668cc62 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:36.275808 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 583/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Aug 9 11:14:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:38.313164 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e0a0d-1deb-48b6-b3ad-6ff945a8fc98 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:38.314274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e0a0d-1deb-48b6-b3ad-6ff945a8fc98 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:38.314274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e0a0d-1deb-48b6-b3ad-6ff945a8fc98 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:38.316361 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 584/1167] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:38.322621 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70176fb2-db27-4ef6-a208-a0c0329efb9e None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:38.323139 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70176fb2-db27-4ef6-a208-a0c0329efb9e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:38.323243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70176fb2-db27-4ef6-a208-a0c0329efb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:38.349774 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-70176fb2-db27-4ef6-a208-a0c0329efb9e None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:38.351010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-70176fb2-db27-4ef6-a208-a0c0329efb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:38.401181 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:38.425353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 584/1168] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:38.447525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e0a0d-1deb-48b6-b3ad-6ff945a8fc98 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:38.545548 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:38.552766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e0a0d-1deb-48b6-b3ad-6ff945a8fc98 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:38.588364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3455557-a55e-48d6-95c1-4b789a84af2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:38.588880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455557-a55e-48d6-95c1-4b789a84af2a None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:38.589147 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455557-a55e-48d6-95c1-4b789a84af2a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:38.589406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455557-a55e-48d6-95c1-4b789a84af2a None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:38.590069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3455557-a55e-48d6-95c1-4b789a84af2a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:38.591489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3455557-a55e-48d6-95c1-4b789a84af2a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:38.609802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 585/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Tue Aug 9 11:14:38 2022] POST /identity/v3/domains => generated 267 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:14:40.601236 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114ecd9-b3dd-4d67-8302-a10c4fa377c0 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:40.601840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114ecd9-b3dd-4d67-8302-a10c4fa377c0 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:40.601840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114ecd9-b3dd-4d67-8302-a10c4fa377c0 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:40.603229 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 585/1170] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:40.608907 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021584d-a3b7-4a7c-a8a6-a505992ef4df None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:40.609317 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021584d-a3b7-4a7c-a8a6-a505992ef4df None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:40.609439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021584d-a3b7-4a7c-a8a6-a505992ef4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:40.628953 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-1021584d-a3b7-4a7c-a8a6-a505992ef4df None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:40.630121 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1021584d-a3b7-4a7c-a8a6-a505992ef4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:40.700221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 586/1171] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:40.724099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114ecd9-b3dd-4d67-8302-a10c4fa377c0 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:40.832119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114ecd9-b3dd-4d67-8302-a10c4fa377c0 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:40.870728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ead6b-1c97-469c-ae3a-7135aeb4cf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:40.871394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ead6b-1c97-469c-ae3a-7135aeb4cf00 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:40.871670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ead6b-1c97-469c-ae3a-7135aeb4cf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:40.871937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ead6b-1c97-469c-ae3a-7135aeb4cf00 None admin] PATH_INFO: `/v3/domains/6386c49f697c4f059f0102a49db7edd6` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:40.882949 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ead6b-1c97-469c-ae3a-7135aeb4cf00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6386c49f697c4f059f0102a49db7edd6)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:40.884393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ead6b-1c97-469c-ae3a-7135aeb4cf00 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:40.886005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 586/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Tue Aug 9 11:14:40 2022] GET /identity/v3/domains/6386c49f697c4f059f0102a49db7edd6 => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:40.893477 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021584d-a3b7-4a7c-a8a6-a505992ef4df None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:40.980273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:40.997515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021584d-a3b7-4a7c-a8a6-a505992ef4df None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:41.032091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b452e3-350e-4da2-b2a1-0cf714e2e4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:41.032688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b452e3-350e-4da2-b2a1-0cf714e2e4c7 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:41.033008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b452e3-350e-4da2-b2a1-0cf714e2e4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:41.033283 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b452e3-350e-4da2-b2a1-0cf714e2e4c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:41.033903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b452e3-350e-4da2-b2a1-0cf714e2e4c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:41.035380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b452e3-350e-4da2-b2a1-0cf714e2e4c7 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:41.063125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 587/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Aug 9 11:14:40 2022] POST /identity/v3/projects => generated 361 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:14:43.056626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd18967-f5d5-4c6a-8faa-ffccaf85e6f3 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:43.057222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd18967-f5d5-4c6a-8faa-ffccaf85e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:43.057222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd18967-f5d5-4c6a-8faa-ffccaf85e6f3 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:43.058506 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 587/1174] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:43.063925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64dec6-6915-4d95-9272-1f42426ddf60 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:43.064367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64dec6-6915-4d95-9272-1f42426ddf60 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:43.064467 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64dec6-6915-4d95-9272-1f42426ddf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:43.083149 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-6e64dec6-6915-4d95-9272-1f42426ddf60 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:43.084331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6e64dec6-6915-4d95-9272-1f42426ddf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:43.157878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 588/1175] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:43.182059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd18967-f5d5-4c6a-8faa-ffccaf85e6f3 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:43.224267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:43.285967 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd18967-f5d5-4c6a-8faa-ffccaf85e6f3 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:43.321191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea81adf-1cf5-4dd0-bd9b-abba79efacf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:43.321728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea81adf-1cf5-4dd0-bd9b-abba79efacf1 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:43.321999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea81adf-1cf5-4dd0-bd9b-abba79efacf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:43.322266 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea81adf-1cf5-4dd0-bd9b-abba79efacf1 None admin] PATH_INFO: `/v3/domains/6386c49f697c4f059f0102a49db7edd6` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:43.323433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea81adf-1cf5-4dd0-bd9b-abba79efacf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6386c49f697c4f059f0102a49db7edd6)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:43.324876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea81adf-1cf5-4dd0-bd9b-abba79efacf1 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:43.326429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 588/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Tue Aug 9 11:14:43 2022] GET /identity/v3/domains/6386c49f697c4f059f0102a49db7edd6 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:43.332718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64dec6-6915-4d95-9272-1f42426ddf60 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:43.400423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:43.435478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64dec6-6915-4d95-9272-1f42426ddf60 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:43.471186 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16a77c-2633-4596-926a-7e8f169afe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:43.471786 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a77c-2633-4596-926a-7e8f169afe5d None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:43.472061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a77c-2633-4596-926a-7e8f169afe5d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:43.472320 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a77c-2633-4596-926a-7e8f169afe5d None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:43.472972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16a77c-2633-4596-926a-7e8f169afe5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:43.474421 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16a77c-2633-4596-926a-7e8f169afe5d None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:43.497862 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 589/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:14:43 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:14:45.528191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56761d9-e2e6-4f1a-80b2-25be939d87f6 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:45.528774 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56761d9-e2e6-4f1a-80b2-25be939d87f6 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:45.528774 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56761d9-e2e6-4f1a-80b2-25be939d87f6 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:45.530045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 589/1178] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:45.535692 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5ecc7-c610-4159-bb6a-511f06b13a9d None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:45.536121 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5ecc7-c610-4159-bb6a-511f06b13a9d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:45.536231 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5ecc7-c610-4159-bb6a-511f06b13a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:45.556189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-5df5ecc7-c610-4159-bb6a-511f06b13a9d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:45.557390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5df5ecc7-c610-4159-bb6a-511f06b13a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:45.627202 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 590/1179] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:45.650429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56761d9-e2e6-4f1a-80b2-25be939d87f6 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:45.759133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56761d9-e2e6-4f1a-80b2-25be939d87f6 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:45.767372 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:45.798223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba7c4c-7b00-40de-99e7-3d84bc368a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:45.798952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7c4c-7b00-40de-99e7-3d84bc368a47 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:45.799231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7c4c-7b00-40de-99e7-3d84bc368a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:45.799495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7c4c-7b00-40de-99e7-3d84bc368a47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:45.812131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba7c4c-7b00-40de-99e7-3d84bc368a47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-e4ba7c4c-7b00-40de-99e7-3d84bc368a47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:14:45.817063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:45.818285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:45.819414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:45.819414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:45.819414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:45.819414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:45.819414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:14:45.819414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:14:45.819414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:14:45.819414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:14:45.819414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:14:45.819414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:14:45.819414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:45.819414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:14:45.819414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 590/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:14:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:45.825047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5ecc7-c610-4159-bb6a-511f06b13a9d None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:45.886270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:45.934617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5ecc7-c610-4159-bb6a-511f06b13a9d None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:45.971045 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b5713-519f-4fe7-96a8-624f6b987055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:45.971653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b5713-519f-4fe7-96a8-624f6b987055 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:45.971932 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b5713-519f-4fe7-96a8-624f6b987055 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:45.972197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b5713-519f-4fe7-96a8-624f6b987055 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:45.972861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b5713-519f-4fe7-96a8-624f6b987055 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:45.973158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b5713-519f-4fe7-96a8-624f6b987055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:45.974550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b5713-519f-4fe7-96a8-624f6b987055 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:45.983391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 591/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:14:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:45.990003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba7c4c-7b00-40de-99e7-3d84bc368a47 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:46.095296 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba7c4c-7b00-40de-99e7-3d84bc368a47 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:46.131384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043f987-306b-4293-a408-2f05004c3497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:46.132015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f987-306b-4293-a408-2f05004c3497 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:46.132284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f987-306b-4293-a408-2f05004c3497 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:46.132548 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f987-306b-4293-a408-2f05004c3497 None admin] PATH_INFO: `/v3/users/5fee133d73c24828b30317d3772ea9ae` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:46.146626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f987-306b-4293-a408-2f05004c3497 None admin] RBAC: Authorizing `identity:get_user(user_id=5fee133d73c24828b30317d3772ea9ae)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:46.148132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f987-306b-4293-a408-2f05004c3497 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:46.149799 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 591/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:45 2022] GET /identity/v3/users/5fee133d73c24828b30317d3772ea9ae => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:46.156033 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b5713-519f-4fe7-96a8-624f6b987055 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:46.265738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b5713-519f-4fe7-96a8-624f6b987055 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:46.282715 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:46.301039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775fb31-fd32-4816-a6ac-bf9c3a6e0ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:46.301647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775fb31-fd32-4816-a6ac-bf9c3a6e0ffb None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:46.301915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775fb31-fd32-4816-a6ac-bf9c3a6e0ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:46.302174 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775fb31-fd32-4816-a6ac-bf9c3a6e0ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:46.374574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775fb31-fd32-4816-a6ac-bf9c3a6e0ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:46.376096 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775fb31-fd32-4816-a6ac-bf9c3a6e0ffb None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:46.478614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 592/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:14:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:14:46.485393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043f987-306b-4293-a408-2f05004c3497 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:46.512386 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:46.591838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043f987-306b-4293-a408-2f05004c3497 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:46.627357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c7027-ac5a-4baf-b266-e68eeecc79f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:46.627890 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c7027-ac5a-4baf-b266-e68eeecc79f3 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:46.628164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c7027-ac5a-4baf-b266-e68eeecc79f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:46.628425 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c7027-ac5a-4baf-b266-e68eeecc79f3 None admin] PATH_INFO: `/v3/projects/37cf07ebcc8546dbb1a7354a512802aa` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:46.629604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c7027-ac5a-4baf-b266-e68eeecc79f3 None admin] RBAC: Authorizing `identity:get_project(project_id=37cf07ebcc8546dbb1a7354a512802aa)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:46.631120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c7027-ac5a-4baf-b266-e68eeecc79f3 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:46.632768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 592/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:14:46 2022] GET /identity/v3/projects/37cf07ebcc8546dbb1a7354a512802aa => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:14:46.639407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775fb31-fd32-4816-a6ac-bf9c3a6e0ffb None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:46.657450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:46.748907 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775fb31-fd32-4816-a6ac-bf9c3a6e0ffb None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:46.783772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a94284-e35e-4506-a45f-3b2bac252e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:46.784373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a94284-e35e-4506-a45f-3b2bac252e2b None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:46.784641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a94284-e35e-4506-a45f-3b2bac252e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:46.784902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a94284-e35e-4506-a45f-3b2bac252e2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:46.785626 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a94284-e35e-4506-a45f-3b2bac252e2b None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=37cf07ebcc8546dbb1a7354a512802aa, user.id=5fee133d73c24828b30317d3772ea9ae) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:46.785928 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a94284-e35e-4506-a45f-3b2bac252e2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:46.787395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a94284-e35e-4506-a45f-3b2bac252e2b None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:46.792971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 593/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:14:46 2022] GET /identity/v3/role_assignments?user.id=5fee133d73c24828b30317d3772ea9ae&scope.project.id=37cf07ebcc8546dbb1a7354a512802aa&role.id=169d11e171d04c87af71475295957618 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:48.764185 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc611-adeb-42aa-956d-e0a1b7607686 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:48.764724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc611-adeb-42aa-956d-e0a1b7607686 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:48.764724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc611-adeb-42aa-956d-e0a1b7607686 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:48.765939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 593/1186] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:48.771356 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8866cb-6341-4605-966a-ac35d58c2c2a None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:48.771824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8866cb-6341-4605-966a-ac35d58c2c2a None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:48.771918 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8866cb-6341-4605-966a-ac35d58c2c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:48.791023 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-3c8866cb-6341-4605-966a-ac35d58c2c2a None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:48.792228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-3c8866cb-6341-4605-966a-ac35d58c2c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:48.862830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 594/1187] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:48.894717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dc611-adeb-42aa-956d-e0a1b7607686 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:48.993495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:49.004293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dc611-adeb-42aa-956d-e0a1b7607686 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:49.039233 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781e745-64c7-4262-99fe-d601e2092313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:49.039767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781e745-64c7-4262-99fe-d601e2092313 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:49.040044 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781e745-64c7-4262-99fe-d601e2092313 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:49.040308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781e745-64c7-4262-99fe-d601e2092313 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:49.051455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781e745-64c7-4262-99fe-d601e2092313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-3781e745-64c7-4262-99fe-d601e2092313 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:14:49.056179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:49.057292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:49.058483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:49.058483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:49.058483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:49.058483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:49.058483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:14:49.058483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:14:49.058483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:14:49.058483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:14:49.058483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:14:49.058483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:14:49.058483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:49.058483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:14:49.058483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 594/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:14:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:49.063520 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8866cb-6341-4605-966a-ac35d58c2c2a None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:49.075798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:49.168389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8866cb-6341-4605-966a-ac35d58c2c2a None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:49.202439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579b17f-b912-4b5f-bbe9-116dee7e3434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:49.203082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579b17f-b912-4b5f-bbe9-116dee7e3434 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:49.203347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579b17f-b912-4b5f-bbe9-116dee7e3434 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:49.203624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579b17f-b912-4b5f-bbe9-116dee7e3434 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:49.204282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579b17f-b912-4b5f-bbe9-116dee7e3434 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:49.204680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579b17f-b912-4b5f-bbe9-116dee7e3434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:49.206046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579b17f-b912-4b5f-bbe9-116dee7e3434 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:49.214583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 595/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:14:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:49.221013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781e745-64c7-4262-99fe-d601e2092313 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:49.334896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781e745-64c7-4262-99fe-d601e2092313 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:49.369983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04c85f-0376-4ae5-ba54-39b214af5eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:49.370610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04c85f-0376-4ae5-ba54-39b214af5eba None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:49.370902 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04c85f-0376-4ae5-ba54-39b214af5eba None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:49.371166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04c85f-0376-4ae5-ba54-39b214af5eba None admin] PATH_INFO: `/v3/users/5fee133d73c24828b30317d3772ea9ae` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:49.372298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04c85f-0376-4ae5-ba54-39b214af5eba None admin] RBAC: Authorizing `identity:get_user(user_id=5fee133d73c24828b30317d3772ea9ae)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:49.373740 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04c85f-0376-4ae5-ba54-39b214af5eba None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:49.375348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 595/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:49 2022] GET /identity/v3/users/5fee133d73c24828b30317d3772ea9ae => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:49.381506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579b17f-b912-4b5f-bbe9-116dee7e3434 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:49.456272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:49.488573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579b17f-b912-4b5f-bbe9-116dee7e3434 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:49.523257 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faab6b0-1a1c-4439-86e3-89d97429635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:49.523885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faab6b0-1a1c-4439-86e3-89d97429635d None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:49.524158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faab6b0-1a1c-4439-86e3-89d97429635d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:49.524426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faab6b0-1a1c-4439-86e3-89d97429635d None admin] PATH_INFO: `/v3/projects/37cf07ebcc8546dbb1a7354a512802aa` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:49.525594 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faab6b0-1a1c-4439-86e3-89d97429635d None admin] RBAC: Authorizing `identity:get_project(project_id=37cf07ebcc8546dbb1a7354a512802aa)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:49.527075 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faab6b0-1a1c-4439-86e3-89d97429635d None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:49.528736 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 596/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:14:49 2022] GET /identity/v3/projects/37cf07ebcc8546dbb1a7354a512802aa => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:49.535526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04c85f-0376-4ae5-ba54-39b214af5eba None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:49.571400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:49.653648 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04c85f-0376-4ae5-ba54-39b214af5eba None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:49.688053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a465f-a145-4c36-aeec-b907a5bf8bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:49.688729 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a465f-a145-4c36-aeec-b907a5bf8bb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:49.689026 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a465f-a145-4c36-aeec-b907a5bf8bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:49.689296 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a465f-a145-4c36-aeec-b907a5bf8bb6 None admin] PATH_INFO: `/v3/projects/37cf07ebcc8546dbb1a7354a512802aa/users/5fee133d73c24828b30317d3772ea9ae/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:49.691266 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a465f-a145-4c36-aeec-b907a5bf8bb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=37cf07ebcc8546dbb1a7354a512802aa, user_id=5fee133d73c24828b30317d3772ea9ae, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:49.692693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a465f-a145-4c36-aeec-b907a5bf8bb6 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:49.706924 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 596/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:14:49 2022] PUT /identity/v3/projects/37cf07ebcc8546dbb1a7354a512802aa/users/5fee133d73c24828b30317d3772ea9ae/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:14:51.685506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7179a5-a174-4eaa-9888-c74753ebfa00 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:51.686052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7179a5-a174-4eaa-9888-c74753ebfa00 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:51.686052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7179a5-a174-4eaa-9888-c74753ebfa00 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:51.687358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 597/1193] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:14:51.693712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c69985-b3b0-4f3e-b6f6-48072b3ed4f1 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:51.694216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c69985-b3b0-4f3e-b6f6-48072b3ed4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:51.694317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c69985-b3b0-4f3e-b6f6-48072b3ed4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:51.721775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c2c69985-b3b0-4f3e-b6f6-48072b3ed4f1 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:14:51.723048 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c2c69985-b3b0-4f3e-b6f6-48072b3ed4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:14:51.795247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 597/1194] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:14:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:14:51.820218 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7179a5-a174-4eaa-9888-c74753ebfa00 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:51.931804 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7179a5-a174-4eaa-9888-c74753ebfa00 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:51.981945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c6310-e151-4333-8889-66c6ab98e021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:51.987830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c6310-e151-4333-8889-66c6ab98e021 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:51.988105 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c6310-e151-4333-8889-66c6ab98e021 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:51.988370 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c6310-e151-4333-8889-66c6ab98e021 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:51.997353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:52.001021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c6310-e151-4333-8889-66c6ab98e021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-d49c6310-e151-4333-8889-66c6ab98e021 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:14:52.006207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:14:52.007338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:14:52.008414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:14:52.008414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:14:52.008414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:14:52.008414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:14:52.008414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:14:52.008414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:14:52.008414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:14:52.008414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:14:52.008414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:14:52.008414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:14:52.008414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:14:52.008414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:14:52.011160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 598/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:14:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:14:52.013644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c69985-b3b0-4f3e-b6f6-48072b3ed4f1 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:52.026154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:52.120737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c69985-b3b0-4f3e-b6f6-48072b3ed4f1 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:52.157500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c12330-2eb4-4e1c-9215-9b1d36bc6df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:52.158167 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c12330-2eb4-4e1c-9215-9b1d36bc6df0 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:52.158442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c12330-2eb4-4e1c-9215-9b1d36bc6df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:52.158715 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c12330-2eb4-4e1c-9215-9b1d36bc6df0 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:52.159424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c12330-2eb4-4e1c-9215-9b1d36bc6df0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:52.159727 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c12330-2eb4-4e1c-9215-9b1d36bc6df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:52.161125 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c12330-2eb4-4e1c-9215-9b1d36bc6df0 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:52.170557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 598/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:14:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:52.176870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c6310-e151-4333-8889-66c6ab98e021 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:52.296168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c6310-e151-4333-8889-66c6ab98e021 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:52.335934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55175639-3be8-4775-8641-43492d0dc109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:52.336584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55175639-3be8-4775-8641-43492d0dc109 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:52.336853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55175639-3be8-4775-8641-43492d0dc109 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:52.337116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55175639-3be8-4775-8641-43492d0dc109 None admin] PATH_INFO: `/v3/users/5fee133d73c24828b30317d3772ea9ae` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:52.338430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55175639-3be8-4775-8641-43492d0dc109 None admin] RBAC: Authorizing `identity:get_user(user_id=5fee133d73c24828b30317d3772ea9ae)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:52.340859 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55175639-3be8-4775-8641-43492d0dc109 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:52.342459 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 599/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Aug 9 11:14:52 2022] GET /identity/v3/users/5fee133d73c24828b30317d3772ea9ae => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:52.349404 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c12330-2eb4-4e1c-9215-9b1d36bc6df0 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:52.422805 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:52.452591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c12330-2eb4-4e1c-9215-9b1d36bc6df0 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:52.487196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bded32c-6c52-438c-a5f4-a513ba62e591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:52.487793 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bded32c-6c52-438c-a5f4-a513ba62e591 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:52.488065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bded32c-6c52-438c-a5f4-a513ba62e591 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:52.488339 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bded32c-6c52-438c-a5f4-a513ba62e591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:52.558447 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bded32c-6c52-438c-a5f4-a513ba62e591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:52.559830 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bded32c-6c52-438c-a5f4-a513ba62e591 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:52.631851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:52.664906 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 599/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:14:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:14:52.671073 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55175639-3be8-4775-8641-43492d0dc109 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:52.740308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:52.778834 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55175639-3be8-4775-8641-43492d0dc109 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:52.813607 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570ff14-6c13-4350-96c9-4ffab0210f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:52.814174 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570ff14-6c13-4350-96c9-4ffab0210f15 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:52.814456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570ff14-6c13-4350-96c9-4ffab0210f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:52.814719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570ff14-6c13-4350-96c9-4ffab0210f15 None admin] PATH_INFO: `/v3/projects/37cf07ebcc8546dbb1a7354a512802aa` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:52.815887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570ff14-6c13-4350-96c9-4ffab0210f15 None admin] RBAC: Authorizing `identity:get_project(project_id=37cf07ebcc8546dbb1a7354a512802aa)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:52.817341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570ff14-6c13-4350-96c9-4ffab0210f15 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:52.818994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 600/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Aug 9 11:14:52 2022] GET /identity/v3/projects/37cf07ebcc8546dbb1a7354a512802aa => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:14:52.825438 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bded32c-6c52-438c-a5f4-a513ba62e591 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:14:52.927632 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bded32c-6c52-438c-a5f4-a513ba62e591 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:14:52.963421 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e491244-19a3-4060-afc9-1282e108a0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:14:52.964063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491244-19a3-4060-afc9-1282e108a0ac None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:14:52.964297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491244-19a3-4060-afc9-1282e108a0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:14:52.964565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491244-19a3-4060-afc9-1282e108a0ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:14:52.965286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e491244-19a3-4060-afc9-1282e108a0ac None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=37cf07ebcc8546dbb1a7354a512802aa, user.id=5fee133d73c24828b30317d3772ea9ae) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:14:52.965592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e491244-19a3-4060-afc9-1282e108a0ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:14:52.967055 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e491244-19a3-4060-afc9-1282e108a0ac None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:14:52.973221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 600/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:14:52 2022] GET /identity/v3/role_assignments?user.id=5fee133d73c24828b30317d3772ea9ae&scope.project.id=37cf07ebcc8546dbb1a7354a512802aa&role.id=169d11e171d04c87af71475295957618 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:15:02.809027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=32 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:02.970875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=82 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:48.426863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4d774-4f52-4d48-a4ab-50a96e32cc29 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:48.426863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4d774-4f52-4d48-a4ab-50a96e32cc29 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:48.426863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4d774-4f52-4d48-a4ab-50a96e32cc29 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:48.427941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 601/1201] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:15:48.433440 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053db578-0d24-46ce-9298-1e28c34ac09a None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:48.434009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053db578-0d24-46ce-9298-1e28c34ac09a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:48.434009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053db578-0d24-46ce-9298-1e28c34ac09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:48.458400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-053db578-0d24-46ce-9298-1e28c34ac09a None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:15:48.459699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-053db578-0d24-46ce-9298-1e28c34ac09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:48.550366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 601/1202] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:15:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:15:48.581774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4d774-4f52-4d48-a4ab-50a96e32cc29 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:48.730336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4d774-4f52-4d48-a4ab-50a96e32cc29 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:48.774641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0545885-2787-4c4b-b842-c6a570d89e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:48.775360 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0545885-2787-4c4b-b842-c6a570d89e37 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:48.775665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0545885-2787-4c4b-b842-c6a570d89e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:48.775901 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0545885-2787-4c4b-b842-c6a570d89e37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:48.791268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0545885-2787-4c4b-b842-c6a570d89e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:48.793343 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0545885-2787-4c4b-b842-c6a570d89e37 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-c0545885-2787-4c4b-b842-c6a570d89e37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:15:48.809301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:15:48.810447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:15:48.811845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:15:48.811845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:15:48.811845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:15:48.811845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 602/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:15:48.818696 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053db578-0d24-46ce-9298-1e28c34ac09a None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:48.980077 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053db578-0d24-46ce-9298-1e28c34ac09a None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:49.028679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:49.039124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f808c-86ed-4ece-a601-368237e2fdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:49.039924 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f808c-86ed-4ece-a601-368237e2fdde None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:49.040322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f808c-86ed-4ece-a601-368237e2fdde None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:49.040623 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f808c-86ed-4ece-a601-368237e2fdde None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:49.041407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f808c-86ed-4ece-a601-368237e2fdde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:15:49.041749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f808c-86ed-4ece-a601-368237e2fdde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:49.043504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f808c-86ed-4ece-a601-368237e2fdde None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:49.065585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 602/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:15:49.068122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0545885-2787-4c4b-b842-c6a570d89e37 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:49.146718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:49.221157 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0545885-2787-4c4b-b842-c6a570d89e37 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:49.267077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d15fc-91aa-44b8-ba16-854f9b399582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:49.267729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d15fc-91aa-44b8-ba16-854f9b399582 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:49.268022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d15fc-91aa-44b8-ba16-854f9b399582 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:49.268314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d15fc-91aa-44b8-ba16-854f9b399582 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:49.268950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d15fc-91aa-44b8-ba16-854f9b399582 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:49.270486 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d15fc-91aa-44b8-ba16-854f9b399582 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:49.298442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 603/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Aug 9 11:15:49 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:15:51.703873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ed68-42ce-401d-80d5-3eaf34f67328 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:51.704462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ed68-42ce-401d-80d5-3eaf34f67328 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:51.704462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ed68-42ce-401d-80d5-3eaf34f67328 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:51.706090 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 603/1206] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:15:51.712099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41f996-6ebb-424a-8dd9-2ed151d11e82 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:51.712548 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41f996-6ebb-424a-8dd9-2ed151d11e82 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:51.712658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41f996-6ebb-424a-8dd9-2ed151d11e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:51.732950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-4a41f996-6ebb-424a-8dd9-2ed151d11e82 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:15:51.734346 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-4a41f996-6ebb-424a-8dd9-2ed151d11e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:51.813832 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 604/1207] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:15:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:15:51.842363 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409ed68-42ce-401d-80d5-3eaf34f67328 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:51.961456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409ed68-42ce-401d-80d5-3eaf34f67328 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:52.003612 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9d0ff-b92b-4f9e-b3ac-5e1225bf31b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:52.004304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9d0ff-b92b-4f9e-b3ac-5e1225bf31b4 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:52.004613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9d0ff-b92b-4f9e-b3ac-5e1225bf31b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:52.004917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9d0ff-b92b-4f9e-b3ac-5e1225bf31b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:52.020160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9d0ff-b92b-4f9e-b3ac-5e1225bf31b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-bcd9d0ff-b92b-4f9e-b3ac-5e1225bf31b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:15:52.025894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:15:52.026929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:15:52.027996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:15:52.027996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:15:52.027996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:15:52.027996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:15:52.027996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:15:52.027996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:15:52.027996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:15:52.027996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:15:52.027996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:15:52.027996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:15:52.027996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:15:52.027996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:15:52.032603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 604/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:15:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:15:52.034319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41f996-6ebb-424a-8dd9-2ed151d11e82 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:52.089124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:52.170373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41f996-6ebb-424a-8dd9-2ed151d11e82 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:52.215487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c874a21-e223-4172-87a7-0d2a1b1df4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:52.216215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c874a21-e223-4172-87a7-0d2a1b1df4bd None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:52.216603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c874a21-e223-4172-87a7-0d2a1b1df4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:52.216888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c874a21-e223-4172-87a7-0d2a1b1df4bd None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:52.217732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c874a21-e223-4172-87a7-0d2a1b1df4bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:15:52.218009 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c874a21-e223-4172-87a7-0d2a1b1df4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:52.219675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c874a21-e223-4172-87a7-0d2a1b1df4bd None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:52.231604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 605/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:15:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:15:52.238860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9d0ff-b92b-4f9e-b3ac-5e1225bf31b4 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:52.309987 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:52.365173 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9d0ff-b92b-4f9e-b3ac-5e1225bf31b4 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:52.417603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a12572-5fd4-4ede-bd73-0a96fbdcf761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:52.418525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a12572-5fd4-4ede-bd73-0a96fbdcf761 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:52.418882 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a12572-5fd4-4ede-bd73-0a96fbdcf761 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:52.419206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a12572-5fd4-4ede-bd73-0a96fbdcf761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:52.431816 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a12572-5fd4-4ede-bd73-0a96fbdcf761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:52.434036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a12572-5fd4-4ede-bd73-0a96fbdcf761 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-17a12572-5fd4-4ede-bd73-0a96fbdcf761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:15:52.452120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:15:52.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:15:52.454452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:15:52.454452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:15:52.454452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:15:52.454452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 605/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:15:52.459683 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c874a21-e223-4172-87a7-0d2a1b1df4bd None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:52.568045 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:52.572045 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c874a21-e223-4172-87a7-0d2a1b1df4bd None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:52.610644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721b94f-a17e-45ab-8bfb-1cda6a100d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:52.611278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b94f-a17e-45ab-8bfb-1cda6a100d9b None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:52.611548 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b94f-a17e-45ab-8bfb-1cda6a100d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:52.611808 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b94f-a17e-45ab-8bfb-1cda6a100d9b None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:52.612452 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721b94f-a17e-45ab-8bfb-1cda6a100d9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:15:52.612735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721b94f-a17e-45ab-8bfb-1cda6a100d9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:52.614104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721b94f-a17e-45ab-8bfb-1cda6a100d9b None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:52.626738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 606/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:15:52.632689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a12572-5fd4-4ede-bd73-0a96fbdcf761 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:52.750620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a12572-5fd4-4ede-bd73-0a96fbdcf761 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:52.752486 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:52.787655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ad53e-35a6-45eb-9f78-4e131f7453bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:52.788365 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ad53e-35a6-45eb-9f78-4e131f7453bc None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:52.788639 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ad53e-35a6-45eb-9f78-4e131f7453bc None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:52.789015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ad53e-35a6-45eb-9f78-4e131f7453bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:52.796899 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ad53e-35a6-45eb-9f78-4e131f7453bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:52.798558 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ad53e-35a6-45eb-9f78-4e131f7453bc None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-cf6ad53e-35a6-45eb-9f78-4e131f7453bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:15:52.810841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:15:52.812208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:15:52.813430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:15:52.813430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:15:52.813430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:15:52.813430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:15:52.813430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:15:52.813430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:15:52.813430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:15:52.813430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:15:52.813430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:15:52.813430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:15:52.813430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 606/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:15:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:15:52.818332 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721b94f-a17e-45ab-8bfb-1cda6a100d9b None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:52.935053 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721b94f-a17e-45ab-8bfb-1cda6a100d9b None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:52.972972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9f8ea-f9bf-47f4-abad-b810b45d47c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:52.973585 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f8ea-f9bf-47f4-abad-b810b45d47c2 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:52.973858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f8ea-f9bf-47f4-abad-b810b45d47c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:52.974119 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f8ea-f9bf-47f4-abad-b810b45d47c2 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:52.974877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9f8ea-f9bf-47f4-abad-b810b45d47c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:15:52.975176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9f8ea-f9bf-47f4-abad-b810b45d47c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:52.976614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9f8ea-f9bf-47f4-abad-b810b45d47c2 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:52.995985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 607/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Aug 9 11:15:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:15:53.002361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ad53e-35a6-45eb-9f78-4e131f7453bc None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:53.116084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ad53e-35a6-45eb-9f78-4e131f7453bc None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:53.161762 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eefc75-6b73-45f8-97d4-7c4f5f939137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:53.162519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eefc75-6b73-45f8-97d4-7c4f5f939137 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:53.162866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eefc75-6b73-45f8-97d4-7c4f5f939137 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:53.163151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eefc75-6b73-45f8-97d4-7c4f5f939137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:53.204435 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:53.254997 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eefc75-6b73-45f8-97d4-7c4f5f939137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:53.256990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eefc75-6b73-45f8-97d4-7c4f5f939137 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:53.381893 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 607/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:15:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:15:53.388249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9f8ea-f9bf-47f4-abad-b810b45d47c2 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:53.414117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:53.528815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9f8ea-f9bf-47f4-abad-b810b45d47c2 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:53.571453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9a9e0-eb70-4170-a758-d3b31bd84639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:53.572136 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9a9e0-eb70-4170-a758-d3b31bd84639 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:53.572403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9a9e0-eb70-4170-a758-d3b31bd84639 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:53.572665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9a9e0-eb70-4170-a758-d3b31bd84639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:53.585066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9a9e0-eb70-4170-a758-d3b31bd84639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:53.586652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9a9e0-eb70-4170-a758-d3b31bd84639 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-68a9a9e0-eb70-4170-a758-d3b31bd84639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:15:53.603391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:15:53.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:15:53.605463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:15:53.605463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:15:53.605463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:15:53.605463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 608/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:15:53.610963 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eefc75-6b73-45f8-97d4-7c4f5f939137 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:53.693067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:53.743127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eefc75-6b73-45f8-97d4-7c4f5f939137 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:53.784152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e2b14-5798-469d-b8dd-9ec5d7b0a928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:53.784952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e2b14-5798-469d-b8dd-9ec5d7b0a928 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:53.786009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e2b14-5798-469d-b8dd-9ec5d7b0a928 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:53.786295 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e2b14-5798-469d-b8dd-9ec5d7b0a928 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:53.786976 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e2b14-5798-469d-b8dd-9ec5d7b0a928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:15:53.787278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e2b14-5798-469d-b8dd-9ec5d7b0a928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:53.788663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e2b14-5798-469d-b8dd-9ec5d7b0a928 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:53.808045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 608/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:15:53.810205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9a9e0-eb70-4170-a758-d3b31bd84639 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:53.895317 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:53.937615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9a9e0-eb70-4170-a758-d3b31bd84639 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:53.983951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541001a-dc91-4aff-be22-5f98e0eda5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:53.984504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541001a-dc91-4aff-be22-5f98e0eda5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:53.984776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541001a-dc91-4aff-be22-5f98e0eda5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:53.985041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541001a-dc91-4aff-be22-5f98e0eda5d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:53.992061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541001a-dc91-4aff-be22-5f98e0eda5d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:53.993873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541001a-dc91-4aff-be22-5f98e0eda5d5 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-9541001a-dc91-4aff-be22-5f98e0eda5d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:15:54.007913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:15:54.009689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:15:54.010933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:15:54.010933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:15:54.010933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:15:54.010933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:15:54.010933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:15:54.010933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:15:54.010933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:15:54.010933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:15:54.014845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 609/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:15:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:15:54.015632 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e2b14-5798-469d-b8dd-9ec5d7b0a928 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:54.135415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e2b14-5798-469d-b8dd-9ec5d7b0a928 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:54.164016 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:54.177002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f0a4c-7d75-4d95-86ec-0cfd9bc1fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:54.177686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f0a4c-7d75-4d95-86ec-0cfd9bc1fecc None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:54.178020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f0a4c-7d75-4d95-86ec-0cfd9bc1fecc None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:54.178350 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f0a4c-7d75-4d95-86ec-0cfd9bc1fecc None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:54.179245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f0a4c-7d75-4d95-86ec-0cfd9bc1fecc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:15:54.179550 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f0a4c-7d75-4d95-86ec-0cfd9bc1fecc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:54.181192 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f0a4c-7d75-4d95-86ec-0cfd9bc1fecc None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:54.195911 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 609/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:15:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:15:54.201669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541001a-dc91-4aff-be22-5f98e0eda5d5 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:54.309508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541001a-dc91-4aff-be22-5f98e0eda5d5 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:54.339579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:54.346106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae11a6c-4623-4659-be3a-219322b18253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:54.346828 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae11a6c-4623-4659-be3a-219322b18253 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:54.347237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae11a6c-4623-4659-be3a-219322b18253 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:54.347744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae11a6c-4623-4659-be3a-219322b18253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:54.348648 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae11a6c-4623-4659-be3a-219322b18253 None admin] RBAC: Adding query filter params (role.id=9f750e14956d482c8757564559516c7a, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=a04b584a68cb488492046faa23e15463) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:15:54.349189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae11a6c-4623-4659-be3a-219322b18253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:54.350684 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae11a6c-4623-4659-be3a-219322b18253 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:54.357093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 610/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:15:54 2022] GET /identity/v3/role_assignments?user.id=a04b584a68cb488492046faa23e15463&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=9f750e14956d482c8757564559516c7a => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:15:56.378730 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2697386-4b6d-4bde-9ee8-82c6aa79ef7a None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:56.379424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2697386-4b6d-4bde-9ee8-82c6aa79ef7a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:56.379424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2697386-4b6d-4bde-9ee8-82c6aa79ef7a None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:56.380613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 610/1220] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:15:56.386659 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d60e8-744f-47ed-831b-72f9acb2cbb0 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:56.387205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d60e8-744f-47ed-831b-72f9acb2cbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:56.387318 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d60e8-744f-47ed-831b-72f9acb2cbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:56.408833 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-d69d60e8-744f-47ed-831b-72f9acb2cbb0 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:15:56.410101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d69d60e8-744f-47ed-831b-72f9acb2cbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:56.485605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 611/1221] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:15:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:15:56.509904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2697386-4b6d-4bde-9ee8-82c6aa79ef7a None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:56.628324 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2697386-4b6d-4bde-9ee8-82c6aa79ef7a None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:56.665912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0632dea-b51a-4aff-9002-b838404f6ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:56.666470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0632dea-b51a-4aff-9002-b838404f6ddb None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:56.666750 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0632dea-b51a-4aff-9002-b838404f6ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:56.667053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0632dea-b51a-4aff-9002-b838404f6ddb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:56.678087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0632dea-b51a-4aff-9002-b838404f6ddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-e0632dea-b51a-4aff-9002-b838404f6ddb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:15:56.682874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:15:56.684001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:15:56.684990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:15:56.684990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:15:56.684990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:15:56.684990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:15:56.684990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:15:56.684990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:15:56.684990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:15:56.684990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:15:56.684990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:15:56.684990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:15:56.684990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:15:56.684990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:15:56.684990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 611/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:15:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:15:56.690707 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d60e8-744f-47ed-831b-72f9acb2cbb0 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:56.809640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d60e8-744f-47ed-831b-72f9acb2cbb0 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:56.847891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:56.864389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbeee71-62b1-4d4d-87b6-4eb5591f9e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:56.865357 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbeee71-62b1-4d4d-87b6-4eb5591f9e55 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:56.865777 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbeee71-62b1-4d4d-87b6-4eb5591f9e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:56.866172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbeee71-62b1-4d4d-87b6-4eb5591f9e55 None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:56.867703 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbeee71-62b1-4d4d-87b6-4eb5591f9e55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:15:56.869250 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbeee71-62b1-4d4d-87b6-4eb5591f9e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:56.871051 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbeee71-62b1-4d4d-87b6-4eb5591f9e55 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:56.882474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 612/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:15:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:15:56.888819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0632dea-b51a-4aff-9002-b838404f6ddb None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:56.938738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:57.009507 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0632dea-b51a-4aff-9002-b838404f6ddb None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:57.047356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7026e8a-24fa-4612-b8b6-b272fa9c29a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:57.048189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7026e8a-24fa-4612-b8b6-b272fa9c29a2 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:57.048574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7026e8a-24fa-4612-b8b6-b272fa9c29a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:57.048936 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7026e8a-24fa-4612-b8b6-b272fa9c29a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:57.061727 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7026e8a-24fa-4612-b8b6-b272fa9c29a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:57.063771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7026e8a-24fa-4612-b8b6-b272fa9c29a2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-e7026e8a-24fa-4612-b8b6-b272fa9c29a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:15:57.082253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:15:57.083382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:15:57.084448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:15:57.084448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:15:57.084448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:15:57.084448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 612/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:15:57.094655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbeee71-62b1-4d4d-87b6-4eb5591f9e55 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:57.215899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbeee71-62b1-4d4d-87b6-4eb5591f9e55 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:57.256710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80267f-6c65-4f54-adba-7b56643a4114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:57.257328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80267f-6c65-4f54-adba-7b56643a4114 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:57.257603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80267f-6c65-4f54-adba-7b56643a4114 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:57.257868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80267f-6c65-4f54-adba-7b56643a4114 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:57.258517 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80267f-6c65-4f54-adba-7b56643a4114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:15:57.258843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80267f-6c65-4f54-adba-7b56643a4114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:57.260237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80267f-6c65-4f54-adba-7b56643a4114 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:57.276234 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 613/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:15:57.281973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7026e8a-24fa-4612-b8b6-b272fa9c29a2 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:57.430756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:57.443186 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7026e8a-24fa-4612-b8b6-b272fa9c29a2 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:57.501450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd12063-b515-4ae5-b30d-ccd70d6c860c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:57.502049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12063-b515-4ae5-b30d-ccd70d6c860c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:57.502373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12063-b515-4ae5-b30d-ccd70d6c860c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:57.502698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12063-b515-4ae5-b30d-ccd70d6c860c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:57.524855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd12063-b515-4ae5-b30d-ccd70d6c860c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:57.526392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd12063-b515-4ae5-b30d-ccd70d6c860c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-5cd12063-b515-4ae5-b30d-ccd70d6c860c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:15:57.539408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:15:57.540559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:15:57.546734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:15:57.546734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:15:57.546734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:15:57.546734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:15:57.546734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:15:57.546734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:15:57.546734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:15:57.546734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:15:57.546734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:15:57.546734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:15:57.546734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 613/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:15:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:15:57.548680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80267f-6c65-4f54-adba-7b56643a4114 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:57.606706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:57.667241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80267f-6c65-4f54-adba-7b56643a4114 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:57.709574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb70ec-ffbd-493b-8416-c3363480eae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:57.710690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb70ec-ffbd-493b-8416-c3363480eae7 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:57.711217 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb70ec-ffbd-493b-8416-c3363480eae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:57.711678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb70ec-ffbd-493b-8416-c3363480eae7 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:57.713040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb70ec-ffbd-493b-8416-c3363480eae7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:15:57.713583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb70ec-ffbd-493b-8416-c3363480eae7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:57.716112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb70ec-ffbd-493b-8416-c3363480eae7 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:57.739227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 614/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Aug 9 11:15:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:15:57.746022 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd12063-b515-4ae5-b30d-ccd70d6c860c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:57.865424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd12063-b515-4ae5-b30d-ccd70d6c860c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:57.903245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f3520-9c76-41f9-a5fc-84945cdf5450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:57.903978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f3520-9c76-41f9-a5fc-84945cdf5450 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:57.904253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f3520-9c76-41f9-a5fc-84945cdf5450 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:57.904539 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f3520-9c76-41f9-a5fc-84945cdf5450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:57.918976 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f3520-9c76-41f9-a5fc-84945cdf5450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:57.921423 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f3520-9c76-41f9-a5fc-84945cdf5450 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-6f2f3520-9c76-41f9-a5fc-84945cdf5450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:15:57.945960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:15:57.947510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:15:57.953317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:15:57.953317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:15:57.953317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:15:57.953317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 614/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:15:57.953696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb70ec-ffbd-493b-8416-c3363480eae7 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:58.066736 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb70ec-ffbd-493b-8416-c3363480eae7 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:58.069548 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:58.108016 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a4de7-3d76-4989-8b28-6cc1526de82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:58.108750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a4de7-3d76-4989-8b28-6cc1526de82e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:58.108962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a4de7-3d76-4989-8b28-6cc1526de82e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:58.109172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a4de7-3d76-4989-8b28-6cc1526de82e None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:58.109845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a4de7-3d76-4989-8b28-6cc1526de82e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:15:58.110212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a4de7-3d76-4989-8b28-6cc1526de82e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:58.111698 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a4de7-3d76-4989-8b28-6cc1526de82e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:58.128320 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 615/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:15:58.137706 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f3520-9c76-41f9-a5fc-84945cdf5450 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:58.153363 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:58.276286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f3520-9c76-41f9-a5fc-84945cdf5450 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:58.319787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd332a-c09e-4feb-9ac9-f40a50a53854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:58.320579 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd332a-c09e-4feb-9ac9-f40a50a53854 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:58.321109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd332a-c09e-4feb-9ac9-f40a50a53854 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:58.321297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd332a-c09e-4feb-9ac9-f40a50a53854 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:58.331514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd332a-c09e-4feb-9ac9-f40a50a53854 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:58.333562 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd332a-c09e-4feb-9ac9-f40a50a53854 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-bddd332a-c09e-4feb-9ac9-f40a50a53854 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:15:58.348396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:15:58.349499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:15:58.350429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:15:58.350429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:15:58.350429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:15:58.350429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:15:58.350429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:15:58.350429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:15:58.350429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:15:58.350429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:15:58.350429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 615/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:15:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:15:58.356058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a4de7-3d76-4989-8b28-6cc1526de82e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:58.497275 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a4de7-3d76-4989-8b28-6cc1526de82e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:58.547460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f8ed1-79c6-4bde-b17a-cbc79376cbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:58.548273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f8ed1-79c6-4bde-b17a-cbc79376cbea None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:58.549382 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f8ed1-79c6-4bde-b17a-cbc79376cbea None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:58.549382 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f8ed1-79c6-4bde-b17a-cbc79376cbea None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:58.550031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f8ed1-79c6-4bde-b17a-cbc79376cbea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:15:58.550031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f8ed1-79c6-4bde-b17a-cbc79376cbea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:58.551863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f8ed1-79c6-4bde-b17a-cbc79376cbea None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:58.571430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 616/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:15:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:15:58.578336 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd332a-c09e-4feb-9ac9-f40a50a53854 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:58.665308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:58.706276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd332a-c09e-4feb-9ac9-f40a50a53854 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:58.752447 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07494c04-abf7-48fd-bdaa-4d028a932605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:58.753166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07494c04-abf7-48fd-bdaa-4d028a932605 None admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:58.753571 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07494c04-abf7-48fd-bdaa-4d028a932605 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:58.754032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07494c04-abf7-48fd-bdaa-4d028a932605 None admin] PATH_INFO: `/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/a04b584a68cb488492046faa23e15463/roles/9f750e14956d482c8757564559516c7a` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:58.771028 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07494c04-abf7-48fd-bdaa-4d028a932605 None admin] RBAC: Authorizing `identity:create_grant(project_id=f53fb3d6b68b4654ae7247c9b74015e7, user_id=a04b584a68cb488492046faa23e15463, role_id=9f750e14956d482c8757564559516c7a)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:58.772968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07494c04-abf7-48fd-bdaa-4d028a932605 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:58.789493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 616/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:15:58 2022] PUT /identity/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/a04b584a68cb488492046faa23e15463/roles/9f750e14956d482c8757564559516c7a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:16:01.100069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088cab2-a872-4333-88b0-0df4e0831635 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:01.101001 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088cab2-a872-4333-88b0-0df4e0831635 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:01.101001 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088cab2-a872-4333-88b0-0df4e0831635 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:01.102798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 617/1233] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:16:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:16:01.109610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40b567-b59c-4888-9bde-9d663307bd95 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:01.110428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40b567-b59c-4888-9bde-9d663307bd95 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:01.110609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40b567-b59c-4888-9bde-9d663307bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:01.133813 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ed40b567-b59c-4888-9bde-9d663307bd95 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:16:01.135805 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ed40b567-b59c-4888-9bde-9d663307bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:16:01.229292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 617/1234] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:16:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:16:01.258541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088cab2-a872-4333-88b0-0df4e0831635 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:01.287983 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:01.375031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088cab2-a872-4333-88b0-0df4e0831635 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:01.419886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1033ce2-cd48-4b7d-87c3-7748fc8492ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:01.420525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1033ce2-cd48-4b7d-87c3-7748fc8492ae None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:01.420778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1033ce2-cd48-4b7d-87c3-7748fc8492ae None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:01.421065 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1033ce2-cd48-4b7d-87c3-7748fc8492ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:01.433112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1033ce2-cd48-4b7d-87c3-7748fc8492ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-a1033ce2-cd48-4b7d-87c3-7748fc8492ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:16:01.445811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:01.446974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:01.447841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:01.447841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:01.447841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:01.447841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:01.447841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:16:01.447841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:16:01.447841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:16:01.447841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:16:01.447841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:16:01.447841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:16:01.447841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:16:01.447841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:16:01.447841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 618/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Aug 9 11:16:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:01.453471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40b567-b59c-4888-9bde-9d663307bd95 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:01.524448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:01.588465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40b567-b59c-4888-9bde-9d663307bd95 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:01.639031 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d9a3b-13bc-4aab-a0bc-d229a81dab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:01.639548 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d9a3b-13bc-4aab-a0bc-d229a81dab9f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:01.639822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d9a3b-13bc-4aab-a0bc-d229a81dab9f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:01.640092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d9a3b-13bc-4aab-a0bc-d229a81dab9f None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:01.640897 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d9a3b-13bc-4aab-a0bc-d229a81dab9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:01.641233 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d9a3b-13bc-4aab-a0bc-d229a81dab9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:01.642728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d9a3b-13bc-4aab-a0bc-d229a81dab9f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:01.658016 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 618/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Aug 9 11:16:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:01.659556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1033ce2-cd48-4b7d-87c3-7748fc8492ae None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:01.780814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:01.804762 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1033ce2-cd48-4b7d-87c3-7748fc8492ae None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:01.849120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cdf56-f26c-4331-aab1-06e2bbc3a65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:01.849746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cdf56-f26c-4331-aab1-06e2bbc3a65e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:01.850025 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cdf56-f26c-4331-aab1-06e2bbc3a65e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:01.850263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cdf56-f26c-4331-aab1-06e2bbc3a65e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:01.861058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cdf56-f26c-4331-aab1-06e2bbc3a65e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:01.862648 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cdf56-f26c-4331-aab1-06e2bbc3a65e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-da2cdf56-f26c-4331-aab1-06e2bbc3a65e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:16:01.878895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:01.880237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:16:01.881159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:16:01.881159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:01.881159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:16:01.881159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 619/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:16:01.886002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d9a3b-13bc-4aab-a0bc-d229a81dab9f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:01.996810 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d9a3b-13bc-4aab-a0bc-d229a81dab9f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:02.006275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:02.042643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85a8bc-4f1d-4343-acbd-e15de68c48bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:02.043369 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85a8bc-4f1d-4343-acbd-e15de68c48bd None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:02.043672 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85a8bc-4f1d-4343-acbd-e15de68c48bd None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:02.043933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85a8bc-4f1d-4343-acbd-e15de68c48bd None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:02.044616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85a8bc-4f1d-4343-acbd-e15de68c48bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:02.044921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85a8bc-4f1d-4343-acbd-e15de68c48bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:02.046687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85a8bc-4f1d-4343-acbd-e15de68c48bd None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:02.061564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 619/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:02.069105 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cdf56-f26c-4331-aab1-06e2bbc3a65e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:02.185394 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cdf56-f26c-4331-aab1-06e2bbc3a65e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:02.221974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43be136-a0f8-4981-8d0b-d80541bff084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:02.223130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43be136-a0f8-4981-8d0b-d80541bff084 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:02.223671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43be136-a0f8-4981-8d0b-d80541bff084 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:02.224036 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43be136-a0f8-4981-8d0b-d80541bff084 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:02.227206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:02.233417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43be136-a0f8-4981-8d0b-d80541bff084 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:02.235371 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43be136-a0f8-4981-8d0b-d80541bff084 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-a43be136-a0f8-4981-8d0b-d80541bff084 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:16:02.248446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:02.249752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:02.251160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:02.251160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:02.251160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:16:02.251160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:16:02.251160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:16:02.251160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:16:02.251160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:16:02.251160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:16:02.251160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:16:02.251160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:16:02.251160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 620/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:16:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:02.255961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85a8bc-4f1d-4343-acbd-e15de68c48bd None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:02.377351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85a8bc-4f1d-4343-acbd-e15de68c48bd None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:02.417395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b12ef-80e2-4b19-a676-c266b4034c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:02.418032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b12ef-80e2-4b19-a676-c266b4034c56 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:02.418426 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b12ef-80e2-4b19-a676-c266b4034c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:02.418703 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b12ef-80e2-4b19-a676-c266b4034c56 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:02.419584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b12ef-80e2-4b19-a676-c266b4034c56 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:02.419915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b12ef-80e2-4b19-a676-c266b4034c56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:02.421812 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b12ef-80e2-4b19-a676-c266b4034c56 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:02.441071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 620/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Aug 9 11:16:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:02.447917 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43be136-a0f8-4981-8d0b-d80541bff084 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:02.562048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43be136-a0f8-4981-8d0b-d80541bff084 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:02.598868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d95ca-c8b1-4ab8-94ea-31b918a8f9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:02.599480 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d95ca-c8b1-4ab8-94ea-31b918a8f9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:02.599754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d95ca-c8b1-4ab8-94ea-31b918a8f9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:02.600133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d95ca-c8b1-4ab8-94ea-31b918a8f9d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:02.679194 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:02.686595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d95ca-c8b1-4ab8-94ea-31b918a8f9d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:02.688129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d95ca-c8b1-4ab8-94ea-31b918a8f9d9 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:02.807367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 621/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:16:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:16:02.813934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b12ef-80e2-4b19-a676-c266b4034c56 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:02.845236 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:02.930514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b12ef-80e2-4b19-a676-c266b4034c56 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:02.968460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a19e19-eab1-4537-ba5f-cfab6b16bffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:02.969152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a19e19-eab1-4537-ba5f-cfab6b16bffd None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:02.969462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a19e19-eab1-4537-ba5f-cfab6b16bffd None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:02.969783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a19e19-eab1-4537-ba5f-cfab6b16bffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:02.981963 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a19e19-eab1-4537-ba5f-cfab6b16bffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:02.983485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a19e19-eab1-4537-ba5f-cfab6b16bffd None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-02a19e19-eab1-4537-ba5f-cfab6b16bffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:16:03.000872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:03.001995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:16:03.002955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:16:03.002955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:03.002955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:03.002955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 621/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:16:03.008604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d95ca-c8b1-4ab8-94ea-31b918a8f9d9 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:03.130942 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:03.138233 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d95ca-c8b1-4ab8-94ea-31b918a8f9d9 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:03.184103 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61cc3b-eb65-475f-8e0b-8747c9fe86f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:03.184896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61cc3b-eb65-475f-8e0b-8747c9fe86f4 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:03.185275 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61cc3b-eb65-475f-8e0b-8747c9fe86f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:03.185442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61cc3b-eb65-475f-8e0b-8747c9fe86f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:03.186587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61cc3b-eb65-475f-8e0b-8747c9fe86f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:03.186992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61cc3b-eb65-475f-8e0b-8747c9fe86f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:03.188915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61cc3b-eb65-475f-8e0b-8747c9fe86f4 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:03.201839 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 622/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:16:03.208564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a19e19-eab1-4537-ba5f-cfab6b16bffd None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:03.312813 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:03.350094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a19e19-eab1-4537-ba5f-cfab6b16bffd None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:03.389883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f491f89-9bf1-445f-9974-d3bd4852f598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:03.390430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f491f89-9bf1-445f-9974-d3bd4852f598 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:03.390701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f491f89-9bf1-445f-9974-d3bd4852f598 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:03.391004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f491f89-9bf1-445f-9974-d3bd4852f598 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:03.398332 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f491f89-9bf1-445f-9974-d3bd4852f598 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:03.399850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f491f89-9bf1-445f-9974-d3bd4852f598 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-8f491f89-9bf1-445f-9974-d3bd4852f598 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:16:03.413290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:03.414362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:03.415407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:16:03.415407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:16:03.415407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:16:03.415407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:16:03.415407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:16:03.415407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:16:03.415407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:16:03.415407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:03.415407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 622/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:16:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:03.420668 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61cc3b-eb65-475f-8e0b-8747c9fe86f4 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:03.545847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61cc3b-eb65-475f-8e0b-8747c9fe86f4 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:03.592197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00964e15-3c1b-4e5c-a853-d74ad8ed78a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:03.592993 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00964e15-3c1b-4e5c-a853-d74ad8ed78a4 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:03.593513 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00964e15-3c1b-4e5c-a853-d74ad8ed78a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:03.593811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00964e15-3c1b-4e5c-a853-d74ad8ed78a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:03.594824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00964e15-3c1b-4e5c-a853-d74ad8ed78a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:03.595318 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00964e15-3c1b-4e5c-a853-d74ad8ed78a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:03.597282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00964e15-3c1b-4e5c-a853-d74ad8ed78a4 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:03.614247 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 623/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:16:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:16:03.622637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f491f89-9bf1-445f-9974-d3bd4852f598 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:03.743224 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f491f89-9bf1-445f-9974-d3bd4852f598 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:03.782261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e1f84-8fbf-4d45-a9dc-74895c2f2b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:03.782989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e1f84-8fbf-4d45-a9dc-74895c2f2b74 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:03.783268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e1f84-8fbf-4d45-a9dc-74895c2f2b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:03.783534 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e1f84-8fbf-4d45-a9dc-74895c2f2b74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:03.784371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e1f84-8fbf-4d45-a9dc-74895c2f2b74 None admin] RBAC: Adding query filter params (role.id=9f750e14956d482c8757564559516c7a, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=a04b584a68cb488492046faa23e15463) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:03.784567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e1f84-8fbf-4d45-a9dc-74895c2f2b74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:03.785993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e1f84-8fbf-4d45-a9dc-74895c2f2b74 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:03.792720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 623/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:16:03 2022] GET /identity/v3/role_assignments?user.id=a04b584a68cb488492046faa23e15463&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=9f750e14956d482c8757564559516c7a => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:16:05.929937 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bca544-9ef5-4af4-afec-ae00c160c0cd None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:05.930507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bca544-9ef5-4af4-afec-ae00c160c0cd None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:05.930507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bca544-9ef5-4af4-afec-ae00c160c0cd None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:05.931870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 624/1247] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:16:05.940763 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0766d9-39a9-44d8-9325-dc73f84b61eb None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:05.941294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0766d9-39a9-44d8-9325-dc73f84b61eb None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:05.941294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0766d9-39a9-44d8-9325-dc73f84b61eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:05.948684 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:05.961873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ad0766d9-39a9-44d8-9325-dc73f84b61eb None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:16:05.963077 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ad0766d9-39a9-44d8-9325-dc73f84b61eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:16:06.042851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 624/1248] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:16:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:16:06.065566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bca544-9ef5-4af4-afec-ae00c160c0cd None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:06.090615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:06.193441 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bca544-9ef5-4af4-afec-ae00c160c0cd None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:06.233293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198fe6f-6f27-40f3-adee-ee3c21cda873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:06.233922 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198fe6f-6f27-40f3-adee-ee3c21cda873 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:06.234210 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198fe6f-6f27-40f3-adee-ee3c21cda873 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:06.234473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198fe6f-6f27-40f3-adee-ee3c21cda873 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:06.245191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198fe6f-6f27-40f3-adee-ee3c21cda873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-a198fe6f-6f27-40f3-adee-ee3c21cda873 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:16:06.249936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:06.256504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:06.257660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:06.257660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:06.257660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:06.257660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:06.257660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:16:06.257660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:16:06.257660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:16:06.257660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:16:06.257660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:16:06.257660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:16:06.257660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:16:06.257660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:16:06.257660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 625/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:16:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:06.258471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0766d9-39a9-44d8-9325-dc73f84b61eb None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:06.383880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0766d9-39a9-44d8-9325-dc73f84b61eb None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:06.417957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:06.424369 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c045f0-a322-4f50-9c2a-3fa0725e0d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:06.425068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c045f0-a322-4f50-9c2a-3fa0725e0d74 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:06.425406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c045f0-a322-4f50-9c2a-3fa0725e0d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:06.425818 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c045f0-a322-4f50-9c2a-3fa0725e0d74 None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:06.426493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c045f0-a322-4f50-9c2a-3fa0725e0d74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:06.426828 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c045f0-a322-4f50-9c2a-3fa0725e0d74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:06.428523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c045f0-a322-4f50-9c2a-3fa0725e0d74 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:06.439012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 625/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:16:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:06.446170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198fe6f-6f27-40f3-adee-ee3c21cda873 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:06.537205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:06.562115 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198fe6f-6f27-40f3-adee-ee3c21cda873 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:06.607527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffd9a8-3129-455a-9d31-41478206503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:06.608138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd9a8-3129-455a-9d31-41478206503a None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:06.608464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd9a8-3129-455a-9d31-41478206503a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:06.608705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd9a8-3129-455a-9d31-41478206503a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:06.621745 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffd9a8-3129-455a-9d31-41478206503a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:06.623338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffd9a8-3129-455a-9d31-41478206503a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-55ffd9a8-3129-455a-9d31-41478206503a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:16:06.640170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:06.641277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:16:06.642255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:16:06.642255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:06.642255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:16:06.642255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 626/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:06.647267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c045f0-a322-4f50-9c2a-3fa0725e0d74 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:06.760957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c045f0-a322-4f50-9c2a-3fa0725e0d74 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:06.796791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a1ced-6013-4075-a969-7e6aa95a712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:06.797397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a1ced-6013-4075-a969-7e6aa95a712e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:06.797729 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a1ced-6013-4075-a969-7e6aa95a712e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:06.798000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a1ced-6013-4075-a969-7e6aa95a712e None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:06.798662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a1ced-6013-4075-a969-7e6aa95a712e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:06.798988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a1ced-6013-4075-a969-7e6aa95a712e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:06.800405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a1ced-6013-4075-a969-7e6aa95a712e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:06.813709 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 626/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:06.820017 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffd9a8-3129-455a-9d31-41478206503a None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:06.946512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffd9a8-3129-455a-9d31-41478206503a None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:06.974254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:06.983806 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ae5f2-e8dd-4a9f-9451-581f7fa209c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:06.984562 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae5f2-e8dd-4a9f-9451-581f7fa209c4 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:06.984849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae5f2-e8dd-4a9f-9451-581f7fa209c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:06.985486 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae5f2-e8dd-4a9f-9451-581f7fa209c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:06.995347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ae5f2-e8dd-4a9f-9451-581f7fa209c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:06.997110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ae5f2-e8dd-4a9f-9451-581f7fa209c4 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-446ae5f2-e8dd-4a9f-9451-581f7fa209c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:16:07.013430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:07.014509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:07.015515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:07.015515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:07.015515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:16:07.015515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:16:07.015515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:16:07.015515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:16:07.015515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:16:07.015515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:16:07.015515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:16:07.015515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:16:07.015515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 627/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:16:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:07.020822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a1ced-6013-4075-a969-7e6aa95a712e None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:07.091554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:07.146234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a1ced-6013-4075-a969-7e6aa95a712e None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:07.187544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fee4f-eb3f-420a-b0dd-c6ce65685956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:07.188181 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fee4f-eb3f-420a-b0dd-c6ce65685956 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:07.188497 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fee4f-eb3f-420a-b0dd-c6ce65685956 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:07.188897 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fee4f-eb3f-420a-b0dd-c6ce65685956 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:07.189787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fee4f-eb3f-420a-b0dd-c6ce65685956 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:07.190093 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fee4f-eb3f-420a-b0dd-c6ce65685956 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:07.191754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fee4f-eb3f-420a-b0dd-c6ce65685956 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:07.209862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 627/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Aug 9 11:16:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:07.216564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ae5f2-e8dd-4a9f-9451-581f7fa209c4 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:07.341730 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ae5f2-e8dd-4a9f-9451-581f7fa209c4 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:07.383653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128478e1-5a21-47b0-ba7c-a44b98263b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:07.384417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128478e1-5a21-47b0-ba7c-a44b98263b90 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:07.384767 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128478e1-5a21-47b0-ba7c-a44b98263b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:07.385107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128478e1-5a21-47b0-ba7c-a44b98263b90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:07.454967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:07.468608 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128478e1-5a21-47b0-ba7c-a44b98263b90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:07.470350 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128478e1-5a21-47b0-ba7c-a44b98263b90 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:07.597475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 628/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:16:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:16:07.603725 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fee4f-eb3f-420a-b0dd-c6ce65685956 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:07.718967 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fee4f-eb3f-420a-b0dd-c6ce65685956 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:07.741195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:07.772855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee525f13-d643-422e-9b2e-7be58ec46617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:07.773538 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee525f13-d643-422e-9b2e-7be58ec46617 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:07.774275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee525f13-d643-422e-9b2e-7be58ec46617 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:07.774554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee525f13-d643-422e-9b2e-7be58ec46617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:07.787745 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee525f13-d643-422e-9b2e-7be58ec46617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:07.789374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee525f13-d643-422e-9b2e-7be58ec46617 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-ee525f13-d643-422e-9b2e-7be58ec46617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:16:07.808189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:07.814143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:16:07.815318 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:16:07.815318 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:07.815318 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:07.815318 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 628/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:16:07.815616 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128478e1-5a21-47b0-ba7c-a44b98263b90 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:07.917609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:07.933310 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128478e1-5a21-47b0-ba7c-a44b98263b90 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:07.970046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f368e-721d-42a8-bdc3-b2f223f9c5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:07.970717 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f368e-721d-42a8-bdc3-b2f223f9c5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:07.970987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f368e-721d-42a8-bdc3-b2f223f9c5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:07.971252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f368e-721d-42a8-bdc3-b2f223f9c5b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:07.971891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f368e-721d-42a8-bdc3-b2f223f9c5b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:07.972188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f368e-721d-42a8-bdc3-b2f223f9c5b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:07.973576 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f368e-721d-42a8-bdc3-b2f223f9c5b0 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:07.986751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 629/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:07.993718 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee525f13-d643-422e-9b2e-7be58ec46617 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:08.111464 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee525f13-d643-422e-9b2e-7be58ec46617 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:08.146568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a23a9-062a-466b-92b2-77b1cd3412e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:08.147186 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a23a9-062a-466b-92b2-77b1cd3412e3 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:08.147527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a23a9-062a-466b-92b2-77b1cd3412e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:08.147746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a23a9-062a-466b-92b2-77b1cd3412e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:08.155879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a23a9-062a-466b-92b2-77b1cd3412e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:08.157911 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a23a9-062a-466b-92b2-77b1cd3412e3 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-2f9a23a9-062a-466b-92b2-77b1cd3412e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:16:08.170384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:08.171605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:08.172960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:16:08.172960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:16:08.172960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:16:08.172960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:16:08.172960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:16:08.172960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:16:08.172960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:16:08.172960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:08.172960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 629/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:16:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:08.179762 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f368e-721d-42a8-bdc3-b2f223f9c5b0 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:08.283780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f368e-721d-42a8-bdc3-b2f223f9c5b0 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:08.317221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e0856-8b99-46c7-8156-df9a6ed55cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:08.317822 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0856-8b99-46c7-8156-df9a6ed55cab None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:08.318088 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0856-8b99-46c7-8156-df9a6ed55cab None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:08.318351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0856-8b99-46c7-8156-df9a6ed55cab None admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:08.319062 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e0856-8b99-46c7-8156-df9a6ed55cab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:08.319356 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e0856-8b99-46c7-8156-df9a6ed55cab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:08.320783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e0856-8b99-46c7-8156-df9a6ed55cab None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:08.334520 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 630/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:16:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:08.340928 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a23a9-062a-466b-92b2-77b1cd3412e3 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:08.369600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:08.467265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a23a9-062a-466b-92b2-77b1cd3412e3 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:08.505375 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f5a5e-b8d6-4fa7-9197-7dce43afbc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:08.505994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5a5e-b8d6-4fa7-9197-7dce43afbc2e None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:08.506237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5a5e-b8d6-4fa7-9197-7dce43afbc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:08.506497 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5a5e-b8d6-4fa7-9197-7dce43afbc2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:08.507247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f5a5e-b8d6-4fa7-9197-7dce43afbc2e None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=a04b584a68cb488492046faa23e15463) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:08.507544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f5a5e-b8d6-4fa7-9197-7dce43afbc2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:08.508958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f5a5e-b8d6-4fa7-9197-7dce43afbc2e None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:08.514504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 630/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:16:08 2022] GET /identity/v3/role_assignments?user.id=a04b584a68cb488492046faa23e15463&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=169d11e171d04c87af71475295957618 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:10.600509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56613a-b46d-4313-8d0c-f8c07419628e None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:10.601426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56613a-b46d-4313-8d0c-f8c07419628e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:10.601426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56613a-b46d-4313-8d0c-f8c07419628e None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:10.603546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 631/1261] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:16:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:16:10.612792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8f908-fafe-4a3f-b117-878d81ed1949 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:10.613568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8f908-fafe-4a3f-b117-878d81ed1949 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:10.613722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8f908-fafe-4a3f-b117-878d81ed1949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:10.643989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-b0d8f908-fafe-4a3f-b117-878d81ed1949 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:16:10.645165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b0d8f908-fafe-4a3f-b117-878d81ed1949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:16:10.712531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 631/1262] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:16:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:16:10.738518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56613a-b46d-4313-8d0c-f8c07419628e None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:10.754194 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:10.855948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56613a-b46d-4313-8d0c-f8c07419628e None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:10.893900 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ef8af-4082-4bd3-b2a2-cd516ef53ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:10.894525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ef8af-4082-4bd3-b2a2-cd516ef53ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:10.894797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ef8af-4082-4bd3-b2a2-cd516ef53ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:10.895101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ef8af-4082-4bd3-b2a2-cd516ef53ff4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:10.906702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ef8af-4082-4bd3-b2a2-cd516ef53ff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-069ef8af-4082-4bd3-b2a2-cd516ef53ff4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:16:10.911475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:10.912670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:10.913776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:10.913776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:10.913776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:10.913776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:10.913776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:16:10.913776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:16:10.913776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:16:10.913776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:16:10.913776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:16:10.913776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:16:10.913776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:16:10.913776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:16:10.913776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 632/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:16:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:10.919528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8f908-fafe-4a3f-b117-878d81ed1949 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:10.945254 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:11.030297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8f908-fafe-4a3f-b117-878d81ed1949 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:11.073069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afde1a5-e6ac-4ea1-b60e-432639db549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:11.073816 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde1a5-e6ac-4ea1-b60e-432639db549c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:11.074124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde1a5-e6ac-4ea1-b60e-432639db549c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:11.074388 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde1a5-e6ac-4ea1-b60e-432639db549c None admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:11.075111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afde1a5-e6ac-4ea1-b60e-432639db549c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:11.075552 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afde1a5-e6ac-4ea1-b60e-432639db549c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:11.076891 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afde1a5-e6ac-4ea1-b60e-432639db549c None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:11.086498 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 632/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:16:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:11.093409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ef8af-4082-4bd3-b2a2-cd516ef53ff4 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:11.164219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:11.201108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ef8af-4082-4bd3-b2a2-cd516ef53ff4 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:11.235049 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a674ef-7df6-4330-9736-076213c470c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:11.235668 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a674ef-7df6-4330-9736-076213c470c3 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:11.235941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a674ef-7df6-4330-9736-076213c470c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:11.236227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a674ef-7df6-4330-9736-076213c470c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:11.246536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a674ef-7df6-4330-9736-076213c470c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:11.248036 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a674ef-7df6-4330-9736-076213c470c3 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-98a674ef-7df6-4330-9736-076213c470c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:16:11.262134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:11.263325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:16:11.264328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:16:11.264328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:11.264328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:16:11.264328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 633/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:11.269653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afde1a5-e6ac-4ea1-b60e-432639db549c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:11.354682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:11.379390 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afde1a5-e6ac-4ea1-b60e-432639db549c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:11.423584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11824654-48a6-429e-970a-cf46c8f70680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:11.424282 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824654-48a6-429e-970a-cf46c8f70680 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:11.424551 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824654-48a6-429e-970a-cf46c8f70680 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:11.424819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824654-48a6-429e-970a-cf46c8f70680 None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:11.425457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11824654-48a6-429e-970a-cf46c8f70680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:11.425755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11824654-48a6-429e-970a-cf46c8f70680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:11.427162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11824654-48a6-429e-970a-cf46c8f70680 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:11.441230 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 633/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:11.449733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a674ef-7df6-4330-9736-076213c470c3 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:11.569019 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a674ef-7df6-4330-9736-076213c470c3 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:11.590405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:11.609635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f1166-50e7-48c3-a12d-c3dd0b48b7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:11.610236 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1166-50e7-48c3-a12d-c3dd0b48b7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:11.610541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1166-50e7-48c3-a12d-c3dd0b48b7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:11.610884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1166-50e7-48c3-a12d-c3dd0b48b7e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:11.625205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f1166-50e7-48c3-a12d-c3dd0b48b7e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:11.627466 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f1166-50e7-48c3-a12d-c3dd0b48b7e5 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-416f1166-50e7-48c3-a12d-c3dd0b48b7e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:16:11.639056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:11.640251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:11.641410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:11.641410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:11.641410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:16:11.641410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:16:11.641410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:16:11.641410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:16:11.641410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:16:11.641410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:16:11.641410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:16:11.641410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:16:11.641410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 634/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:16:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:11.646159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11824654-48a6-429e-970a-cf46c8f70680 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:11.751482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11824654-48a6-429e-970a-cf46c8f70680 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:11.789880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97131d38-26e5-427b-938a-e8000b216283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:11.790485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97131d38-26e5-427b-938a-e8000b216283 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:11.790763 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97131d38-26e5-427b-938a-e8000b216283 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:11.791046 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97131d38-26e5-427b-938a-e8000b216283 None admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:11.791783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97131d38-26e5-427b-938a-e8000b216283 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:11.792073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97131d38-26e5-427b-938a-e8000b216283 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:11.793523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97131d38-26e5-427b-938a-e8000b216283 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:11.803144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:11.811919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 634/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Aug 9 11:16:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:11.817817 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f1166-50e7-48c3-a12d-c3dd0b48b7e5 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:11.923553 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f1166-50e7-48c3-a12d-c3dd0b48b7e5 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:11.957466 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727a42a-9a30-4d96-9821-8e68e8d27513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:11.958079 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727a42a-9a30-4d96-9821-8e68e8d27513 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:11.958346 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727a42a-9a30-4d96-9821-8e68e8d27513 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:11.958604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727a42a-9a30-4d96-9821-8e68e8d27513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:11.969359 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727a42a-9a30-4d96-9821-8e68e8d27513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:11.970935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727a42a-9a30-4d96-9821-8e68e8d27513 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-9727a42a-9a30-4d96-9821-8e68e8d27513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:16:11.984697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:11.985904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:16:11.987114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:16:11.987114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:11.987114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:16:11.987114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 635/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:11.991866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97131d38-26e5-427b-938a-e8000b216283 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:12.109557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97131d38-26e5-427b-938a-e8000b216283 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:12.145164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d394a1-2fa6-468a-8cfd-be18735e52cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:12.145766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d394a1-2fa6-468a-8cfd-be18735e52cc None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:12.146039 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d394a1-2fa6-468a-8cfd-be18735e52cc None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:12.146308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d394a1-2fa6-468a-8cfd-be18735e52cc None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:12.146976 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d394a1-2fa6-468a-8cfd-be18735e52cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:12.147268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d394a1-2fa6-468a-8cfd-be18735e52cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:12.148648 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d394a1-2fa6-468a-8cfd-be18735e52cc None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:12.161315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 635/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:12.170413 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727a42a-9a30-4d96-9821-8e68e8d27513 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:12.209882 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:12.285120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727a42a-9a30-4d96-9821-8e68e8d27513 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:12.319919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4b54d-44c6-48c7-a57b-dd8f3f0c5bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:12.320541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4b54d-44c6-48c7-a57b-dd8f3f0c5bcf None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:12.320811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4b54d-44c6-48c7-a57b-dd8f3f0c5bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:12.321073 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4b54d-44c6-48c7-a57b-dd8f3f0c5bcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:12.327951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4b54d-44c6-48c7-a57b-dd8f3f0c5bcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:12.329400 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4b54d-44c6-48c7-a57b-dd8f3f0c5bcf None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-34b4b54d-44c6-48c7-a57b-dd8f3f0c5bcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:16:12.340672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:12.341735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:12.342652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:16:12.342652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:16:12.342652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:16:12.342652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:16:12.342652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:16:12.342652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:16:12.342652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:16:12.342652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:16:12.342652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 636/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:16:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:12.348211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d394a1-2fa6-468a-8cfd-be18735e52cc None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:12.411372 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:12.454516 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d394a1-2fa6-468a-8cfd-be18735e52cc None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:12.505272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7da599-b4d7-4afc-a6bc-3a2f88aecbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:12.505798 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7da599-b4d7-4afc-a6bc-3a2f88aecbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:12.506068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7da599-b4d7-4afc-a6bc-3a2f88aecbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:12.506328 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7da599-b4d7-4afc-a6bc-3a2f88aecbb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:12.507057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7da599-b4d7-4afc-a6bc-3a2f88aecbb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:12.507357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7da599-b4d7-4afc-a6bc-3a2f88aecbb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:12.508902 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7da599-b4d7-4afc-a6bc-3a2f88aecbb6 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:12.523543 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 636/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:16:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:12.529859 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4b54d-44c6-48c7-a57b-dd8f3f0c5bcf None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:12.632648 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:12.641794 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4b54d-44c6-48c7-a57b-dd8f3f0c5bcf None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:12.675916 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24235-7b71-441d-b74e-594c2217f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:12.676557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24235-7b71-441d-b74e-594c2217f329 None admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:12.676823 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24235-7b71-441d-b74e-594c2217f329 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:12.677089 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24235-7b71-441d-b74e-594c2217f329 None admin] PATH_INFO: `/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/a04b584a68cb488492046faa23e15463/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:12.679237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24235-7b71-441d-b74e-594c2217f329 None admin] RBAC: Authorizing `identity:create_grant(project_id=f53fb3d6b68b4654ae7247c9b74015e7, user_id=a04b584a68cb488492046faa23e15463, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:12.680672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24235-7b71-441d-b74e-594c2217f329 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:12.695676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 637/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Aug 9 11:16:12 2022] PUT /identity/v3/projects/f53fb3d6b68b4654ae7247c9b74015e7/users/a04b584a68cb488492046faa23e15463/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:16:14.639360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eb31c-8194-499a-bc0c-3b085b4503e2 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:14.640243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eb31c-8194-499a-bc0c-3b085b4503e2 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:14.640243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eb31c-8194-499a-bc0c-3b085b4503e2 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:14.642304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 637/1274] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:16:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:16:14.650157 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900e66e-043a-442b-b882-78e1f640a267 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:14.650595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900e66e-043a-442b-b882-78e1f640a267 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:14.650712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900e66e-043a-442b-b882-78e1f640a267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:14.670432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-2900e66e-043a-442b-b882-78e1f640a267 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:16:14.671547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-2900e66e-043a-442b-b882-78e1f640a267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:16:14.740222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 638/1275] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:16:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:16:14.768184 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57eb31c-8194-499a-bc0c-3b085b4503e2 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:14.880043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57eb31c-8194-499a-bc0c-3b085b4503e2 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:14.897313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:14.915470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77931c48-b8f2-4162-9623-6a962c24ce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:14.916094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77931c48-b8f2-4162-9623-6a962c24ce1c None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:14.916368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77931c48-b8f2-4162-9623-6a962c24ce1c None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:14.916634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77931c48-b8f2-4162-9623-6a962c24ce1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:14.926879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77931c48-b8f2-4162-9623-6a962c24ce1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-77931c48-b8f2-4162-9623-6a962c24ce1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:16:14.931522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:14.932701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:14.933741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:14.933741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:14.933741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:14.933741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:14.933741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:16:14.933741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:16:14.933741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:16:14.933741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:16:14.933741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:16:14.933741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:16:14.933741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:16:14.933741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:14.933741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 638/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Aug 9 11:16:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:14.939663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900e66e-043a-442b-b882-78e1f640a267 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:15.026462 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:15.053502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900e66e-043a-442b-b882-78e1f640a267 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:15.097878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f458aa-3be1-4a5d-8abf-1c0586669d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:15.098484 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f458aa-3be1-4a5d-8abf-1c0586669d3e None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:15.098753 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f458aa-3be1-4a5d-8abf-1c0586669d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:15.099045 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f458aa-3be1-4a5d-8abf-1c0586669d3e None admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:15.099701 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f458aa-3be1-4a5d-8abf-1c0586669d3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:15.099997 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f458aa-3be1-4a5d-8abf-1c0586669d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:15.101377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f458aa-3be1-4a5d-8abf-1c0586669d3e None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:15.109691 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 639/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Aug 9 11:16:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:15.116238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77931c48-b8f2-4162-9623-6a962c24ce1c None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:15.224040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77931c48-b8f2-4162-9623-6a962c24ce1c None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:15.259871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4623d-fcb4-4ce6-a7be-3a6fff797298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:15.260491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4623d-fcb4-4ce6-a7be-3a6fff797298 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:15.260764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4623d-fcb4-4ce6-a7be-3a6fff797298 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:15.261032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4623d-fcb4-4ce6-a7be-3a6fff797298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:15.271366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4623d-fcb4-4ce6-a7be-3a6fff797298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:15.272808 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4623d-fcb4-4ce6-a7be-3a6fff797298 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-9ca4623d-fcb4-4ce6-a7be-3a6fff797298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:16:15.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:15.288994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:16:15.289921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:16:15.289921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:15.289921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:15.289921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 639/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:15.295069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f458aa-3be1-4a5d-8abf-1c0586669d3e None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:15.412355 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f458aa-3be1-4a5d-8abf-1c0586669d3e None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:15.446796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6cf0-6a67-4f1c-bcda-9d433e3cf509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:15.447418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6cf0-6a67-4f1c-bcda-9d433e3cf509 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:15.447689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6cf0-6a67-4f1c-bcda-9d433e3cf509 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:15.447949 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6cf0-6a67-4f1c-bcda-9d433e3cf509 None admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:15.448581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f6cf0-6a67-4f1c-bcda-9d433e3cf509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:15.448880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f6cf0-6a67-4f1c-bcda-9d433e3cf509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:15.450249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f6cf0-6a67-4f1c-bcda-9d433e3cf509 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:15.461753 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 640/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:15.468414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4623d-fcb4-4ce6-a7be-3a6fff797298 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:15.515787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:15.591366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4623d-fcb4-4ce6-a7be-3a6fff797298 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:15.629056 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502104c7-ed21-4986-8c72-bf75b86c2bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:15.629674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502104c7-ed21-4986-8c72-bf75b86c2bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:15.629946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502104c7-ed21-4986-8c72-bf75b86c2bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:15.630212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502104c7-ed21-4986-8c72-bf75b86c2bb2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:15.638200 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502104c7-ed21-4986-8c72-bf75b86c2bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:15.639690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502104c7-ed21-4986-8c72-bf75b86c2bb2 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-502104c7-ed21-4986-8c72-bf75b86c2bb2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:16:15.651101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:15.652470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:15.653574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:15.653574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:15.653574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:16:15.653574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:16:15.653574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:16:15.653574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:16:15.653574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:16:15.653574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:16:15.653574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:16:15.653574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:15.653574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 640/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:16:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:15.658843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6cf0-6a67-4f1c-bcda-9d433e3cf509 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:15.665197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:15.767747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6cf0-6a67-4f1c-bcda-9d433e3cf509 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:15.803790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cb65e-4842-4a4e-9d88-ad5c4694b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:15.804397 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb65e-4842-4a4e-9d88-ad5c4694b700 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:15.804671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb65e-4842-4a4e-9d88-ad5c4694b700 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:15.804934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb65e-4842-4a4e-9d88-ad5c4694b700 None admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:15.805667 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cb65e-4842-4a4e-9d88-ad5c4694b700 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:15.805964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cb65e-4842-4a4e-9d88-ad5c4694b700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:15.807436 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cb65e-4842-4a4e-9d88-ad5c4694b700 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:15.825049 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 641/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Aug 9 11:16:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:15.831079 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502104c7-ed21-4986-8c72-bf75b86c2bb2 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:15.925977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:15.937257 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502104c7-ed21-4986-8c72-bf75b86c2bb2 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:15.972370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd038c1-4ec5-4ae4-ac53-7e34a13346f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:15.972968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd038c1-4ec5-4ae4-ac53-7e34a13346f8 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:15.973241 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd038c1-4ec5-4ae4-ac53-7e34a13346f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:15.973516 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd038c1-4ec5-4ae4-ac53-7e34a13346f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:16.048005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd038c1-4ec5-4ae4-ac53-7e34a13346f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:16.050096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd038c1-4ec5-4ae4-ac53-7e34a13346f8 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:16.164924 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:16.177864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 641/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Aug 9 11:16:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:16:16.183974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cb65e-4842-4a4e-9d88-ad5c4694b700 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:16.259767 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:16.302877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cb65e-4842-4a4e-9d88-ad5c4694b700 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:16.338857 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851130c-925f-4dd2-9c08-98fecbc3373d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:16.339495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851130c-925f-4dd2-9c08-98fecbc3373d None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:16.339766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851130c-925f-4dd2-9c08-98fecbc3373d None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:16.340029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851130c-925f-4dd2-9c08-98fecbc3373d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:16.350876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851130c-925f-4dd2-9c08-98fecbc3373d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:16.352369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851130c-925f-4dd2-9c08-98fecbc3373d None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-4851130c-925f-4dd2-9c08-98fecbc3373d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:16:16.368877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:16.370225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:16:16.372175 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:16:16.372175 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:16:16.372175 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:16:16.372175 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 642/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:16.379628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd038c1-4ec5-4ae4-ac53-7e34a13346f8 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:16.497136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd038c1-4ec5-4ae4-ac53-7e34a13346f8 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:16.534113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b72034-911e-48d2-8b0d-7e6a31b4f42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:16.534709 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b72034-911e-48d2-8b0d-7e6a31b4f42f None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:16.535009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b72034-911e-48d2-8b0d-7e6a31b4f42f None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:16.535274 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b72034-911e-48d2-8b0d-7e6a31b4f42f None admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:16.535909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b72034-911e-48d2-8b0d-7e6a31b4f42f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:16.536208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b72034-911e-48d2-8b0d-7e6a31b4f42f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:16.537566 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b72034-911e-48d2-8b0d-7e6a31b4f42f None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:16.550493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 642/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Aug 9 11:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:16.557300 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851130c-925f-4dd2-9c08-98fecbc3373d None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:16.669908 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851130c-925f-4dd2-9c08-98fecbc3373d None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:16.684041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:16.708050 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29555086-0495-49d7-bc71-4d65e97e276b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:16.708684 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29555086-0495-49d7-bc71-4d65e97e276b None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:16.708959 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29555086-0495-49d7-bc71-4d65e97e276b None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:16.709228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29555086-0495-49d7-bc71-4d65e97e276b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:16.716600 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29555086-0495-49d7-bc71-4d65e97e276b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:16.718059 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29555086-0495-49d7-bc71-4d65e97e276b None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application [None req-29555086-0495-49d7-bc71-4d65e97e276b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:16:16.730489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:16.731638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:16.732774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:16:16.732774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:16:16.732774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:16:16.732774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:16:16.732774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:16:16.732774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:16:16.732774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:16:16.732774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: ERROR keystone.server.flask.application Aug 09 11:16:16.732774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 643/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Aug 9 11:16:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:16.737851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b72034-911e-48d2-8b0d-7e6a31b4f42f None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:16.790674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:16.851680 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b72034-911e-48d2-8b0d-7e6a31b4f42f None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:16.897335 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660d89f-0dde-42c0-b2e2-450dbbcc4138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:16.897967 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660d89f-0dde-42c0-b2e2-450dbbcc4138 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:16.898211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660d89f-0dde-42c0-b2e2-450dbbcc4138 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:16.898506 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660d89f-0dde-42c0-b2e2-450dbbcc4138 None admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:16.899384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660d89f-0dde-42c0-b2e2-450dbbcc4138 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:16.900577 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660d89f-0dde-42c0-b2e2-450dbbcc4138 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:16.901914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660d89f-0dde-42c0-b2e2-450dbbcc4138 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:16.916024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 643/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Aug 9 11:16:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:16:16.925807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29555086-0495-49d7-bc71-4d65e97e276b None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:17.035623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29555086-0495-49d7-bc71-4d65e97e276b None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:17.083337 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2be0a-2395-436a-8ffd-ed455cfe4d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:17.083942 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2be0a-2395-436a-8ffd-ed455cfe4d98 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:17.084410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2be0a-2395-436a-8ffd-ed455cfe4d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:17.084538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2be0a-2395-436a-8ffd-ed455cfe4d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:17.085207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2be0a-2395-436a-8ffd-ed455cfe4d98 None admin] RBAC: Adding query filter params (role.id=169d11e171d04c87af71475295957618, scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7, user.id=a04b584a68cb488492046faa23e15463) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:17.085507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2be0a-2395-436a-8ffd-ed455cfe4d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:17.086989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2be0a-2395-436a-8ffd-ed455cfe4d98 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:17.093424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 644/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Aug 9 11:16:16 2022] GET /identity/v3/role_assignments?user.id=a04b584a68cb488492046faa23e15463&scope.project.id=f53fb3d6b68b4654ae7247c9b74015e7&role.id=169d11e171d04c87af71475295957618 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:19.118429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c87d7-9ac1-4a7b-82c8-dc15edba9abb None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:19.119346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c87d7-9ac1-4a7b-82c8-dc15edba9abb None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:19.119346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c87d7-9ac1-4a7b-82c8-dc15edba9abb None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:19.121433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 644/1288] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:16:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:16:19.129013 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e5659-b36c-4045-bbf7-e4f6aecea106 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:19.129440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e5659-b36c-4045-bbf7-e4f6aecea106 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:19.129547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e5659-b36c-4045-bbf7-e4f6aecea106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:19.148986 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-269e5659-b36c-4045-bbf7-e4f6aecea106 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:16:19.150168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-269e5659-b36c-4045-bbf7-e4f6aecea106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:16:19.180549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:19.219682 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 645/1289] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:16:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:16:19.243991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c87d7-9ac1-4a7b-82c8-dc15edba9abb None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:19.352985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c87d7-9ac1-4a7b-82c8-dc15edba9abb None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:19.363717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:19.389376 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e87095-3839-499a-9087-c26c2d65b8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:19.389925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87095-3839-499a-9087-c26c2d65b8fa None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:19.390201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87095-3839-499a-9087-c26c2d65b8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:19.390473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87095-3839-499a-9087-c26c2d65b8fa None admin] PATH_INFO: `/v3/services/placement` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:19.391078 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e87095-3839-499a-9087-c26c2d65b8fa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:19.392519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e87095-3839-499a-9087-c26c2d65b8fa None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-e1e87095-3839-499a-9087-c26c2d65b8fa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:19.401311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:19.402360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:19.403357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 645/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Aug 9 11:16:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:19.408781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e5659-b36c-4045-bbf7-e4f6aecea106 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:19.521017 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e5659-b36c-4045-bbf7-e4f6aecea106 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:19.557556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b8ba2-8f9f-44b5-b857-20c74fcce0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:19.558159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b8ba2-8f9f-44b5-b857-20c74fcce0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:19.558425 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b8ba2-8f9f-44b5-b857-20c74fcce0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:19.558693 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b8ba2-8f9f-44b5-b857-20c74fcce0e4 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:19.559344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b8ba2-8f9f-44b5-b857-20c74fcce0e4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:19.559646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b8ba2-8f9f-44b5-b857-20c74fcce0e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:19.561026 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b8ba2-8f9f-44b5-b857-20c74fcce0e4 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:19.565956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 646/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Tue Aug 9 11:16:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:19.572060 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e87095-3839-499a-9087-c26c2d65b8fa None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:19.675276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e87095-3839-499a-9087-c26c2d65b8fa None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:19.712528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c57be1-cbaa-4222-8650-60a341400e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:19.713121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c57be1-cbaa-4222-8650-60a341400e90 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:19.713390 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c57be1-cbaa-4222-8650-60a341400e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:19.713650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c57be1-cbaa-4222-8650-60a341400e90 None admin] PATH_INFO: `/v3/services` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:19.714263 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c57be1-cbaa-4222-8650-60a341400e90 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:19.714555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c57be1-cbaa-4222-8650-60a341400e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:19.715950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c57be1-cbaa-4222-8650-60a341400e90 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:19.720556 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 646/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Tue Aug 9 11:16:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:21.709962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53b92-cc6a-466f-bab5-f8239cca3657 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:21.710494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53b92-cc6a-466f-bab5-f8239cca3657 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:21.710494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53b92-cc6a-466f-bab5-f8239cca3657 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:21.711755 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 647/1293] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:16:21.717926 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f17a6a-c55f-4f2a-bdff-91b29d83bfde None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:21.718653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f17a6a-c55f-4f2a-bdff-91b29d83bfde None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:21.718836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f17a6a-c55f-4f2a-bdff-91b29d83bfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:21.744674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-69f17a6a-c55f-4f2a-bdff-91b29d83bfde None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:16:21.745891 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-69f17a6a-c55f-4f2a-bdff-91b29d83bfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:16:21.778148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:21.817870 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 647/1294] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:16:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:16:21.840224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a53b92-cc6a-466f-bab5-f8239cca3657 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:21.872286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:21.945019 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a53b92-cc6a-466f-bab5-f8239cca3657 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:21.982704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b95b45-d70e-4bb2-951e-56c7a67d24a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:21.983263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b95b45-d70e-4bb2-951e-56c7a67d24a2 None admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:21.983532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b95b45-d70e-4bb2-951e-56c7a67d24a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:21.983794 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b95b45-d70e-4bb2-951e-56c7a67d24a2 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:21.984427 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b95b45-d70e-4bb2-951e-56c7a67d24a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:21.985793 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b95b45-d70e-4bb2-951e-56c7a67d24a2 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:22.003259 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 648/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Aug 9 11:16:21 2022] POST /identity/v3/services => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:16:24.035913 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc413a9c-c293-47df-8a99-322de2df0cb6 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:24.035913 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc413a9c-c293-47df-8a99-322de2df0cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:24.036982 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc413a9c-c293-47df-8a99-322de2df0cb6 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:24.038305 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 648/1296] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:16:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:16:24.045110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09e90a-c165-411b-acd1-f678a11cb38d None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:24.045747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09e90a-c165-411b-acd1-f678a11cb38d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:24.045901 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09e90a-c165-411b-acd1-f678a11cb38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:24.066443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-5e09e90a-c165-411b-acd1-f678a11cb38d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:16:24.067759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5e09e90a-c165-411b-acd1-f678a11cb38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:16:24.153860 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 649/1297] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:16:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:16:24.177951 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc413a9c-c293-47df-8a99-322de2df0cb6 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:24.292147 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc413a9c-c293-47df-8a99-322de2df0cb6 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:24.328748 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac32ad-c850-47b8-b3e0-5320b3815975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:24.329382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac32ad-c850-47b8-b3e0-5320b3815975 None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:24.329658 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac32ad-c850-47b8-b3e0-5320b3815975 None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:24.329911 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac32ad-c850-47b8-b3e0-5320b3815975 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:24.330602 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac32ad-c850-47b8-b3e0-5320b3815975 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:24.332101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac32ad-c850-47b8-b3e0-5320b3815975 None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-31ac32ad-c850-47b8-b3e0-5320b3815975 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:24.342133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:24.343424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:24.344932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 649/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Aug 9 11:16:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:24.351926 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09e90a-c165-411b-acd1-f678a11cb38d None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:24.371659 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:24.454047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09e90a-c165-411b-acd1-f678a11cb38d None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:24.490833 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec9c9c-9cfe-4600-8f07-572dee204cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:24.491455 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec9c9c-9cfe-4600-8f07-572dee204cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:24.492046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec9c9c-9cfe-4600-8f07-572dee204cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:24.492312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec9c9c-9cfe-4600-8f07-572dee204cb8 None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:24.492949 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec9c9c-9cfe-4600-8f07-572dee204cb8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:24.493244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec9c9c-9cfe-4600-8f07-572dee204cb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:24.494639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec9c9c-9cfe-4600-8f07-572dee204cb8 None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:24.500038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 650/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Tue Aug 9 11:16:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:24.506481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac32ad-c850-47b8-b3e0-5320b3815975 None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:24.540018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:24.613350 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac32ad-c850-47b8-b3e0-5320b3815975 None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:24.650396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90096852-8f01-4405-ba5d-93c5d783eabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:24.651019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90096852-8f01-4405-ba5d-93c5d783eabe None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:24.651293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90096852-8f01-4405-ba5d-93c5d783eabe None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:24.651559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90096852-8f01-4405-ba5d-93c5d783eabe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:24.652254 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90096852-8f01-4405-ba5d-93c5d783eabe None admin] RBAC: Adding query filter params (interface=public, service_id=22d5f753068544a08084057bfd6ea854, region_id=RegionOne) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:24.652563 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90096852-8f01-4405-ba5d-93c5d783eabe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:24.653932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90096852-8f01-4405-ba5d-93c5d783eabe None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:24.659609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 650/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Aug 9 11:16:24 2022] GET /identity/v3/endpoints?service_id=22d5f753068544a08084057bfd6ea854&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:24.668162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec9c9c-9cfe-4600-8f07-572dee204cb8 None admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:24.754361 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:24.779022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec9c9c-9cfe-4600-8f07-572dee204cb8 None admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:24.815728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe45ae7-19c8-4553-9a96-12fbf91fdccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:24.816329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe45ae7-19c8-4553-9a96-12fbf91fdccc None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:24.816608 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe45ae7-19c8-4553-9a96-12fbf91fdccc None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:24.816876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe45ae7-19c8-4553-9a96-12fbf91fdccc None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:24.817457 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe45ae7-19c8-4553-9a96-12fbf91fdccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:24.818893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe45ae7-19c8-4553-9a96-12fbf91fdccc None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:24.825629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 651/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Aug 9 11:16:24 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:16:26.807370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d90a-354c-4261-ad4f-4fedb5cfc973 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:26.808191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d90a-354c-4261-ad4f-4fedb5cfc973 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:26.808191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d90a-354c-4261-ad4f-4fedb5cfc973 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:26.810053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 651/1302] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:16:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:16:26.815767 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a75a9-5c86-4e60-ac9b-e454e7ef2458 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:26.816226 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a75a9-5c86-4e60-ac9b-e454e7ef2458 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:26.816323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a75a9-5c86-4e60-ac9b-e454e7ef2458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:26.835639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b72a75a9-5c86-4e60-ac9b-e454e7ef2458 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:16:26.836822 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b72a75a9-5c86-4e60-ac9b-e454e7ef2458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:16:26.907387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 652/1303] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:16:26 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:16:26.935974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911d90a-354c-4261-ad4f-4fedb5cfc973 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:27.040152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:27.048747 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911d90a-354c-4261-ad4f-4fedb5cfc973 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:27.088211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a2ff7-a0ec-4ff3-8158-a6eff7614eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:27.088757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a2ff7-a0ec-4ff3-8158-a6eff7614eee None admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:27.089035 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a2ff7-a0ec-4ff3-8158-a6eff7614eee None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:27.089304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a2ff7-a0ec-4ff3-8158-a6eff7614eee None admin] PATH_INFO: `/v3/services/placement` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:27.089882 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a2ff7-a0ec-4ff3-8158-a6eff7614eee None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:27.104241 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a2ff7-a0ec-4ff3-8158-a6eff7614eee None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application [None req-c93a2ff7-a0ec-4ff3-8158-a6eff7614eee None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:16:27.114081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:16:27.115269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application with Lock( Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: ERROR keystone.server.flask.application Aug 09 11:16:27.116239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 652/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Aug 9 11:16:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:16:27.121847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a75a9-5c86-4e60-ac9b-e454e7ef2458 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:27.200376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:27.226322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a75a9-5c86-4e60-ac9b-e454e7ef2458 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:27.262884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f4fbf-04a7-4484-910c-3027a8efa26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:27.263488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f4fbf-04a7-4484-910c-3027a8efa26a None admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:27.263758 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f4fbf-04a7-4484-910c-3027a8efa26a None admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:27.264025 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f4fbf-04a7-4484-910c-3027a8efa26a None admin] PATH_INFO: `/v3/services` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:27.264654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f4fbf-04a7-4484-910c-3027a8efa26a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:16:27.264950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f4fbf-04a7-4484-910c-3027a8efa26a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:27.266342 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f4fbf-04a7-4484-910c-3027a8efa26a None admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:27.271555 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 653/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Tue Aug 9 11:16:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:27.277613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a2ff7-a0ec-4ff3-8158-a6eff7614eee None admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:27.384262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a2ff7-a0ec-4ff3-8158-a6eff7614eee None admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:27.432170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730bfa9-7ab9-4c54-bc9a-cd79e11909fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:27.432779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730bfa9-7ab9-4c54-bc9a-cd79e11909fa None admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:27.433050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730bfa9-7ab9-4c54-bc9a-cd79e11909fa None admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:27.433320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730bfa9-7ab9-4c54-bc9a-cd79e11909fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:27.433980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730bfa9-7ab9-4c54-bc9a-cd79e11909fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:27.435402 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730bfa9-7ab9-4c54-bc9a-cd79e11909fa None admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:27.459661 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 653/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:16:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:16:37.268553 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=30 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:37.453726 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:31.098284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744fdf2-1245-49c4-8d33-95159801c836 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:31.098915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744fdf2-1245-49c4-8d33-95159801c836 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:31.098915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744fdf2-1245-49c4-8d33-95159801c836 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:31.103996 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 654/1307] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:31.105836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb24c3-6e0d-41a4-99c5-375b3d8e1c39 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:31.106716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb24c3-6e0d-41a4-99c5-375b3d8e1c39 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:31.107360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb24c3-6e0d-41a4-99c5-375b3d8e1c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:31.312515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-76eb24c3-6e0d-41a4-99c5-375b3d8e1c39 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:31.314510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-76eb24c3-6e0d-41a4-99c5-375b3d8e1c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:31.470502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 654/1308] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:17:31.523750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6a47d-18df-4cd2-bb92-ade8a3b1eaff None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:31.524184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6a47d-18df-4cd2-bb92-ade8a3b1eaff None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:31.524553 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6a47d-18df-4cd2-bb92-ade8a3b1eaff None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:31.526362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 655/1309] 10.222.0.59 () {54 vars in 965 bytes} [Tue Aug 9 11:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:31.532107 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5fba0-408c-4f59-ac28-4cd208fe0c87 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:31.532394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5fba0-408c-4f59-ac28-4cd208fe0c87 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:31.532872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5fba0-408c-4f59-ac28-4cd208fe0c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:31.615027 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-42c5fba0-408c-4f59-ac28-4cd208fe0c87 None None] MFA Rules not processed for user `54cdc076295642bf945fe63a972b8aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:31.616260 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-42c5fba0-408c-4f59-ac28-4cd208fe0c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:31.638594 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:31.707328 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 655/1310] 10.222.0.59 () {58 vars in 1062 bytes} [Tue Aug 9 11:17:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:17:31.713102 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6a47d-18df-4cd2-bb92-ade8a3b1eaff None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:31.715051 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-3fb6a47d-18df-4cd2-bb92-ade8a3b1eaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:31.855158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6a47d-18df-4cd2-bb92-ade8a3b1eaff None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:31.937785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca681a-6408-4166-be0e-342a23e8155b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:31.938566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca681a-6408-4166-be0e-342a23e8155b service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:31.938963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca681a-6408-4166-be0e-342a23e8155b service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:31.939344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca681a-6408-4166-be0e-342a23e8155b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:31.941043 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5aca681a-6408-4166-be0e-342a23e8155b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:31.999483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:32.058014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca681a-6408-4166-be0e-342a23e8155b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:32.059628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca681a-6408-4166-be0e-342a23e8155b service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:32.081202 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 656/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:34.411710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef827cb-c0c5-43ec-8015-1b4d864c7142 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:34.412183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef827cb-c0c5-43ec-8015-1b4d864c7142 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:34.412267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef827cb-c0c5-43ec-8015-1b4d864c7142 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:34.413748 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 656/1312] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:34.418956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00963d50-7211-4c64-9635-b27960253894 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:34.419581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00963d50-7211-4c64-9635-b27960253894 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:34.419581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00963d50-7211-4c64-9635-b27960253894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:34.501791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-00963d50-7211-4c64-9635-b27960253894 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:34.503084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-00963d50-7211-4c64-9635-b27960253894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:34.600475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 657/1313] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:17:34.638444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef827cb-c0c5-43ec-8015-1b4d864c7142 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:34.640069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9ef827cb-c0c5-43ec-8015-1b4d864c7142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:34.751839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef827cb-c0c5-43ec-8015-1b4d864c7142 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:34.826172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:34.828980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ccae5-10cb-444a-88c4-70ecb98b1f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:34.829601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccae5-10cb-444a-88c4-70ecb98b1f0e service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:34.829891 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccae5-10cb-444a-88c4-70ecb98b1f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:34.830154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccae5-10cb-444a-88c4-70ecb98b1f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:34.832242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c08ccae5-10cb-444a-88c4-70ecb98b1f0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:34.947104 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ccae5-10cb-444a-88c4-70ecb98b1f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:34.948567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ccae5-10cb-444a-88c4-70ecb98b1f0e service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:34.968601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 657/1314] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:37.250808 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ea1f5-e29f-4374-9b52-7d898723676e None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:37.251414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ea1f5-e29f-4374-9b52-7d898723676e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:37.251540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ea1f5-e29f-4374-9b52-7d898723676e None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:37.252899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 658/1315] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:37.259234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bb5f3-0178-4bcb-b27f-2a618a368a19 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:37.259935 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bb5f3-0178-4bcb-b27f-2a618a368a19 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:37.260081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bb5f3-0178-4bcb-b27f-2a618a368a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:37.332274 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-624bb5f3-0178-4bcb-b27f-2a618a368a19 None None] MFA Rules not processed for user `6c00a943c52a48299d08f42c54466487`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:37.333492 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-624bb5f3-0178-4bcb-b27f-2a618a368a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:37.387849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:37.434358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 658/1316] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:17:37.500315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6bb7f-2284-486b-b6cb-6df45ca55314 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:37.500577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6bb7f-2284-486b-b6cb-6df45ca55314 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:37.500974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6bb7f-2284-486b-b6cb-6df45ca55314 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:37.502224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 659/1317] 10.222.0.59 () {54 vars in 965 bytes} [Tue Aug 9 11:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:37.508221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4814f1-a30c-4e4e-844e-0b67650ab848 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:37.508505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4814f1-a30c-4e4e-844e-0b67650ab848 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:37.508778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4814f1-a30c-4e4e-844e-0b67650ab848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:37.592784 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-2f4814f1-a30c-4e4e-844e-0b67650ab848 None None] MFA Rules not processed for user `54cdc076295642bf945fe63a972b8aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:37.594101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2f4814f1-a30c-4e4e-844e-0b67650ab848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:37.672842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 659/1318] 10.222.0.59 () {58 vars in 1062 bytes} [Tue Aug 9 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:17:37.682242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6bb7f-2284-486b-b6cb-6df45ca55314 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:37.683828 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0fd6bb7f-2284-486b-b6cb-6df45ca55314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:37.694479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:37.798260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6bb7f-2284-486b-b6cb-6df45ca55314 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:37.879238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7388b7-2fad-486e-bafc-9868ee17162f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:37.879891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7388b7-2fad-486e-bafc-9868ee17162f service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:37.880163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7388b7-2fad-486e-bafc-9868ee17162f service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:37.880428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7388b7-2fad-486e-bafc-9868ee17162f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:37.882041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-bf7388b7-2fad-486e-bafc-9868ee17162f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:37.949754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:38.003552 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7388b7-2fad-486e-bafc-9868ee17162f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:38.005000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7388b7-2fad-486e-bafc-9868ee17162f service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:38.025663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 660/1319] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:37 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:40.987923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4474050-9339-4ad6-bcf0-aeecf441716e None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:40.988838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4474050-9339-4ad6-bcf0-aeecf441716e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:40.988838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4474050-9339-4ad6-bcf0-aeecf441716e None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:40.991066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 660/1320] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:17:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:40.997581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69561334-251c-4100-89d2-3ad9ad0b4e30 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:40.998311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69561334-251c-4100-89d2-3ad9ad0b4e30 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:40.998452 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69561334-251c-4100-89d2-3ad9ad0b4e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:41.081573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-69561334-251c-4100-89d2-3ad9ad0b4e30 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:41.082797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-69561334-251c-4100-89d2-3ad9ad0b4e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:41.188374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 661/1321] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:17:41.231241 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4474050-9339-4ad6-bcf0-aeecf441716e None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:41.233669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f4474050-9339-4ad6-bcf0-aeecf441716e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:41.302438 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:41.358940 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4474050-9339-4ad6-bcf0-aeecf441716e None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:41.446001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e91ee-1296-465f-975a-85d742238cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:41.446620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e91ee-1296-465f-975a-85d742238cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:41.446932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e91ee-1296-465f-975a-85d742238cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:41.447204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e91ee-1296-465f-975a-85d742238cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:41.448815 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-659e91ee-1296-465f-975a-85d742238cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:41.557525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:41.572240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e91ee-1296-465f-975a-85d742238cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:41.573708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e91ee-1296-465f-975a-85d742238cf6 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:41.593881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 661/1322] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:44.295943 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606265-80df-44bb-88da-356efc8b1d29 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:44.296633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606265-80df-44bb-88da-356efc8b1d29 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:44.296633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606265-80df-44bb-88da-356efc8b1d29 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:44.297788 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 662/1323] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:44.303004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08d0f9-3610-4e4f-a6e7-b893d555648d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:44.303480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08d0f9-3610-4e4f-a6e7-b893d555648d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:44.303624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08d0f9-3610-4e4f-a6e7-b893d555648d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:44.371231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-3a08d0f9-3610-4e4f-a6e7-b893d555648d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:44.372425 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-3a08d0f9-3610-4e4f-a6e7-b893d555648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:44.487973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 662/1324] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:17:44.526147 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28606265-80df-44bb-88da-356efc8b1d29 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:44.527751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-28606265-80df-44bb-88da-356efc8b1d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:44.549092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:44.641510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28606265-80df-44bb-88da-356efc8b1d29 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:44.719500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e0172-365d-4a87-ae7b-8fce0b3100f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:44.720116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e0172-365d-4a87-ae7b-8fce0b3100f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:44.720389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e0172-365d-4a87-ae7b-8fce0b3100f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:44.720662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e0172-365d-4a87-ae7b-8fce0b3100f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:44.722263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ad7e0172-365d-4a87-ae7b-8fce0b3100f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:44.800006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:44.841368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e0172-365d-4a87-ae7b-8fce0b3100f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:44.842970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e0172-365d-4a87-ae7b-8fce0b3100f9 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:44.862443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 663/1325] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:46.884891 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f613bf6-ed19-4d20-a249-ae59dc32c6c1 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:46.885454 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f613bf6-ed19-4d20-a249-ae59dc32c6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:46.885454 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f613bf6-ed19-4d20-a249-ae59dc32c6c1 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:46.886754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 663/1326] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:46.892144 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7cd2-3adc-4e48-973f-f465ca7ad644 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:46.892603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7cd2-3adc-4e48-973f-f465ca7ad644 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:46.892696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7cd2-3adc-4e48-973f-f465ca7ad644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:46.961792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-786a7cd2-3adc-4e48-973f-f465ca7ad644 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:46.962960 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-786a7cd2-3adc-4e48-973f-f465ca7ad644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:47.068468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 664/1327] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:17:47.104594 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f613bf6-ed19-4d20-a249-ae59dc32c6c1 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:47.106201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6f613bf6-ed19-4d20-a249-ae59dc32c6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:47.170003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:47.217358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f613bf6-ed19-4d20-a249-ae59dc32c6c1 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:47.294039 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e94b88-a022-4745-bab2-337ae286990a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:47.294651 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e94b88-a022-4745-bab2-337ae286990a service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:47.294948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e94b88-a022-4745-bab2-337ae286990a service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:47.295212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e94b88-a022-4745-bab2-337ae286990a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:47.296868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-23e94b88-a022-4745-bab2-337ae286990a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:47.411621 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:47.414386 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e94b88-a022-4745-bab2-337ae286990a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:47.416273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e94b88-a022-4745-bab2-337ae286990a service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:47.435786 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 664/1328] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:49.546721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aca265-97fd-486e-b6a3-54228a9a85c9 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:49.547368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aca265-97fd-486e-b6a3-54228a9a85c9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:49.547368 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aca265-97fd-486e-b6a3-54228a9a85c9 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:49.548820 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 665/1329] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:49.554430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee3916-3da4-4f64-97c8-93c36e9292b2 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:49.554914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee3916-3da4-4f64-97c8-93c36e9292b2 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:49.555019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee3916-3da4-4f64-97c8-93c36e9292b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:49.626065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-d4ee3916-3da4-4f64-97c8-93c36e9292b2 None None] MFA Rules not processed for user `6c00a943c52a48299d08f42c54466487`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:49.627347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d4ee3916-3da4-4f64-97c8-93c36e9292b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:49.741264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 665/1330] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:17:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:17:49.779232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aca265-97fd-486e-b6a3-54228a9a85c9 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:49.780925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b2aca265-97fd-486e-b6a3-54228a9a85c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:49.812584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:49.888481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aca265-97fd-486e-b6a3-54228a9a85c9 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:49.969646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9cbb7-790d-4132-88bf-9e904f83a0fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:49.970258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9cbb7-790d-4132-88bf-9e904f83a0fb service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:49.970533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9cbb7-790d-4132-88bf-9e904f83a0fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:49.970803 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9cbb7-790d-4132-88bf-9e904f83a0fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:49.972458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d2a9cbb7-790d-4132-88bf-9e904f83a0fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:50.051247 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:50.088766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9cbb7-790d-4132-88bf-9e904f83a0fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:50.088766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9cbb7-790d-4132-88bf-9e904f83a0fb service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:50.122704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 666/1331] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:52.440427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eada8-d226-433d-bdd6-3a75026e99c7 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:52.440927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eada8-d226-433d-bdd6-3a75026e99c7 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:52.440927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eada8-d226-433d-bdd6-3a75026e99c7 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:52.442318 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 666/1332] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:52.447876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93f49a-fb65-4c24-a15d-7e100ad491bf None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:52.448314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93f49a-fb65-4c24-a15d-7e100ad491bf None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:52.448411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93f49a-fb65-4c24-a15d-7e100ad491bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:52.522142 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-da93f49a-fb65-4c24-a15d-7e100ad491bf None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:52.523434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-da93f49a-fb65-4c24-a15d-7e100ad491bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:52.645085 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 667/1333] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:17:52.681363 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012eada8-d226-433d-bdd6-3a75026e99c7 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:52.682991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-012eada8-d226-433d-bdd6-3a75026e99c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:52.757975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:52.797038 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012eada8-d226-433d-bdd6-3a75026e99c7 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:52.875092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd99515-aa22-40ca-abc1-1db90133c083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:52.875699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd99515-aa22-40ca-abc1-1db90133c083 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:52.875969 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd99515-aa22-40ca-abc1-1db90133c083 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:52.876241 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd99515-aa22-40ca-abc1-1db90133c083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:52.877836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-bfd99515-aa22-40ca-abc1-1db90133c083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:52.998863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd99515-aa22-40ca-abc1-1db90133c083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:53.000337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd99515-aa22-40ca-abc1-1db90133c083 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:53.013562 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:53.023675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 667/1334] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:55.037419 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dca0ad-8a51-4ca3-89ec-9b8df5c8464d None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:55.038274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dca0ad-8a51-4ca3-89ec-9b8df5c8464d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:55.038274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dca0ad-8a51-4ca3-89ec-9b8df5c8464d None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:55.040486 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 668/1335] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:17:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:55.045854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520811e-64ee-4c00-8236-a43717ea1ca1 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:55.046307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520811e-64ee-4c00-8236-a43717ea1ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:55.046439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520811e-64ee-4c00-8236-a43717ea1ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:55.115734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c520811e-64ee-4c00-8236-a43717ea1ca1 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:55.116935 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c520811e-64ee-4c00-8236-a43717ea1ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:55.219615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 668/1336] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:17:55.260110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dca0ad-8a51-4ca3-89ec-9b8df5c8464d None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:55.261675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-81dca0ad-8a51-4ca3-89ec-9b8df5c8464d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:55.303396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:55.369525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dca0ad-8a51-4ca3-89ec-9b8df5c8464d None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:55.442722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3ef3-d734-47d6-9543-26584a76b7e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:55.443365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3ef3-d734-47d6-9543-26584a76b7e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:55.443637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3ef3-d734-47d6-9543-26584a76b7e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:55.443901 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3ef3-d734-47d6-9543-26584a76b7e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:55.445498 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-77db3ef3-d734-47d6-9543-26584a76b7e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:55.537295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:55.571648 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db3ef3-d734-47d6-9543-26584a76b7e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:55.573035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db3ef3-d734-47d6-9543-26584a76b7e0 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:55.592522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 669/1337] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:57.950244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2123a-8750-4603-83f5-0dd5e8c6020b None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:57.950880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2123a-8750-4603-83f5-0dd5e8c6020b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:57.950880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2123a-8750-4603-83f5-0dd5e8c6020b None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:57.952217 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 669/1338] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:57.958341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746adb1-be41-4ea2-a074-829b1f1223df None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:57.958969 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746adb1-be41-4ea2-a074-829b1f1223df None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:57.959163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746adb1-be41-4ea2-a074-829b1f1223df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:58.043777 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-e746adb1-be41-4ea2-a074-829b1f1223df None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:58.045442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e746adb1-be41-4ea2-a074-829b1f1223df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:58.155681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 670/1339] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:17:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:17:58.191711 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2123a-8750-4603-83f5-0dd5e8c6020b None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:58.193260 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-59b2123a-8750-4603-83f5-0dd5e8c6020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:58.280325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:58.309644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2123a-8750-4603-83f5-0dd5e8c6020b None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:58.412627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af6866-b131-4f24-b5dc-08518fc4d7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:58.413395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af6866-b131-4f24-b5dc-08518fc4d7db service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:58.413667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af6866-b131-4f24-b5dc-08518fc4d7db service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:58.413931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af6866-b131-4f24-b5dc-08518fc4d7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:58.415582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-20af6866-b131-4f24-b5dc-08518fc4d7db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:58.541162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af6866-b131-4f24-b5dc-08518fc4d7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:58.542534 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af6866-b131-4f24-b5dc-08518fc4d7db service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:58.561669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 670/1340] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:02.690394 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c4ff7-30d8-4cdc-86ea-2e2724b8eada None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:02.690956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c4ff7-30d8-4cdc-86ea-2e2724b8eada None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:02.690956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c4ff7-30d8-4cdc-86ea-2e2724b8eada None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:02.692348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 671/1341] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:02.697643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea959c-a887-4be6-b1b9-4ed3435fa598 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:02.698117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea959c-a887-4be6-b1b9-4ed3435fa598 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:02.698117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea959c-a887-4be6-b1b9-4ed3435fa598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:02.703821 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:02.766914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-62ea959c-a887-4be6-b1b9-4ed3435fa598 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:02.768042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-62ea959c-a887-4be6-b1b9-4ed3435fa598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:02.876283 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 671/1342] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:02.915626 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c4ff7-30d8-4cdc-86ea-2e2724b8eada None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:02.917245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-768c4ff7-30d8-4cdc-86ea-2e2724b8eada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:02.968214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:03.030697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c4ff7-30d8-4cdc-86ea-2e2724b8eada None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:03.105786 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbdcd1-6b34-4c71-9a2f-df1ef2680c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:03.106406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbdcd1-6b34-4c71-9a2f-df1ef2680c69 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:03.106677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbdcd1-6b34-4c71-9a2f-df1ef2680c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:03.106970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbdcd1-6b34-4c71-9a2f-df1ef2680c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:03.108813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-38cbdcd1-6b34-4c71-9a2f-df1ef2680c69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:03.210604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:03.230025 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbdcd1-6b34-4c71-9a2f-df1ef2680c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:03.231737 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbdcd1-6b34-4c71-9a2f-df1ef2680c69 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:03.253291 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 672/1343] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:05.857431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f983f6-5f9b-4f5e-84fd-10b0c7fcad41 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:05.858027 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f983f6-5f9b-4f5e-84fd-10b0c7fcad41 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:05.858027 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f983f6-5f9b-4f5e-84fd-10b0c7fcad41 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:05.859704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 672/1344] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:05.865894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc28e-0c52-46dc-b1ee-2ad1d969ab4e None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:05.866444 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc28e-0c52-46dc-b1ee-2ad1d969ab4e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:05.866444 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc28e-0c52-46dc-b1ee-2ad1d969ab4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:05.941468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-6dccc28e-0c52-46dc-b1ee-2ad1d969ab4e None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:05.942741 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6dccc28e-0c52-46dc-b1ee-2ad1d969ab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:06.049470 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 673/1345] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:06.089963 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f983f6-5f9b-4f5e-84fd-10b0c7fcad41 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:06.092650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e3f983f6-5f9b-4f5e-84fd-10b0c7fcad41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:06.187891 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:06.206638 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f983f6-5f9b-4f5e-84fd-10b0c7fcad41 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:06.414382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea6381-c929-4854-a098-db4d285e556a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:06.415016 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6381-c929-4854-a098-db4d285e556a service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:06.415289 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6381-c929-4854-a098-db4d285e556a service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:06.415577 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6381-c929-4854-a098-db4d285e556a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:06.417180 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ecea6381-c929-4854-a098-db4d285e556a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:06.541196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea6381-c929-4854-a098-db4d285e556a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:06.542650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea6381-c929-4854-a098-db4d285e556a service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:06.563194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 673/1346] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:10.567289 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca471a-1dc8-4a34-b034-4080d26a00a6 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:10.567766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca471a-1dc8-4a34-b034-4080d26a00a6 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:10.567845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca471a-1dc8-4a34-b034-4080d26a00a6 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:10.569724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 674/1347] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:10.575330 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390b998-68b2-443c-aafb-aed7b1fd469a None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:10.576942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390b998-68b2-443c-aafb-aed7b1fd469a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:10.577165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390b998-68b2-443c-aafb-aed7b1fd469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:10.593279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:10.647685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-9390b998-68b2-443c-aafb-aed7b1fd469a None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:10.648942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9390b998-68b2-443c-aafb-aed7b1fd469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:10.751221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 674/1348] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:10.804341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca471a-1dc8-4a34-b034-4080d26a00a6 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:10.806171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-4dca471a-1dc8-4a34-b034-4080d26a00a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:10.878583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:10.929066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca471a-1dc8-4a34-b034-4080d26a00a6 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:11.010078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f7406-25bb-45bb-8a2f-0b55aac3e114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:11.010688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f7406-25bb-45bb-8a2f-0b55aac3e114 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:11.011002 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f7406-25bb-45bb-8a2f-0b55aac3e114 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:11.011267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f7406-25bb-45bb-8a2f-0b55aac3e114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:11.012931 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c53f7406-25bb-45bb-8a2f-0b55aac3e114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:11.129731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:11.134565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f7406-25bb-45bb-8a2f-0b55aac3e114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:11.135897 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f7406-25bb-45bb-8a2f-0b55aac3e114 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:11.154963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 675/1349] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:16.402666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884066c3-bc97-4352-b7c7-a58b48013441 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:16.403487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884066c3-bc97-4352-b7c7-a58b48013441 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:16.403487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884066c3-bc97-4352-b7c7-a58b48013441 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:16.404662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 675/1350] 10.222.0.59 () {54 vars in 921 bytes} [Tue Aug 9 11:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:16.411951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0f622-3210-40e9-9ec4-81e92ad867aa None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:16.412621 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0f622-3210-40e9-9ec4-81e92ad867aa None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:16.412621 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0f622-3210-40e9-9ec4-81e92ad867aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:16.546355 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-e8f0f622-3210-40e9-9ec4-81e92ad867aa None None] MFA Rules not processed for user `a04b584a68cb488492046faa23e15463`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:16.548423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e8f0f622-3210-40e9-9ec4-81e92ad867aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:16.732296 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 676/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Aug 9 11:18:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:20.749208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=59 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:21.210533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8a2c-2f16-4b51-be6b-61b9f57ec9f6 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:21.211120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8a2c-2f16-4b51-be6b-61b9f57ec9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:21.211572 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8a2c-2f16-4b51-be6b-61b9f57ec9f6 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:21.213243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 676/1352] 10.222.0.59 () {54 vars in 921 bytes} [Tue Aug 9 11:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:21.219468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ebf02-f321-40d0-8d51-bf60216e055c None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:21.220702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ebf02-f321-40d0-8d51-bf60216e055c None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:21.221724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ebf02-f321-40d0-8d51-bf60216e055c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:21.288635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:21.314532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-dc1ebf02-f321-40d0-8d51-bf60216e055c None None] MFA Rules not processed for user `a04b584a68cb488492046faa23e15463`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:21.315779 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-dc1ebf02-f321-40d0-8d51-bf60216e055c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:21.438793 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 677/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Aug 9 11:18:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:22.726065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932abf0c-5313-482a-82a1-956a5e581b8a None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:22.726564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932abf0c-5313-482a-82a1-956a5e581b8a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:22.726564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932abf0c-5313-482a-82a1-956a5e581b8a None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:22.727862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 677/1354] 10.222.0.59 () {54 vars in 921 bytes} [Tue Aug 9 11:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:22.733500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201bdaf-f0c5-4eab-af9d-210b1cad3e52 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:22.734007 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201bdaf-f0c5-4eab-af9d-210b1cad3e52 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:22.734165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201bdaf-f0c5-4eab-af9d-210b1cad3e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:22.823588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-0201bdaf-f0c5-4eab-af9d-210b1cad3e52 None None] MFA Rules not processed for user `a04b584a68cb488492046faa23e15463`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:22.824811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0201bdaf-f0c5-4eab-af9d-210b1cad3e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:22.872132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:22.942841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 678/1355] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Aug 9 11:18:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:26.465708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a87331-608f-4fbe-a8a3-88f2c666abf8 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:26.466224 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a87331-608f-4fbe-a8a3-88f2c666abf8 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:26.466224 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a87331-608f-4fbe-a8a3-88f2c666abf8 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:26.468075 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 678/1356] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:26.474091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478660d-2327-42b3-af3a-52ae5a6de628 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:26.474981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478660d-2327-42b3-af3a-52ae5a6de628 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:26.475394 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478660d-2327-42b3-af3a-52ae5a6de628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:26.555934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-7478660d-2327-42b3-af3a-52ae5a6de628 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:26.557134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-7478660d-2327-42b3-af3a-52ae5a6de628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:26.663761 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 679/1357] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:26.718159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19012597-2011-4c78-b6e0-03011df5f9fc None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:26.719007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19012597-2011-4c78-b6e0-03011df5f9fc None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:26.719694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19012597-2011-4c78-b6e0-03011df5f9fc None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:26.721290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 679/1358] 10.222.0.59 () {54 vars in 962 bytes} [Tue Aug 9 11:18:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:26.730950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5f5f0-e060-4287-ad72-00735b16ce0b None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:26.731609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5f5f0-e060-4287-ad72-00735b16ce0b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:26.732776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5f5f0-e060-4287-ad72-00735b16ce0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:26.752817 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:26.825703 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-3cf5f5f0-e060-4287-ad72-00735b16ce0b None None] MFA Rules not processed for user `2136cf1160a64951ad780424cb28403b`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:26.827316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-3cf5f5f0-e060-4287-ad72-00735b16ce0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:26.953122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 680/1359] 10.222.0.59 () {58 vars in 1059 bytes} [Tue Aug 9 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:26.969734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19012597-2011-4c78-b6e0-03011df5f9fc None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:26.971264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-19012597-2011-4c78-b6e0-03011df5f9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:27.127405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19012597-2011-4c78-b6e0-03011df5f9fc None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:27.201297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:27.242723 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed0948-ff46-4e42-b498-15acc92835f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:27.243362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0948-ff46-4e42-b498-15acc92835f5 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:27.243698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0948-ff46-4e42-b498-15acc92835f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:27.244024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0948-ff46-4e42-b498-15acc92835f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:27.245680 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-1eed0948-ff46-4e42-b498-15acc92835f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:27.337038 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed0948-ff46-4e42-b498-15acc92835f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:27.338766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed0948-ff46-4e42-b498-15acc92835f5 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:27.357160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 680/1360] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:29.587705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d13a74-ede9-4e79-89fb-2e38a9bd261a None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:29.588404 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d13a74-ede9-4e79-89fb-2e38a9bd261a None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:29.588404 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d13a74-ede9-4e79-89fb-2e38a9bd261a None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:29.591602 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 681/1361] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:29.595946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a08f-f021-4ca9-b0e3-430c01931ef9 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:29.596421 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a08f-f021-4ca9-b0e3-430c01931ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:29.596533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a08f-f021-4ca9-b0e3-430c01931ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:29.700967 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-f995a08f-f021-4ca9-b0e3-430c01931ef9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:29.702252 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f995a08f-f021-4ca9-b0e3-430c01931ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:29.743866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:29.815228 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 681/1362] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:29.862306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d13a74-ede9-4e79-89fb-2e38a9bd261a None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:29.864754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-55d13a74-ede9-4e79-89fb-2e38a9bd261a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:29.947055 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:30.053692 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d13a74-ede9-4e79-89fb-2e38a9bd261a None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:30.185028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be4e25-ec99-49f7-896a-a40544c30580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:30.185908 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be4e25-ec99-49f7-896a-a40544c30580 service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:30.187020 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be4e25-ec99-49f7-896a-a40544c30580 service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:30.187625 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be4e25-ec99-49f7-896a-a40544c30580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:30.189964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-62be4e25-ec99-49f7-896a-a40544c30580 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:30.218575 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:30.298474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be4e25-ec99-49f7-896a-a40544c30580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:30.300117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be4e25-ec99-49f7-896a-a40544c30580 service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:30.320122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 682/1363] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:32.740426 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4202c-3b2a-494a-ab11-4afb9117f134 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:32.740945 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4202c-3b2a-494a-ab11-4afb9117f134 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:32.740945 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4202c-3b2a-494a-ab11-4afb9117f134 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:32.742261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 682/1364] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:32.748326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a1a59-a075-4d96-b1b9-5919b14c6ddc None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:32.748808 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a1a59-a075-4d96-b1b9-5919b14c6ddc None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:32.748909 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a1a59-a075-4d96-b1b9-5919b14c6ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:32.832077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-1e2a1a59-a075-4d96-b1b9-5919b14c6ddc None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:32.833536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1e2a1a59-a075-4d96-b1b9-5919b14c6ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:32.959278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:32.962991 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 683/1365] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:33.008632 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcf0b6-dcf6-4ee3-af2b-6b0ccd368a93 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:33.009046 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcf0b6-dcf6-4ee3-af2b-6b0ccd368a93 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:33.009413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcf0b6-dcf6-4ee3-af2b-6b0ccd368a93 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:33.010868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 683/1366] 10.222.0.59 () {54 vars in 962 bytes} [Tue Aug 9 11:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:33.016814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652c52e-7635-4786-91f8-7f539d26b673 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:33.017195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652c52e-7635-4786-91f8-7f539d26b673 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:33.017562 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652c52e-7635-4786-91f8-7f539d26b673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:33.102655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-0652c52e-7635-4786-91f8-7f539d26b673 None None] MFA Rules not processed for user `2136cf1160a64951ad780424cb28403b`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:33.104084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0652c52e-7635-4786-91f8-7f539d26b673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:33.230061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 684/1367] 10.222.0.59 () {58 vars in 1059 bytes} [Tue Aug 9 11:18:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:33.238617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcf0b6-dcf6-4ee3-af2b-6b0ccd368a93 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:33.240301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-58dcf0b6-dcf6-4ee3-af2b-6b0ccd368a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:33.406655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcf0b6-dcf6-4ee3-af2b-6b0ccd368a93 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:33.430500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:33.552841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b1885-7b0e-4a63-894c-d70c858a9752 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:33.553639 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b1885-7b0e-4a63-894c-d70c858a9752 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:33.554008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b1885-7b0e-4a63-894c-d70c858a9752 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:33.554366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b1885-7b0e-4a63-894c-d70c858a9752 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:33.556104 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ee4b1885-7b0e-4a63-894c-d70c858a9752 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:33.653537 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b1885-7b0e-4a63-894c-d70c858a9752 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:33.655013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b1885-7b0e-4a63-894c-d70c858a9752 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:33.674368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 684/1368] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:34.620400 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01a68b-8830-4053-a1b9-a93db0c585ec None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:34.620991 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01a68b-8830-4053-a1b9-a93db0c585ec None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:34.620991 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01a68b-8830-4053-a1b9-a93db0c585ec None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:34.622506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 685/1369] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:34.627917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048a18e-ba6b-48be-a9e6-a1f7b8e975db None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:34.628396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048a18e-ba6b-48be-a9e6-a1f7b8e975db None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:34.628494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048a18e-ba6b-48be-a9e6-a1f7b8e975db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:34.661772 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:34.698714 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-f048a18e-ba6b-48be-a9e6-a1f7b8e975db None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:34.700280 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f048a18e-ba6b-48be-a9e6-a1f7b8e975db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:34.803431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 685/1370] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:35.136777 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d848ae-c32c-4e3e-9059-baec53c06a15 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:35.137097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d848ae-c32c-4e3e-9059-baec53c06a15 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:35.137306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d848ae-c32c-4e3e-9059-baec53c06a15 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:35.138861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 686/1371] 10.222.0.59 () {54 vars in 964 bytes} [Tue Aug 9 11:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:35.144178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b7567-bdbd-4a87-91d2-0001cb80627f None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:35.144443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b7567-bdbd-4a87-91d2-0001cb80627f None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:35.144720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b7567-bdbd-4a87-91d2-0001cb80627f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:35.224366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-803b7567-bdbd-4a87-91d2-0001cb80627f None None] MFA Rules not processed for user `a8bcbc6393d341a7be009f3b8c329e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:35.225588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-803b7567-bdbd-4a87-91d2-0001cb80627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:35.276431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:35.315401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 686/1372] 10.222.0.59 () {58 vars in 1061 bytes} [Tue Aug 9 11:18:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:35.323108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d848ae-c32c-4e3e-9059-baec53c06a15 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:35.324766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-08d848ae-c32c-4e3e-9059-baec53c06a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:35.377200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:35.433670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d848ae-c32c-4e3e-9059-baec53c06a15 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:35.511498 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e06157-61d4-4383-8775-68775fcbeb7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:35.512199 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e06157-61d4-4383-8775-68775fcbeb7c service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:35.512536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e06157-61d4-4383-8775-68775fcbeb7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:35.512997 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e06157-61d4-4383-8775-68775fcbeb7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:35.514695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-75e06157-61d4-4383-8775-68775fcbeb7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:35.623129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:35.638118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e06157-61d4-4383-8775-68775fcbeb7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:35.639683 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e06157-61d4-4383-8775-68775fcbeb7c service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:35.661142 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 687/1373] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:35.755238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff087a-c5ec-4a9a-90d7-0acaf1d7db86 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:35.755724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff087a-c5ec-4a9a-90d7-0acaf1d7db86 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:35.755724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff087a-c5ec-4a9a-90d7-0acaf1d7db86 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:35.757252 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 687/1374] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:35.762912 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc353-5fa7-4ce8-9d38-333a522f17c9 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:35.763495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc353-5fa7-4ce8-9d38-333a522f17c9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:35.763495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc353-5fa7-4ce8-9d38-333a522f17c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:35.844920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-df3cc353-5fa7-4ce8-9d38-333a522f17c9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:35.846739 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-df3cc353-5fa7-4ce8-9d38-333a522f17c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:35.962982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 688/1375] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:36.010853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff087a-c5ec-4a9a-90d7-0acaf1d7db86 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:36.010853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2cff087a-c5ec-4a9a-90d7-0acaf1d7db86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:36.181850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff087a-c5ec-4a9a-90d7-0acaf1d7db86 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:36.236838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:36.302128 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba711c22-def3-4d9c-ae7a-f1ec525d1ffc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:36.302752 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba711c22-def3-4d9c-ae7a-f1ec525d1ffc service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:36.303050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba711c22-def3-4d9c-ae7a-f1ec525d1ffc service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:36.303317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba711c22-def3-4d9c-ae7a-f1ec525d1ffc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:36.305070 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ba711c22-def3-4d9c-ae7a-f1ec525d1ffc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:36.408912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba711c22-def3-4d9c-ae7a-f1ec525d1ffc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:36.410543 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba711c22-def3-4d9c-ae7a-f1ec525d1ffc service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:36.429034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 688/1376] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:38.442506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3cd8b-753f-4298-8f25-336be84168fc None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:38.443075 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3cd8b-753f-4298-8f25-336be84168fc None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:38.443075 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3cd8b-753f-4298-8f25-336be84168fc None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:38.444363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 689/1377] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:38.450006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153046-04e5-4650-84da-c92c05d15316 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:38.450431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153046-04e5-4650-84da-c92c05d15316 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:38.450654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153046-04e5-4650-84da-c92c05d15316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:38.522397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-71153046-04e5-4650-84da-c92c05d15316 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:38.523627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-71153046-04e5-4650-84da-c92c05d15316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:38.530941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:38.632919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 689/1378] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:38.679403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3cd8b-753f-4298-8f25-336be84168fc None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:38.680941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a1c3cd8b-753f-4298-8f25-336be84168fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:38.749689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:38.856435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3cd8b-753f-4298-8f25-336be84168fc None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:38.974392 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a274f43-4a21-486a-903e-8be56a86cbc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:38.975172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a274f43-4a21-486a-903e-8be56a86cbc3 service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:38.975554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a274f43-4a21-486a-903e-8be56a86cbc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:38.975913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a274f43-4a21-486a-903e-8be56a86cbc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:38.977633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1a274f43-4a21-486a-903e-8be56a86cbc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:39.001733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:39.086103 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a274f43-4a21-486a-903e-8be56a86cbc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:39.087745 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a274f43-4a21-486a-903e-8be56a86cbc3 service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:39.112944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 690/1379] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:41.187407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ff68-f0d0-49ae-b8c8-23421fae7803 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:41.187959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ff68-f0d0-49ae-b8c8-23421fae7803 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:41.187959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ff68-f0d0-49ae-b8c8-23421fae7803 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:41.189305 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 690/1380] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:41.194895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202db194-2f35-4199-90ea-3ce478d46c1f None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:41.195413 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202db194-2f35-4199-90ea-3ce478d46c1f None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:41.195736 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202db194-2f35-4199-90ea-3ce478d46c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:41.276807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-202db194-2f35-4199-90ea-3ce478d46c1f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:41.278188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-202db194-2f35-4199-90ea-3ce478d46c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:41.401018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:41.414869 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 691/1381] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:41.459186 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2ff68-f0d0-49ae-b8c8-23421fae7803 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:41.462443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f1e2ff68-f0d0-49ae-b8c8-23421fae7803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:41.632174 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:41.647036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2ff68-f0d0-49ae-b8c8-23421fae7803 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:41.780213 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcd64a-760d-4b18-b9d6-c53ecce36e10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:41.780871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcd64a-760d-4b18-b9d6-c53ecce36e10 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:41.781199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcd64a-760d-4b18-b9d6-c53ecce36e10 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:41.781524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcd64a-760d-4b18-b9d6-c53ecce36e10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:41.783341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6ebcd64a-760d-4b18-b9d6-c53ecce36e10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:41.891135 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebcd64a-760d-4b18-b9d6-c53ecce36e10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:41.892807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebcd64a-760d-4b18-b9d6-c53ecce36e10 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:41.904784 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:41.916028 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 691/1382] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:44.035935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811243ac-4fb0-4308-889f-8acade80f13a None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:44.036611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811243ac-4fb0-4308-889f-8acade80f13a None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:44.036611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811243ac-4fb0-4308-889f-8acade80f13a None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:44.037976 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 692/1383] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:44.045325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8dc87-c494-4097-9009-d05b89d8d65c None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:44.045893 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8dc87-c494-4097-9009-d05b89d8d65c None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:44.045893 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8dc87-c494-4097-9009-d05b89d8d65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:44.129270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-d3a8dc87-c494-4097-9009-d05b89d8d65c None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:44.131012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d3a8dc87-c494-4097-9009-d05b89d8d65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:44.259435 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 692/1384] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:44.309618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811243ac-4fb0-4308-889f-8acade80f13a None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:44.311377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-811243ac-4fb0-4308-889f-8acade80f13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:44.501549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811243ac-4fb0-4308-889f-8acade80f13a None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:44.603130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:44.665452 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c2019-c4cc-4656-a08b-4277b1c27b88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:44.666177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c2019-c4cc-4656-a08b-4277b1c27b88 service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:44.666505 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c2019-c4cc-4656-a08b-4277b1c27b88 service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:44.666801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c2019-c4cc-4656-a08b-4277b1c27b88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:44.668972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-757c2019-c4cc-4656-a08b-4277b1c27b88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:44.789532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c2019-c4cc-4656-a08b-4277b1c27b88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:44.791799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c2019-c4cc-4656-a08b-4277b1c27b88 service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:44.818284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 693/1385] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:46.894348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66642c1a-95b1-49f5-9add-cb3ac287aa94 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:46.895032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66642c1a-95b1-49f5-9add-cb3ac287aa94 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:46.895166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66642c1a-95b1-49f5-9add-cb3ac287aa94 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:46.897122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 693/1386] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:46.903298 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d5604-b317-484e-8eb0-bf3398d819f9 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:46.904019 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d5604-b317-484e-8eb0-bf3398d819f9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:46.904019 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d5604-b317-484e-8eb0-bf3398d819f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:47.004042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-5c5d5604-b317-484e-8eb0-bf3398d819f9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:47.005340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5c5d5604-b317-484e-8eb0-bf3398d819f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:47.050550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:47.126386 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 694/1387] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:18:47.174047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66642c1a-95b1-49f5-9add-cb3ac287aa94 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:47.175717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-66642c1a-95b1-49f5-9add-cb3ac287aa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:47.266220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:47.402798 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66642c1a-95b1-49f5-9add-cb3ac287aa94 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:47.554765 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5389961-eb5c-4502-be46-8fbed6c2891c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:47.555454 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389961-eb5c-4502-be46-8fbed6c2891c service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:47.555743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389961-eb5c-4502-be46-8fbed6c2891c service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:47.555983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389961-eb5c-4502-be46-8fbed6c2891c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:47.557675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d5389961-eb5c-4502-be46-8fbed6c2891c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:47.625880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:47.712889 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5389961-eb5c-4502-be46-8fbed6c2891c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:47.714530 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5389961-eb5c-4502-be46-8fbed6c2891c service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:47.735480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 694/1388] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:49.822437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2f1e3-9144-44b7-80dc-1041f503dabd None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:49.823849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2f1e3-9144-44b7-80dc-1041f503dabd None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:49.824317 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2f1e3-9144-44b7-80dc-1041f503dabd None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:49.826978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 695/1389] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:49.836002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77f85c-2fee-4f22-80b8-978aac7e7720 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:49.836598 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77f85c-2fee-4f22-80b8-978aac7e7720 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:49.836841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77f85c-2fee-4f22-80b8-978aac7e7720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:49.949062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-4e77f85c-2fee-4f22-80b8-978aac7e7720 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:49.950766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4e77f85c-2fee-4f22-80b8-978aac7e7720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:50.071870 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 695/1390] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:50.142265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2f1e3-9144-44b7-80dc-1041f503dabd None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:50.144147 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-82d2f1e3-9144-44b7-80dc-1041f503dabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:50.346740 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2f1e3-9144-44b7-80dc-1041f503dabd None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:50.375114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:50.526398 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c618760-d3c0-4cc7-9164-1dc48ce34525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:50.527135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c618760-d3c0-4cc7-9164-1dc48ce34525 service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:50.527478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c618760-d3c0-4cc7-9164-1dc48ce34525 service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:50.527829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c618760-d3c0-4cc7-9164-1dc48ce34525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:50.529774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5c618760-d3c0-4cc7-9164-1dc48ce34525 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:50.662480 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c618760-d3c0-4cc7-9164-1dc48ce34525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:50.665458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c618760-d3c0-4cc7-9164-1dc48ce34525 service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:50.691396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 696/1391] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:50.950122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474a4cf-c4b3-4392-a02b-a02f77b49290 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:50.950977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474a4cf-c4b3-4392-a02b-a02f77b49290 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:50.950977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474a4cf-c4b3-4392-a02b-a02f77b49290 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:50.951964 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 696/1392] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:18:50.957940 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f5133-33fd-4385-95ca-9193647a99cf None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:50.958842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f5133-33fd-4385-95ca-9193647a99cf None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:50.958842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f5133-33fd-4385-95ca-9193647a99cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:50.991640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:51.044320 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-203f5133-33fd-4385-95ca-9193647a99cf None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:51.045545 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-203f5133-33fd-4385-95ca-9193647a99cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:51.191530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 697/1393] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:18:51.268838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08596237-ecc5-40e4-895d-8c1334967f93 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:51.269305 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08596237-ecc5-40e4-895d-8c1334967f93 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:51.269739 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08596237-ecc5-40e4-895d-8c1334967f93 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:51.272188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 697/1394] 10.222.0.59 () {54 vars in 967 bytes} [Tue Aug 9 11:18:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:51.280520 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5de1d4-dab8-4a87-8ad4-fcd8dcc5b24d None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:51.280883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5de1d4-dab8-4a87-8ad4-fcd8dcc5b24d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:51.281280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5de1d4-dab8-4a87-8ad4-fcd8dcc5b24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:51.405394 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-2e5de1d4-dab8-4a87-8ad4-fcd8dcc5b24d None None] MFA Rules not processed for user `a7f8976306ff477592c6c5b62af60f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:51.406854 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-2e5de1d4-dab8-4a87-8ad4-fcd8dcc5b24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:51.467492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:51.523849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 698/1395] 10.222.0.59 () {58 vars in 1064 bytes} [Tue Aug 9 11:18:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:51.537297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08596237-ecc5-40e4-895d-8c1334967f93 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:51.540023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-08596237-ecc5-40e4-895d-8c1334967f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:51.564193 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:51.709914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08596237-ecc5-40e4-895d-8c1334967f93 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:51.806934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdac28b-3e75-4003-bacd-d2b3e0c20f16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7f8976306ff477592c6c5b62af60f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:51.807836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdac28b-3e75-4003-bacd-d2b3e0c20f16 service glance] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:51.808301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdac28b-3e75-4003-bacd-d2b3e0c20f16 service glance] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:51.808768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdac28b-3e75-4003-bacd-d2b3e0c20f16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:51.811840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-8bdac28b-3e75-4003-bacd-d2b3e0c20f16 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:51.918451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:51.989265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdac28b-3e75-4003-bacd-d2b3e0c20f16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:51.991161 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdac28b-3e75-4003-bacd-d2b3e0c20f16 service glance] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:52.013271 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 698/1396] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:53.099545 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c0bdb-5213-48ee-9990-efb7788f9a4f None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.100448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c0bdb-5213-48ee-9990-efb7788f9a4f None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.100448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c0bdb-5213-48ee-9990-efb7788f9a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.225400 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-005c0bdb-5213-48ee-9990-efb7788f9a4f None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.227519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-005c0bdb-5213-48ee-9990-efb7788f9a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.364190 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04694537-fda5-4fc6-ab06-a08c5687dbb2 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.364869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04694537-fda5-4fc6-ab06-a08c5687dbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.364869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04694537-fda5-4fc6-ab06-a08c5687dbb2 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.366305 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 699/1397] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:53.371959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e397e-c2cc-4806-9b67-e1aa594b791f None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.372203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e397e-c2cc-4806-9b67-e1aa594b791f None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.372491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e397e-c2cc-4806-9b67-e1aa594b791f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.396802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 699/1398] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:53.455515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-f18e397e-c2cc-4806-9b67-e1aa594b791f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.457545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f18e397e-c2cc-4806-9b67-e1aa594b791f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.464485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac1a0-29bf-4ed7-879b-c762fcd57f20 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.464871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac1a0-29bf-4ed7-879b-c762fcd57f20 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.465254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac1a0-29bf-4ed7-879b-c762fcd57f20 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.466721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 700/1399] 10.222.0.59 () {54 vars in 943 bytes} [Tue Aug 9 11:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:18:53.474578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d238c-d5d8-40e4-a88f-3e56b6f3a1cd None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.475042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d238c-d5d8-40e4-a88f-3e56b6f3a1cd None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.475328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d238c-d5d8-40e4-a88f-3e56b6f3a1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.558674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:53.569597 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-5a2d238c-d5d8-40e4-a88f-3e56b6f3a1cd None None] MFA Rules not processed for user `913447120a2e42d8affdf50bb74dc5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.571661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5a2d238c-d5d8-40e4-a88f-3e56b6f3a1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.621485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 700/1400] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:18:53.670433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e397e-c2cc-4806-9b67-e1aa594b791f None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:53.671781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f18e397e-c2cc-4806-9b67-e1aa594b791f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.698793 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 701/1401] 10.222.0.59 () {58 vars in 1040 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:18:53.704388 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:53.709097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d238c-d5d8-40e4-a88f-3e56b6f3a1cd None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:53.721442 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d238c-d5d8-40e4-a88f-3e56b6f3a1cd None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:53.829445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e397e-c2cc-4806-9b67-e1aa594b791f None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:53.850058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f11bee-f0ab-4011-b062-b35af66b3c99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:53.850689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f11bee-f0ab-4011-b062-b35af66b3c99 service swift] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.851019 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f11bee-f0ab-4011-b062-b35af66b3c99 service swift] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.851284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f11bee-f0ab-4011-b062-b35af66b3c99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.853004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a5f11bee-f0ab-4011-b062-b35af66b3c99 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.855882 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:53.955605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f11bee-f0ab-4011-b062-b35af66b3c99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:53.957150 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f11bee-f0ab-4011-b062-b35af66b3c99 service swift] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:53.966140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 702/1402] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:18:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:18:53.979617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ca6cb-b929-45e0-9bc5-3fbc688842cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:53.980952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ca6cb-b929-45e0-9bc5-3fbc688842cf service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.981539 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ca6cb-b929-45e0-9bc5-3fbc688842cf service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.981949 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ca6cb-b929-45e0-9bc5-3fbc688842cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.985297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-497ca6cb-b929-45e0-9bc5-3fbc688842cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:54.018102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:54.122973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ca6cb-b929-45e0-9bc5-3fbc688842cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.124812 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ca6cb-b929-45e0-9bc5-3fbc688842cf service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.151017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 701/1403] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:18:56.286128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08303ec9-466a-4012-9e39-0ad54ca7237e None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.286720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08303ec9-466a-4012-9e39-0ad54ca7237e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.286720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08303ec9-466a-4012-9e39-0ad54ca7237e None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.288333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 703/1404] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:56.293998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f945f-b4c7-454a-a511-3a5429daa17a None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.294556 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f945f-b4c7-454a-a511-3a5429daa17a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.294556 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f945f-b4c7-454a-a511-3a5429daa17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.409261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-187f945f-b4c7-454a-a511-3a5429daa17a None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:56.411860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-187f945f-b4c7-454a-a511-3a5429daa17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:56.573337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:56.582854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 702/1405] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:56.635463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08303ec9-466a-4012-9e39-0ad54ca7237e None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:56.638357 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-08303ec9-466a-4012-9e39-0ad54ca7237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:56.945643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:56.951804 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08303ec9-466a-4012-9e39-0ad54ca7237e None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:57.246795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecb29b-c2c4-4c03-94bb-fef08b0ffc45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:57.247513 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecb29b-c2c4-4c03-94bb-fef08b0ffc45 service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:57.247787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecb29b-c2c4-4c03-94bb-fef08b0ffc45 service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:57.248048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecb29b-c2c4-4c03-94bb-fef08b0ffc45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:57.249754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-feecb29b-c2c4-4c03-94bb-fef08b0ffc45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:57.396906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecb29b-c2c4-4c03-94bb-fef08b0ffc45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:57.401150 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecb29b-c2c4-4c03-94bb-fef08b0ffc45 service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:57.438084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 704/1406] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 804 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:59.724333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad567d-3839-45d9-a20a-b47b342af89e None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:59.724955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad567d-3839-45d9-a20a-b47b342af89e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:59.725611 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad567d-3839-45d9-a20a-b47b342af89e None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:59.728711 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 703/1407] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:18:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:59.734887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba94c0-87ca-4ab1-ae75-59711121a8ff None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:59.735582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba94c0-87ca-4ab1-ae75-59711121a8ff None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:59.735582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba94c0-87ca-4ab1-ae75-59711121a8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:59.740972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:59.830415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-95ba94c0-87ca-4ab1-ae75-59711121a8ff None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:59.831948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-95ba94c0-87ca-4ab1-ae75-59711121a8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:59.960973 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 705/1408] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:00.030991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad567d-3839-45d9-a20a-b47b342af89e None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:00.033008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-08ad567d-3839-45d9-a20a-b47b342af89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:00.211226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad567d-3839-45d9-a20a-b47b342af89e None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:00.319120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:00.385457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204049c2-1979-43c4-a803-016a44a2e71e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:00.386092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204049c2-1979-43c4-a803-016a44a2e71e service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:00.386354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204049c2-1979-43c4-a803-016a44a2e71e service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:00.386619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204049c2-1979-43c4-a803-016a44a2e71e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:00.388459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-204049c2-1979-43c4-a803-016a44a2e71e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:00.531630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204049c2-1979-43c4-a803-016a44a2e71e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:00.533746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204049c2-1979-43c4-a803-016a44a2e71e service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:00.562071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 704/1409] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:19:09.958715 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=64 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:10.558321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=64 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:18.879769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b188ce-6dfc-42aa-84d3-1d3ff378166f None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:18.880653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b188ce-6dfc-42aa-84d3-1d3ff378166f None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:18.880653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b188ce-6dfc-42aa-84d3-1d3ff378166f None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:18.881714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 706/1410] 10.222.0.59 () {54 vars in 918 bytes} [Tue Aug 9 11:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:19:18.887971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1e0e-2bda-455d-a5ec-0bcc6cf080fd None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:18.888681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1e0e-2bda-455d-a5ec-0bcc6cf080fd None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:18.888681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1e0e-2bda-455d-a5ec-0bcc6cf080fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:18.982873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-33da1e0e-2bda-455d-a5ec-0bcc6cf080fd None None] MFA Rules not processed for user `a04b584a68cb488492046faa23e15463`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:18.984194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-33da1e0e-2bda-455d-a5ec-0bcc6cf080fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:19.136040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 705/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Tue Aug 9 11:19:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:19.153723 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de0fef-51ee-45b2-9c50-125917092526 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:19.154207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de0fef-51ee-45b2-9c50-125917092526 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:19.154642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de0fef-51ee-45b2-9c50-125917092526 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:19.157140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 707/1412] 10.222.0.59 () {54 vars in 918 bytes} [Tue Aug 9 11:19:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:19.162967 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581b34-4816-4664-9242-f9252f435fdc None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:19.163300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581b34-4816-4664-9242-f9252f435fdc None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:19.163534 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581b34-4816-4664-9242-f9252f435fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:19.255469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:19.259206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-fe581b34-4816-4664-9242-f9252f435fdc None None] MFA Rules not processed for user `2136cf1160a64951ad780424cb28403b`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:19.261655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-fe581b34-4816-4664-9242-f9252f435fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:19.409921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 706/1413] 10.222.0.59 () {58 vars in 1015 bytes} [Tue Aug 9 11:19:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:22.029645 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a7f7e-90d8-4224-8096-87cec22ee736 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:22.030558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a7f7e-90d8-4224-8096-87cec22ee736 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:22.030558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a7f7e-90d8-4224-8096-87cec22ee736 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:22.032310 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:22.038951 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff577e-7ec6-43e5-9030-4c051438fbf0 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:22.039590 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff577e-7ec6-43e5-9030-4c051438fbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:22.039764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff577e-7ec6-43e5-9030-4c051438fbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:22.119824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-a6ff577e-7ec6-43e5-9030-4c051438fbf0 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:22.121125 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a6ff577e-7ec6-43e5-9030-4c051438fbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:22.196627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:22.255850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:22.302802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a7f7e-90d8-4224-8096-87cec22ee736 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:22.304804 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-588a7f7e-90d8-4224-8096-87cec22ee736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:22.491233 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a7f7e-90d8-4224-8096-87cec22ee736 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:22.586390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:22.641403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22c89b-14e1-413c-aaf9-ffd7d85f35d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:22.642166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22c89b-14e1-413c-aaf9-ffd7d85f35d7 service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:22.642523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22c89b-14e1-413c-aaf9-ffd7d85f35d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:22.643000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22c89b-14e1-413c-aaf9-ffd7d85f35d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:22.644968 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5a22c89b-14e1-413c-aaf9-ffd7d85f35d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:22.756236 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22c89b-14e1-413c-aaf9-ffd7d85f35d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:22.758100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22c89b-14e1-413c-aaf9-ffd7d85f35d7 service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:22.780024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 709/1416] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:23.852290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72c2a4-f2df-4fd9-b87c-7b848dfa5075 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:23.852979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72c2a4-f2df-4fd9-b87c-7b848dfa5075 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:23.852979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72c2a4-f2df-4fd9-b87c-7b848dfa5075 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:23.854244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:23.861903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adfd20-860e-4914-9264-7f1b8e5b5275 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:23.862550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adfd20-860e-4914-9264-7f1b8e5b5275 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:23.862550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adfd20-860e-4914-9264-7f1b8e5b5275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:23.957160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f9adfd20-860e-4914-9264-7f1b8e5b5275 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:23.958484 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f9adfd20-860e-4914-9264-7f1b8e5b5275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:23.992418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:24.082278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:24.239393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72c2a4-f2df-4fd9-b87c-7b848dfa5075 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:24.240871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ed72c2a4-f2df-4fd9-b87c-7b848dfa5075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:24.471084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72c2a4-f2df-4fd9-b87c-7b848dfa5075 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:24.522410 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:24.617354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8925f-15b4-4801-8841-f670259a7253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:24.618234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8925f-15b4-4801-8841-f670259a7253 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:24.618646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8925f-15b4-4801-8841-f670259a7253 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:24.619020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8925f-15b4-4801-8841-f670259a7253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:24.621155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d6f8925f-15b4-4801-8841-f670259a7253 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:24.730544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8925f-15b4-4801-8841-f670259a7253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:24.732368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8925f-15b4-4801-8841-f670259a7253 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:24.754090 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 709/1419] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:19:25.723418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e0de7-3d47-4799-8838-9e01f26db9b8 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:25.723995 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e0de7-3d47-4799-8838-9e01f26db9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:25.723995 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e0de7-3d47-4799-8838-9e01f26db9b8 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:25.725661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:25.731620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963a09b-7f6c-4371-98a9-e70750901b64 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:25.732361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963a09b-7f6c-4371-98a9-e70750901b64 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:25.732361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963a09b-7f6c-4371-98a9-e70750901b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:25.800995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:25.841092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-a963a09b-7f6c-4371-98a9-e70750901b64 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:25.842880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a963a09b-7f6c-4371-98a9-e70750901b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:25.966479 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:26.125489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e0de7-3d47-4799-8838-9e01f26db9b8 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:26.127769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-287e0de7-3d47-4799-8838-9e01f26db9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:26.304177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e0de7-3d47-4799-8838-9e01f26db9b8 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:26.319401 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:26.450835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4900b-6e2b-42f1-a35f-29b9e0f5aa89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:26.451512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4900b-6e2b-42f1-a35f-29b9e0f5aa89 service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:26.451812 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4900b-6e2b-42f1-a35f-29b9e0f5aa89 service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:26.452106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4900b-6e2b-42f1-a35f-29b9e0f5aa89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:26.453950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1ca4900b-6e2b-42f1-a35f-29b9e0f5aa89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:26.566704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4900b-6e2b-42f1-a35f-29b9e0f5aa89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:26.569655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4900b-6e2b-42f1-a35f-29b9e0f5aa89 service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:26.593786 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 712/1422] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:27.532321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f546e-4aec-4832-a33d-064b84cc672b None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:27.532977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f546e-4aec-4832-a33d-064b84cc672b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:27.532977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f546e-4aec-4832-a33d-064b84cc672b None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:27.534256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:27.540267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5edeb0-f0a8-4214-a71d-bd14395ffc28 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:27.540855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5edeb0-f0a8-4214-a71d-bd14395ffc28 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:27.540855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5edeb0-f0a8-4214-a71d-bd14395ffc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:27.567769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:27.641635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-ae5edeb0-f0a8-4214-a71d-bd14395ffc28 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:27.642955 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ae5edeb0-f0a8-4214-a71d-bd14395ffc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:27.761056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:27.911978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f546e-4aec-4832-a33d-064b84cc672b None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:27.913603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-151f546e-4aec-4832-a33d-064b84cc672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:28.054007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:28.103438 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f546e-4aec-4832-a33d-064b84cc672b None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:28.286315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe313be-d2bd-4a3c-b96b-e58ed1cf7536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:28.286990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe313be-d2bd-4a3c-b96b-e58ed1cf7536 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:28.287263 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe313be-d2bd-4a3c-b96b-e58ed1cf7536 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:28.287533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe313be-d2bd-4a3c-b96b-e58ed1cf7536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:28.289345 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4fe313be-d2bd-4a3c-b96b-e58ed1cf7536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:28.401129 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:28.421287 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe313be-d2bd-4a3c-b96b-e58ed1cf7536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:28.423456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe313be-d2bd-4a3c-b96b-e58ed1cf7536 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:28.449822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 712/1425] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:29.458686 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b6a75-e134-4c84-ad5c-01b034d8d9a2 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:29.459468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b6a75-e134-4c84-ad5c-01b034d8d9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:29.459635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b6a75-e134-4c84-ad5c-01b034d8d9a2 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:29.461388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:19:29.467680 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071a538-7b0e-47ba-b730-1b66b395904b None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:29.468323 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071a538-7b0e-47ba-b730-1b66b395904b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:29.468323 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071a538-7b0e-47ba-b730-1b66b395904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:29.569121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c071a538-7b0e-47ba-b730-1b66b395904b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:29.571373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c071a538-7b0e-47ba-b730-1b66b395904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:29.713440 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:29.875936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b6a75-e134-4c84-ad5c-01b034d8d9a2 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:29.878777 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d58b6a75-e134-4c84-ad5c-01b034d8d9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:30.000502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:30.083335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b6a75-e134-4c84-ad5c-01b034d8d9a2 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:30.221393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017fd96-116f-4f5e-981c-8312279a018f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:30.222181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017fd96-116f-4f5e-981c-8312279a018f service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:30.222522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017fd96-116f-4f5e-981c-8312279a018f service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:30.222875 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017fd96-116f-4f5e-981c-8312279a018f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:30.224821 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5017fd96-116f-4f5e-981c-8312279a018f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:30.291496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:30.346506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017fd96-116f-4f5e-981c-8312279a018f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:30.348437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017fd96-116f-4f5e-981c-8312279a018f service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:30.371986 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 715/1428] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:31.303110 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77537b12-56c5-4abb-a13d-42f054d8f33b None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:31.303764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77537b12-56c5-4abb-a13d-42f054d8f33b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:31.304059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77537b12-56c5-4abb-a13d-42f054d8f33b None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:31.306750 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:19:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:31.315950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadab58-be76-4e02-9d85-bffd0e396261 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:31.316559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadab58-be76-4e02-9d85-bffd0e396261 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:31.316846 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadab58-be76-4e02-9d85-bffd0e396261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:31.424633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-fdadab58-be76-4e02-9d85-bffd0e396261 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:31.426030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-fdadab58-be76-4e02-9d85-bffd0e396261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:31.549344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:31.711626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77537b12-56c5-4abb-a13d-42f054d8f33b None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:31.714627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-77537b12-56c5-4abb-a13d-42f054d8f33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:31.807211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:31.937514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77537b12-56c5-4abb-a13d-42f054d8f33b None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:32.089544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b8bc9-87c6-4348-9626-878b82e57517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:32.090083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b8bc9-87c6-4348-9626-878b82e57517 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:32.090360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b8bc9-87c6-4348-9626-878b82e57517 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:32.090626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b8bc9-87c6-4348-9626-878b82e57517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:32.092424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c89b8bc9-87c6-4348-9626-878b82e57517 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:32.101117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:32.218721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b8bc9-87c6-4348-9626-878b82e57517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:32.221090 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b8bc9-87c6-4348-9626-878b82e57517 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:32.245466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 715/1431] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:33.109855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914d365-d518-4bcd-af99-b693ad15f027 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:33.110447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914d365-d518-4bcd-af99-b693ad15f027 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:33.111217 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914d365-d518-4bcd-af99-b693ad15f027 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:33.113841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:19:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:33.120899 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9e25d-7e41-43b3-97e9-2d63d199089e None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:33.121560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9e25d-7e41-43b3-97e9-2d63d199089e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:33.121560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9e25d-7e41-43b3-97e9-2d63d199089e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:33.256418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-6da9e25d-7e41-43b3-97e9-2d63d199089e None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:33.257834 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6da9e25d-7e41-43b3-97e9-2d63d199089e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:33.355443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:33.407429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:33.557611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914d365-d518-4bcd-af99-b693ad15f027 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:33.559391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d914d365-d518-4bcd-af99-b693ad15f027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:33.580738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:33.800930 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914d365-d518-4bcd-af99-b693ad15f027 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:33.945661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:33.977491 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08007ede-3626-4a4a-9a21-6240cf5549ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:33.978110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08007ede-3626-4a4a-9a21-6240cf5549ba service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:33.978382 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08007ede-3626-4a4a-9a21-6240cf5549ba service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:33.978650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08007ede-3626-4a4a-9a21-6240cf5549ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:33.980478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-08007ede-3626-4a4a-9a21-6240cf5549ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:34.104793 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08007ede-3626-4a4a-9a21-6240cf5549ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:34.106607 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08007ede-3626-4a4a-9a21-6240cf5549ba service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:34.129488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 718/1434] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:35.002294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a1140-c85b-4c2f-a677-1d5e8cbacb25 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:35.003014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a1140-c85b-4c2f-a677-1d5e8cbacb25 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:35.003014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a1140-c85b-4c2f-a677-1d5e8cbacb25 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:35.004318 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:35.010369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f412ee-2ba6-4f29-9684-2f28010d6bc0 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:35.010636 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f412ee-2ba6-4f29-9684-2f28010d6bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:35.010929 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f412ee-2ba6-4f29-9684-2f28010d6bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:35.103654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-77f412ee-2ba6-4f29-9684-2f28010d6bc0 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:35.104989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-77f412ee-2ba6-4f29-9684-2f28010d6bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:35.159525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:35.228749 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:35.386662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a1140-c85b-4c2f-a677-1d5e8cbacb25 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:35.387728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-8e0a1140-c85b-4c2f-a677-1d5e8cbacb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:35.570077 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a1140-c85b-4c2f-a677-1d5e8cbacb25 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:35.633832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:35.705215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79a723-e187-4105-b91c-b868a526c7c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:35.705729 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79a723-e187-4105-b91c-b868a526c7c4 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:35.706016 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79a723-e187-4105-b91c-b868a526c7c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:35.706286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79a723-e187-4105-b91c-b868a526c7c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:35.708105 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ad79a723-e187-4105-b91c-b868a526c7c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:35.822694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79a723-e187-4105-b91c-b868a526c7c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:35.824351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79a723-e187-4105-b91c-b868a526c7c4 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:35.845435 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 718/1437] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:36.737049 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0809b-4aaa-4d50-b3f0-51396f23ece9 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:36.737652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0809b-4aaa-4d50-b3f0-51396f23ece9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:36.737652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0809b-4aaa-4d50-b3f0-51396f23ece9 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:36.739186 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:19:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:36.746008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f30c9-b63d-48fb-b989-9ce26131ea2d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:36.746668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f30c9-b63d-48fb-b989-9ce26131ea2d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:36.746668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f30c9-b63d-48fb-b989-9ce26131ea2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:36.842323 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-203f30c9-b63d-48fb-b989-9ce26131ea2d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:36.843839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-203f30c9-b63d-48fb-b989-9ce26131ea2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:36.846596 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:36.967295 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:37.119163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0809b-4aaa-4d50-b3f0-51396f23ece9 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:37.120799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-88c0809b-4aaa-4d50-b3f0-51396f23ece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:37.294476 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0809b-4aaa-4d50-b3f0-51396f23ece9 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:37.327176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:37.436834 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445dda3-9314-4286-ad4d-ad6d063d6474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:37.437551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445dda3-9314-4286-ad4d-ad6d063d6474 service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:37.437894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445dda3-9314-4286-ad4d-ad6d063d6474 service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:37.438200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445dda3-9314-4286-ad4d-ad6d063d6474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:37.440200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5445dda3-9314-4286-ad4d-ad6d063d6474 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:37.550631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445dda3-9314-4286-ad4d-ad6d063d6474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:37.552319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445dda3-9314-4286-ad4d-ad6d063d6474 service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:37.574691 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 721/1440] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:39.590632 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec178d3-37e0-4dab-a61a-972a946919af None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:39.591553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec178d3-37e0-4dab-a61a-972a946919af None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:39.591553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec178d3-37e0-4dab-a61a-972a946919af None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:39.592634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:19:39.599500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203497f6-d474-4a68-bad0-e189f1a2dd45 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:39.600388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203497f6-d474-4a68-bad0-e189f1a2dd45 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:39.600388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203497f6-d474-4a68-bad0-e189f1a2dd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:39.652296 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:39.685522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-203497f6-d474-4a68-bad0-e189f1a2dd45 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:39.686702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-203497f6-d474-4a68-bad0-e189f1a2dd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:39.805251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:39.846248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec178d3-37e0-4dab-a61a-972a946919af None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:39.847996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-aec178d3-37e0-4dab-a61a-972a946919af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:40.003444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec178d3-37e0-4dab-a61a-972a946919af None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:40.065819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:40.119841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794f1cc-2610-4413-acaa-8c8ca1543d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:40.120583 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794f1cc-2610-4413-acaa-8c8ca1543d0c service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:40.120879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794f1cc-2610-4413-acaa-8c8ca1543d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:40.121207 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794f1cc-2610-4413-acaa-8c8ca1543d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:40.123050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f794f1cc-2610-4413-acaa-8c8ca1543d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:40.267045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794f1cc-2610-4413-acaa-8c8ca1543d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:40.270361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794f1cc-2610-4413-acaa-8c8ca1543d0c service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:40.314766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 721/1443] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:42.752172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9d832-4806-43ba-8b9a-9f4ca1193da9 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:42.752930 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9d832-4806-43ba-8b9a-9f4ca1193da9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:42.752930 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9d832-4806-43ba-8b9a-9f4ca1193da9 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:42.754045 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:42.760038 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc0320-67eb-4916-885f-261c6b6399b2 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:42.760586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc0320-67eb-4916-885f-261c6b6399b2 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:42.760586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc0320-67eb-4916-885f-261c6b6399b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:42.846785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-7fbc0320-67eb-4916-885f-261c6b6399b2 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:42.848833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7fbc0320-67eb-4916-885f-261c6b6399b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:42.873339 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:43.014715 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:43.058213 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9d832-4806-43ba-8b9a-9f4ca1193da9 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:43.059819 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-bbc9d832-4806-43ba-8b9a-9f4ca1193da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:43.218149 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9d832-4806-43ba-8b9a-9f4ca1193da9 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:43.243394 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:43.339677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdb8cf-81ee-4c08-bf19-74c28375effc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:43.340593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdb8cf-81ee-4c08-bf19-74c28375effc service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:43.341095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdb8cf-81ee-4c08-bf19-74c28375effc service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:43.341545 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdb8cf-81ee-4c08-bf19-74c28375effc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:43.344709 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5efdb8cf-81ee-4c08-bf19-74c28375effc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:43.510944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdb8cf-81ee-4c08-bf19-74c28375effc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:43.512520 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdb8cf-81ee-4c08-bf19-74c28375effc service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:43.533826 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 724/1446] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:46.409608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3da3b-c07b-4d4f-9ea0-4a1a007ed697 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:46.410499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3da3b-c07b-4d4f-9ea0-4a1a007ed697 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:46.410499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3da3b-c07b-4d4f-9ea0-4a1a007ed697 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:46.412434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:19:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:46.419388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5cbbd-e9e0-4a64-8df7-2933965607b7 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:46.420122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5cbbd-e9e0-4a64-8df7-2933965607b7 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:46.420122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5cbbd-e9e0-4a64-8df7-2933965607b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:46.483008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:46.509534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a0c5cbbd-e9e0-4a64-8df7-2933965607b7 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:46.510779 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a0c5cbbd-e9e0-4a64-8df7-2933965607b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:46.639716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:46.680618 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3da3b-c07b-4d4f-9ea0-4a1a007ed697 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:46.682191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-cbc3da3b-c07b-4d4f-9ea0-4a1a007ed697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:46.827021 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3da3b-c07b-4d4f-9ea0-4a1a007ed697 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:46.875183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:46.934107 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f7e9c-cff2-4771-a5c0-f434ba1ddd3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:46.934730 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f7e9c-cff2-4771-a5c0-f434ba1ddd3d service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:46.935081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f7e9c-cff2-4771-a5c0-f434ba1ddd3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:46.935479 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f7e9c-cff2-4771-a5c0-f434ba1ddd3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:46.937291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-344f7e9c-cff2-4771-a5c0-f434ba1ddd3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:47.089456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f7e9c-cff2-4771-a5c0-f434ba1ddd3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:47.091127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f7e9c-cff2-4771-a5c0-f434ba1ddd3d service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:47.113933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 724/1449] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:49.779762 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606322ff-72b4-4369-bf1d-1a0ced3d2fa5 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:49.779762 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606322ff-72b4-4369-bf1d-1a0ced3d2fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:49.779762 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606322ff-72b4-4369-bf1d-1a0ced3d2fa5 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:49.780940 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:19:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:49.787488 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfceac-5f6b-4b20-9ae7-d4f00923c407 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:49.788208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfceac-5f6b-4b20-9ae7-d4f00923c407 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:49.788208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfceac-5f6b-4b20-9ae7-d4f00923c407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:49.877405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-58bfceac-5f6b-4b20-9ae7-d4f00923c407 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:49.878630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-58bfceac-5f6b-4b20-9ae7-d4f00923c407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:49.904357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:50.001976 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:50.044871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606322ff-72b4-4369-bf1d-1a0ced3d2fa5 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:50.046610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-606322ff-72b4-4369-bf1d-1a0ced3d2fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:50.192349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606322ff-72b4-4369-bf1d-1a0ced3d2fa5 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:50.219917 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:50.287154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2d214-2fb8-40e9-9e5d-b96a33c28244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:50.287847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2d214-2fb8-40e9-9e5d-b96a33c28244 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:50.288057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2d214-2fb8-40e9-9e5d-b96a33c28244 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:50.288286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2d214-2fb8-40e9-9e5d-b96a33c28244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:50.290023 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c4a2d214-2fb8-40e9-9e5d-b96a33c28244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:50.426574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2d214-2fb8-40e9-9e5d-b96a33c28244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:50.428362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2d214-2fb8-40e9-9e5d-b96a33c28244 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:50.449683 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 727/1452] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:52.749881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5e020-3272-4b12-8e55-06f4c28f3043 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:52.750448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5e020-3272-4b12-8e55-06f4c28f3043 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:52.750448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5e020-3272-4b12-8e55-06f4c28f3043 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:52.752167 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:52.758304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d370e1-fa0e-41d5-bb5e-d8817ef7d70f None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:52.759205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d370e1-fa0e-41d5-bb5e-d8817ef7d70f None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:52.759205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d370e1-fa0e-41d5-bb5e-d8817ef7d70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:52.833623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:52.838208 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c2d370e1-fa0e-41d5-bb5e-d8817ef7d70f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:52.840057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c2d370e1-fa0e-41d5-bb5e-d8817ef7d70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:52.963114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:53.007590 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5e020-3272-4b12-8e55-06f4c28f3043 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:53.009159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-cdd5e020-3272-4b12-8e55-06f4c28f3043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:53.140025 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5e020-3272-4b12-8e55-06f4c28f3043 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:53.199703 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:53.229538 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05610c54-70d4-4bc0-9079-dcd79a5b9fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:53.230155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05610c54-70d4-4bc0-9079-dcd79a5b9fde service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:53.230424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05610c54-70d4-4bc0-9079-dcd79a5b9fde service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:53.230688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05610c54-70d4-4bc0-9079-dcd79a5b9fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:53.232430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-05610c54-70d4-4bc0-9079-dcd79a5b9fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:53.368815 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05610c54-70d4-4bc0-9079-dcd79a5b9fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:53.370515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05610c54-70d4-4bc0-9079-dcd79a5b9fde service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:53.392548 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 727/1455] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:55.614054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e278a6-4c76-4e3e-83e6-98636bbb7532 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.614629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e278a6-4c76-4e3e-83e6-98636bbb7532 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.615034 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e278a6-4c76-4e3e-83e6-98636bbb7532 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.617576 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:19:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:55.626707 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816cc4f-6d1c-4567-8eaf-c152a9153cfd None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.627670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816cc4f-6d1c-4567-8eaf-c152a9153cfd None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.627670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816cc4f-6d1c-4567-8eaf-c152a9153cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.710037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-4816cc4f-6d1c-4567-8eaf-c152a9153cfd None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:55.711241 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4816cc4f-6d1c-4567-8eaf-c152a9153cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:55.747090 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:55.831509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:55.884246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e278a6-4c76-4e3e-83e6-98636bbb7532 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:55.886152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-74e278a6-4c76-4e3e-83e6-98636bbb7532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:56.089280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e278a6-4c76-4e3e-83e6-98636bbb7532 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:56.144664 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:56.216375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588371d2-c690-43fe-8734-62d6bff7a909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:56.217383 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588371d2-c690-43fe-8734-62d6bff7a909 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:56.217864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588371d2-c690-43fe-8734-62d6bff7a909 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:56.218325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588371d2-c690-43fe-8734-62d6bff7a909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:56.221454 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-588371d2-c690-43fe-8734-62d6bff7a909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:56.375774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588371d2-c690-43fe-8734-62d6bff7a909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:56.377264 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588371d2-c690-43fe-8734-62d6bff7a909 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:56.397524 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 730/1458] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:58.674320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd969-f6b5-4686-b861-04d02a8ec480 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:58.675265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd969-f6b5-4686-b861-04d02a8ec480 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:58.675265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd969-f6b5-4686-b861-04d02a8ec480 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:58.676907 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:58.684135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683816e6-c10a-4fbb-8ae7-1ce2fdbee69e None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:58.684784 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683816e6-c10a-4fbb-8ae7-1ce2fdbee69e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:58.684784 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683816e6-c10a-4fbb-8ae7-1ce2fdbee69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:58.766948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-683816e6-c10a-4fbb-8ae7-1ce2fdbee69e None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:58.768182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-683816e6-c10a-4fbb-8ae7-1ce2fdbee69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:58.778507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:58.899658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:58.940962 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bd969-f6b5-4686-b861-04d02a8ec480 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:58.942793 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-789bd969-f6b5-4686-b861-04d02a8ec480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:59.080307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bd969-f6b5-4686-b861-04d02a8ec480 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:59.154615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:59.185089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e7ab0-9ab3-4ae7-bc6a-e0c8475e978f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:59.185614 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e7ab0-9ab3-4ae7-bc6a-e0c8475e978f service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:59.185891 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e7ab0-9ab3-4ae7-bc6a-e0c8475e978f service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:59.186161 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e7ab0-9ab3-4ae7-bc6a-e0c8475e978f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:59.187930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-565e7ab0-9ab3-4ae7-bc6a-e0c8475e978f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:59.314332 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e7ab0-9ab3-4ae7-bc6a-e0c8475e978f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:59.315822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e7ab0-9ab3-4ae7-bc6a-e0c8475e978f service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:59.337478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 730/1461] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:01.529987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb982-6248-47e9-8613-208907121bcd None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:01.530644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb982-6248-47e9-8613-208907121bcd None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:01.530644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb982-6248-47e9-8613-208907121bcd None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:01.531915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:20:01.538379 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0dde-20c2-4516-b000-ba80618e2222 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:01.539141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0dde-20c2-4516-b000-ba80618e2222 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:01.539141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0dde-20c2-4516-b000-ba80618e2222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:01.642220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-b72d0dde-20c2-4516-b000-ba80618e2222 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:01.644177 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b72d0dde-20c2-4516-b000-ba80618e2222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:01.718376 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:01.793491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:01.834139 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fb982-6248-47e9-8613-208907121bcd None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:01.835828 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f76fb982-6248-47e9-8613-208907121bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:01.963526 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fb982-6248-47e9-8613-208907121bcd None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:02.010917 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:02.056080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ec6ab-d13d-49f6-a34c-c8e6c3495589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:02.056849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ec6ab-d13d-49f6-a34c-c8e6c3495589 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:02.057249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ec6ab-d13d-49f6-a34c-c8e6c3495589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:02.057622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ec6ab-d13d-49f6-a34c-c8e6c3495589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:02.059677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f01ec6ab-d13d-49f6-a34c-c8e6c3495589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:02.197827 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ec6ab-d13d-49f6-a34c-c8e6c3495589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:02.199511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ec6ab-d13d-49f6-a34c-c8e6c3495589 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:02.221264 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 733/1464] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:20:04.436272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17006059-fc14-4aba-a98c-93f14a13fa11 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:04.437010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17006059-fc14-4aba-a98c-93f14a13fa11 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:04.437010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17006059-fc14-4aba-a98c-93f14a13fa11 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:04.438181 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:20:04.444557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510027-295b-41b3-9e90-82e28737532c None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:04.445181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510027-295b-41b3-9e90-82e28737532c None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:04.445181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510027-295b-41b3-9e90-82e28737532c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:04.562193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-ec510027-295b-41b3-9e90-82e28737532c None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:04.564233 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ec510027-295b-41b3-9e90-82e28737532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:04.598473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:04.698043 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:04.736263 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17006059-fc14-4aba-a98c-93f14a13fa11 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:04.737851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-17006059-fc14-4aba-a98c-93f14a13fa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:04.861260 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17006059-fc14-4aba-a98c-93f14a13fa11 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:04.941494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:04.950698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ac9c4-1b0c-4dd2-97be-f703ef7c7677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:04.951280 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ac9c4-1b0c-4dd2-97be-f703ef7c7677 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:04.951550 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ac9c4-1b0c-4dd2-97be-f703ef7c7677 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:04.951813 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ac9c4-1b0c-4dd2-97be-f703ef7c7677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:04.953530 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6c8ac9c4-1b0c-4dd2-97be-f703ef7c7677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:05.090282 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ac9c4-1b0c-4dd2-97be-f703ef7c7677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:05.093119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ac9c4-1b0c-4dd2-97be-f703ef7c7677 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:05.131631 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 733/1467] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:07.240317 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fee3f9-2c00-4d49-94da-bcd95e41ca8b None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:07.240962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fee3f9-2c00-4d49-94da-bcd95e41ca8b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:07.241276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fee3f9-2c00-4d49-94da-bcd95e41ca8b None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:07.243109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:20:07.249509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dd800-9776-4729-a17e-8e90c881e304 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:07.250132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dd800-9776-4729-a17e-8e90c881e304 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:07.250132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dd800-9776-4729-a17e-8e90c881e304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:07.328254 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-e10dd800-9776-4729-a17e-8e90c881e304 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:07.329488 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e10dd800-9776-4729-a17e-8e90c881e304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:07.424517 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:07.491439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:07.529765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fee3f9-2c00-4d49-94da-bcd95e41ca8b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:07.531395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-48fee3f9-2c00-4d49-94da-bcd95e41ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:07.710476 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fee3f9-2c00-4d49-94da-bcd95e41ca8b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:07.772379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:07.809453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5ab17-4d4e-4a57-9109-aa1f777ed8b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:07.810091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5ab17-4d4e-4a57-9109-aa1f777ed8b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:07.810356 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5ab17-4d4e-4a57-9109-aa1f777ed8b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:07.810610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5ab17-4d4e-4a57-9109-aa1f777ed8b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:07.812403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0dc5ab17-4d4e-4a57-9109-aa1f777ed8b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:07.941735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5ab17-4d4e-4a57-9109-aa1f777ed8b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:07.943269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5ab17-4d4e-4a57-9109-aa1f777ed8b0 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:07.964440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 736/1470] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:17.488270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=22 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:17.961474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=66 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:28.527610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30e813-035f-489e-8aed-924638e45830 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:28.528268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30e813-035f-489e-8aed-924638e45830 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:28.528268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30e813-035f-489e-8aed-924638e45830 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:28.529495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 735/1471] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:20:28.535599 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89026df8-0372-4b6f-82ce-912a2abec146 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:28.536272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89026df8-0372-4b6f-82ce-912a2abec146 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:28.536272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89026df8-0372-4b6f-82ce-912a2abec146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:28.613207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-89026df8-0372-4b6f-82ce-912a2abec146 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:28.614456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-89026df8-0372-4b6f-82ce-912a2abec146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:28.751786 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 737/1472] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:28.846333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d04bc-4612-4fad-bfad-90c6ba730f51 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:28.846584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d04bc-4612-4fad-bfad-90c6ba730f51 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:28.846867 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d04bc-4612-4fad-bfad-90c6ba730f51 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:28.848268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 736/1473] 10.222.0.59 () {54 vars in 967 bytes} [Tue Aug 9 11:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:20:28.855128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1d038-f4ef-4318-86e9-85498addfac2 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:28.855594 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1d038-f4ef-4318-86e9-85498addfac2 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:28.856078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1d038-f4ef-4318-86e9-85498addfac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:29.000756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b7c1d038-f4ef-4318-86e9-85498addfac2 None None] MFA Rules not processed for user `a7f8976306ff477592c6c5b62af60f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:29.001904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b7c1d038-f4ef-4318-86e9-85498addfac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:29.024833 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:29.108649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 738/1474] 10.222.0.59 () {58 vars in 1064 bytes} [Tue Aug 9 11:20:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:29.117269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d04bc-4612-4fad-bfad-90c6ba730f51 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:29.118942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-714d04bc-4612-4fad-bfad-90c6ba730f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:29.238420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d04bc-4612-4fad-bfad-90c6ba730f51 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:29.333897 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f7819-7c21-40a6-a347-2c623be0296c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7f8976306ff477592c6c5b62af60f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:29.334464 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f7819-7c21-40a6-a347-2c623be0296c service glance] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:29.334744 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f7819-7c21-40a6-a347-2c623be0296c service glance] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:29.335067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f7819-7c21-40a6-a347-2c623be0296c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:29.336873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-0c3f7819-7c21-40a6-a347-2c623be0296c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:29.402348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:29.473375 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f7819-7c21-40a6-a347-2c623be0296c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:29.474968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f7819-7c21-40a6-a347-2c623be0296c service glance] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:29.499012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 737/1475] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:31.691244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9af0d-bd13-4362-8656-b5985dd64120 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:31.691892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9af0d-bd13-4362-8656-b5985dd64120 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:31.691892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9af0d-bd13-4362-8656-b5985dd64120 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:31.693045 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 739/1476] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:20:31.699092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6afbc-f230-4ba2-9201-92d84b073a4d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:31.699905 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6afbc-f230-4ba2-9201-92d84b073a4d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:31.699905 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6afbc-f230-4ba2-9201-92d84b073a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:31.779988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-86b6afbc-f230-4ba2-9201-92d84b073a4d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:31.781203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-86b6afbc-f230-4ba2-9201-92d84b073a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:31.916385 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 738/1477] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:31.940645 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9af0d-bd13-4362-8656-b5985dd64120 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:31.942268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-7ac9af0d-bd13-4362-8656-b5985dd64120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:32.093867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9af0d-bd13-4362-8656-b5985dd64120 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:32.147981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:32.202326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c89564-ae52-48d9-8604-f5ac1312afc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:32.202863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c89564-ae52-48d9-8604-f5ac1312afc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:32.203144 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c89564-ae52-48d9-8604-f5ac1312afc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:32.203412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c89564-ae52-48d9-8604-f5ac1312afc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:32.204058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c89564-ae52-48d9-8604-f5ac1312afc4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:32.205902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: WARNING py.warnings [None req-56c89564-ae52-48d9-8604-f5ac1312afc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:20:32.205902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: warnings.warn(msg) Aug 09 11:20:32.205902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: Aug 09 11:20:32.207097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c89564-ae52-48d9-8604-f5ac1312afc4 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:32.230995 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 740/1478] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Aug 9 11:20:31 2022] GET /identity/v3/projects => generated 2553 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:34.303533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba4543-fc5a-4e57-a758-b9922059894b None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:34.304095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba4543-fc5a-4e57-a758-b9922059894b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:34.304095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba4543-fc5a-4e57-a758-b9922059894b None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:34.305949 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 739/1479] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:20:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:20:34.311712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef902e1-14b7-44c4-855a-d686fac07b89 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:34.312305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef902e1-14b7-44c4-855a-d686fac07b89 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:34.312305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef902e1-14b7-44c4-855a-d686fac07b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:34.390719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-4ef902e1-14b7-44c4-855a-d686fac07b89 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:34.392031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-4ef902e1-14b7-44c4-855a-d686fac07b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:34.505070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 741/1480] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:34.551748 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba4543-fc5a-4e57-a758-b9922059894b None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:34.553411 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-96ba4543-fc5a-4e57-a758-b9922059894b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:34.568092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:34.753842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba4543-fc5a-4e57-a758-b9922059894b None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:34.839779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:34.876187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db597d-d8c5-4bb3-b372-ecdee8c4f140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:34.876801 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db597d-d8c5-4bb3-b372-ecdee8c4f140 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:34.877162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db597d-d8c5-4bb3-b372-ecdee8c4f140 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:34.877422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db597d-d8c5-4bb3-b372-ecdee8c4f140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:34.879016 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-02db597d-d8c5-4bb3-b372-ecdee8c4f140 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:34.975435 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db597d-d8c5-4bb3-b372-ecdee8c4f140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:34.977102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db597d-d8c5-4bb3-b372-ecdee8c4f140 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:34.997798 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 740/1481] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:20:37.237173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68b75d-d61f-494b-9ed2-bc4c5787b194 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:37.237835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68b75d-d61f-494b-9ed2-bc4c5787b194 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:37.237835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68b75d-d61f-494b-9ed2-bc4c5787b194 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:37.239647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 742/1482] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:20:37.246150 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9227edd-6689-4a60-95ab-83c1e4ff9fdb None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:37.246695 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9227edd-6689-4a60-95ab-83c1e4ff9fdb None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:37.246695 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9227edd-6689-4a60-95ab-83c1e4ff9fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:37.322609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c9227edd-6689-4a60-95ab-83c1e4ff9fdb None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:37.323910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c9227edd-6689-4a60-95ab-83c1e4ff9fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:37.376647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:37.432826 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 741/1483] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:37.470430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68b75d-d61f-494b-9ed2-bc4c5787b194 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:37.473237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-3b68b75d-d61f-494b-9ed2-bc4c5787b194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:37.505710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:37.602541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68b75d-d61f-494b-9ed2-bc4c5787b194 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:37.685621 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d21d6e-dca8-4de5-b1c4-e45d217c4788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:37.686232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d21d6e-dca8-4de5-b1c4-e45d217c4788 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:37.686501 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d21d6e-dca8-4de5-b1c4-e45d217c4788 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:37.686764 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d21d6e-dca8-4de5-b1c4-e45d217c4788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:37.688525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e4d21d6e-dca8-4de5-b1c4-e45d217c4788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:37.903803 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:37.942841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d21d6e-dca8-4de5-b1c4-e45d217c4788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:37.944197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d21d6e-dca8-4de5-b1c4-e45d217c4788 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:37.963919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 743/1484] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:40.102657 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72180d5-be1a-430a-a777-f5a9a5f62def None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:40.103390 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72180d5-be1a-430a-a777-f5a9a5f62def None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:40.103390 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72180d5-be1a-430a-a777-f5a9a5f62def None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:40.104675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 742/1485] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:20:40.110966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e8d01-e86a-4033-a295-228a011a3fa4 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:40.111531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e8d01-e86a-4033-a295-228a011a3fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:40.111531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e8d01-e86a-4033-a295-228a011a3fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:40.190277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-df4e8d01-e86a-4033-a295-228a011a3fa4 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:40.191517 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-df4e8d01-e86a-4033-a295-228a011a3fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:40.310807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 744/1486] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:40.352120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72180d5-be1a-430a-a777-f5a9a5f62def None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:40.354398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a72180d5-be1a-430a-a777-f5a9a5f62def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:40.488526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72180d5-be1a-430a-a777-f5a9a5f62def None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:40.566589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:40.568401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0e74f-963a-449b-a1ed-8ebb7583a6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:40.569245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0e74f-963a-449b-a1ed-8ebb7583a6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:40.569602 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0e74f-963a-449b-a1ed-8ebb7583a6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:40.569914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0e74f-963a-449b-a1ed-8ebb7583a6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:40.572468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c1e0e74f-963a-449b-a1ed-8ebb7583a6e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:40.695050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0e74f-963a-449b-a1ed-8ebb7583a6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:40.696512 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0e74f-963a-449b-a1ed-8ebb7583a6e6 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:40.716270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 743/1487] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:42.883117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30f89-b2c6-47e1-981c-ff0d2226a24a None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:42.883711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30f89-b2c6-47e1-981c-ff0d2226a24a None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:42.883711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30f89-b2c6-47e1-981c-ff0d2226a24a None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:42.885032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 745/1488] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:20:42.891188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27da54-05ea-4884-b501-40469944c55f None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:42.891942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27da54-05ea-4884-b501-40469944c55f None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:42.891942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27da54-05ea-4884-b501-40469944c55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:42.972012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ea27da54-05ea-4884-b501-40469944c55f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:42.973242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ea27da54-05ea-4884-b501-40469944c55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:43.029854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:43.080745 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 744/1489] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:43.124312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a30f89-b2c6-47e1-981c-ff0d2226a24a None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:43.126054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-49a30f89-b2c6-47e1-981c-ff0d2226a24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:43.174678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:43.253963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a30f89-b2c6-47e1-981c-ff0d2226a24a None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:43.343864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e6d21-5020-40d9-bffb-44134dc2b0f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:43.344511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e6d21-5020-40d9-bffb-44134dc2b0f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:43.344787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e6d21-5020-40d9-bffb-44134dc2b0f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:43.345053 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e6d21-5020-40d9-bffb-44134dc2b0f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:43.346698 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1f3e6d21-5020-40d9-bffb-44134dc2b0f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:43.440633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:43.471705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e6d21-5020-40d9-bffb-44134dc2b0f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:43.473170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e6d21-5020-40d9-bffb-44134dc2b0f7 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:43.495261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 746/1490] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:45.830535 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21a54-7593-4b58-abbb-eb6d0fcc9a0d None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:45.831111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21a54-7593-4b58-abbb-eb6d0fcc9a0d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:45.831111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21a54-7593-4b58-abbb-eb6d0fcc9a0d None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:45.832374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 745/1491] 10.222.0.59 () {54 vars in 927 bytes} [Tue Aug 9 11:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:20:45.838366 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdd991-6575-48b0-bf81-13333f3ef2f0 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:45.838939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdd991-6575-48b0-bf81-13333f3ef2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:45.838939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdd991-6575-48b0-bf81-13333f3ef2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:45.920519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-5afdd991-6575-48b0-bf81-13333f3ef2f0 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:45.921789 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5afdd991-6575-48b0-bf81-13333f3ef2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:46.040136 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 747/1492] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Aug 9 11:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:46.083469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f21a54-7593-4b58-abbb-eb6d0fcc9a0d None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:46.085432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-11f21a54-7593-4b58-abbb-eb6d0fcc9a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:46.233942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f21a54-7593-4b58-abbb-eb6d0fcc9a0d None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:46.318528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637e41d-5c98-48e2-8262-7096528efe74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:46.319192 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637e41d-5c98-48e2-8262-7096528efe74 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:46.319461 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637e41d-5c98-48e2-8262-7096528efe74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:46.319729 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637e41d-5c98-48e2-8262-7096528efe74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:46.321442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c637e41d-5c98-48e2-8262-7096528efe74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:46.331998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:46.455581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637e41d-5c98-48e2-8262-7096528efe74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:46.457064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637e41d-5c98-48e2-8262-7096528efe74 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:46.480375 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 746/1493] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:56.038058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=82 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:56.477383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=50 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:14.352058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0402b4c-5228-4908-9c99-884d743b8238 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:14.352849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0402b4c-5228-4908-9c99-884d743b8238 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:14.352849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0402b4c-5228-4908-9c99-884d743b8238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:14.436395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-e0402b4c-5228-4908-9c99-884d743b8238 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:14.437621 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e0402b4c-5228-4908-9c99-884d743b8238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:14.549555 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 748/1494] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:14.559347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f134-0cb1-4b16-9d65-17648ebe7084 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:14.559953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f134-0cb1-4b16-9d65-17648ebe7084 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:14.559953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f134-0cb1-4b16-9d65-17648ebe7084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:14.651997 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-5e75f134-0cb1-4b16-9d65-17648ebe7084 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:14.653133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-5e75f134-0cb1-4b16-9d65-17648ebe7084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:14.755772 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 747/1495] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:14.762412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0402b4c-5228-4908-9c99-884d743b8238 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:14.763738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e0402b4c-5228-4908-9c99-884d743b8238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:14.776182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0402b4c-5228-4908-9c99-884d743b8238 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:14.844482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:14.883640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d854ec1-a53f-4771-bcd8-afbc80d1e1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:14.884383 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d854ec1-a53f-4771-bcd8-afbc80d1e1ee admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:14.884761 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d854ec1-a53f-4771-bcd8-afbc80d1e1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:14.885130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d854ec1-a53f-4771-bcd8-afbc80d1e1ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:14.885877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d854ec1-a53f-4771-bcd8-afbc80d1e1ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:22:14.886269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d854ec1-a53f-4771-bcd8-afbc80d1e1ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:14.887507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: WARNING py.warnings [None req-9d854ec1-a53f-4771-bcd8-afbc80d1e1ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:22:14.887507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: warnings.warn(msg) Aug 09 11:22:14.887507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: Aug 09 11:22:14.888879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d854ec1-a53f-4771-bcd8-afbc80d1e1ee admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:14.902714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 749/1496] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:22:14.914105 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75f134-0cb1-4b16-9d65-17648ebe7084 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:14.923878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75f134-0cb1-4b16-9d65-17648ebe7084 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:14.989582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:15.028972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f042d-fb3e-463f-9e2d-95adedcaf507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:15.029685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f042d-fb3e-463f-9e2d-95adedcaf507 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:15.029961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f042d-fb3e-463f-9e2d-95adedcaf507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:15.030234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f042d-fb3e-463f-9e2d-95adedcaf507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:15.030933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f042d-fb3e-463f-9e2d-95adedcaf507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:15.032990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: WARNING py.warnings [None req-719f042d-fb3e-463f-9e2d-95adedcaf507 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:22:15.032990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: warnings.warn(msg) Aug 09 11:22:15.032990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: Aug 09 11:22:15.034636 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f042d-fb3e-463f-9e2d-95adedcaf507 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:15.104981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 748/1497] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:22:14 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:22:15.110249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d854ec1-a53f-4771-bcd8-afbc80d1e1ee admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:15.112022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9d854ec1-a53f-4771-bcd8-afbc80d1e1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:15.159478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d854ec1-a53f-4771-bcd8-afbc80d1e1ee admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:15.265068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e688c-4260-499f-b31c-623c1a9c406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:15.265681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e688c-4260-499f-b31c-623c1a9c406d admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:15.265948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e688c-4260-499f-b31c-623c1a9c406d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:15.266193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e688c-4260-499f-b31c-623c1a9c406d admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:15.266873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e688c-4260-499f-b31c-623c1a9c406d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:15.267899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: WARNING py.warnings [None req-de5e688c-4260-499f-b31c-623c1a9c406d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:22:15.267899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: warnings.warn(msg) Aug 09 11:22:15.267899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: Aug 09 11:22:15.269093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e688c-4260-499f-b31c-623c1a9c406d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:15.321902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 750/1498] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:22:15 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:22:15.327604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f042d-fb3e-463f-9e2d-95adedcaf507 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:15.329308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-719f042d-fb3e-463f-9e2d-95adedcaf507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:15.398006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f042d-fb3e-463f-9e2d-95adedcaf507 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:15.497543 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:15.510563 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a5936-0932-4059-9ecd-1e5d2b23f8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:15.511215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a5936-0932-4059-9ecd-1e5d2b23f8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:15.511495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a5936-0932-4059-9ecd-1e5d2b23f8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:15.511764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a5936-0932-4059-9ecd-1e5d2b23f8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:15.512417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a5936-0932-4059-9ecd-1e5d2b23f8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:15.513470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: WARNING py.warnings [None req-893a5936-0932-4059-9ecd-1e5d2b23f8e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:22:15.513470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: warnings.warn(msg) Aug 09 11:22:15.513470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: Aug 09 11:22:15.514361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a5936-0932-4059-9ecd-1e5d2b23f8e9 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:15.527787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 749/1499] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:22:15.532375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e688c-4260-499f-b31c-623c1a9c406d admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:15.533951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-de5e688c-4260-499f-b31c-623c1a9c406d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:15.545700 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e688c-4260-499f-b31c-623c1a9c406d admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:15.571762 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:15.663899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaa055-92d3-4c1b-8fd8-4dd343a8f98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:15.664528 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaa055-92d3-4c1b-8fd8-4dd343a8f98a admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:15.664799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaa055-92d3-4c1b-8fd8-4dd343a8f98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:15.665112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaa055-92d3-4c1b-8fd8-4dd343a8f98a admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:15.665885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aaa055-92d3-4c1b-8fd8-4dd343a8f98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:15.667121 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: WARNING py.warnings [None req-e2aaa055-92d3-4c1b-8fd8-4dd343a8f98a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:22:15.667121 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: warnings.warn(msg) Aug 09 11:22:15.667121 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: Aug 09 11:22:15.668115 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aaa055-92d3-4c1b-8fd8-4dd343a8f98a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:15.683494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 751/1500] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:22:15.688511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a5936-0932-4059-9ecd-1e5d2b23f8e9 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:15.690048 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-893a5936-0932-4059-9ecd-1e5d2b23f8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:15.730580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a5936-0932-4059-9ecd-1e5d2b23f8e9 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:15.851910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9c8ee-8dcb-4f75-b309-95b37063da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:15.852597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9c8ee-8dcb-4f75-b309-95b37063da11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:15.852872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9c8ee-8dcb-4f75-b309-95b37063da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:15.853142 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9c8ee-8dcb-4f75-b309-95b37063da11 admin admin] PATH_INFO: `/v3/projects/c8de725528144211a85e38474393b79b/users/b9d095aed61e46fa86ecd1bdda5c66ac/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:15.879697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9c8ee-8dcb-4f75-b309-95b37063da11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8de725528144211a85e38474393b79b, user_id=b9d095aed61e46fa86ecd1bdda5c66ac, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:15.880786 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: WARNING py.warnings [None req-44a9c8ee-8dcb-4f75-b309-95b37063da11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:22:15.880786 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: warnings.warn(msg) Aug 09 11:22:15.880786 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: Aug 09 11:22:15.883009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9c8ee-8dcb-4f75-b309-95b37063da11 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:15.913469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 750/1501] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:22:15 2022] PUT /identity/v3/projects/c8de725528144211a85e38474393b79b/users/b9d095aed61e46fa86ecd1bdda5c66ac/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:22:15.926526 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a5627-3804-4498-a9cc-bf25c4755918 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:15.926870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a5627-3804-4498-a9cc-bf25c4755918 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:15.927143 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a5627-3804-4498-a9cc-bf25c4755918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:15.987981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-0c1a5627-3804-4498-a9cc-bf25c4755918 None None] MFA Rules not processed for user `b9d095aed61e46fa86ecd1bdda5c66ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:15.989216 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0c1a5627-3804-4498-a9cc-bf25c4755918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:16.086701 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 752/1502] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:22:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:16.101739 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790b507-bf55-49b6-85b0-f126d252e2d4 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:16.102057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790b507-bf55-49b6-85b0-f126d252e2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:16.102301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790b507-bf55-49b6-85b0-f126d252e2d4 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:16.103685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 751/1503] 10.222.0.59 () {54 vars in 964 bytes} [Tue Aug 9 11:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:22:16.109120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619e528-3173-4a26-a3a4-6143cabfd9d0 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:16.109405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619e528-3173-4a26-a3a4-6143cabfd9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:16.109638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619e528-3173-4a26-a3a4-6143cabfd9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:16.142868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:16.191191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-7619e528-3173-4a26-a3a4-6143cabfd9d0 None None] MFA Rules not processed for user `a8bcbc6393d341a7be009f3b8c329e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:16.192459 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-7619e528-3173-4a26-a3a4-6143cabfd9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:16.299479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 753/1504] 10.222.0.59 () {58 vars in 1061 bytes} [Tue Aug 9 11:22:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:16.313583 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790b507-bf55-49b6-85b0-f126d252e2d4 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:16.315176 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c790b507-bf55-49b6-85b0-f126d252e2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:16.372190 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:16.437273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790b507-bf55-49b6-85b0-f126d252e2d4 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:16.530776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35b767-ec09-4ea2-8cd3-c28c082323ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:16.531450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35b767-ec09-4ea2-8cd3-c28c082323ec service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:16.531727 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35b767-ec09-4ea2-8cd3-c28c082323ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:16.531994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35b767-ec09-4ea2-8cd3-c28c082323ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:16.533642 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-bf35b767-ec09-4ea2-8cd3-c28c082323ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:16.654910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35b767-ec09-4ea2-8cd3-c28c082323ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:16.656276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35b767-ec09-4ea2-8cd3-c28c082323ec service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:16.660072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:16.677827 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 752/1505] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:22:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:22:16.726535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40860432-97e2-4d57-9177-589f659d3887 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:16.727103 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40860432-97e2-4d57-9177-589f659d3887 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:16.727103 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40860432-97e2-4d57-9177-589f659d3887 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:16.728431 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 754/1506] 10.222.0.59 () {52 vars in 830 bytes} [Tue Aug 9 11:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:22:16.733054 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35b767-ec09-4ea2-8cd3-c28c082323ec service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:16.734692 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-bf35b767-ec09-4ea2-8cd3-c28c082323ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:16.846953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35b767-ec09-4ea2-8cd3-c28c082323ec service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:16.948733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:16.949466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:16.949670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:16.949931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] PATH_INFO: `/v3/users/b9d095aed61e46fa86ecd1bdda5c66ac` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:16.967048 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d095aed61e46fa86ecd1bdda5c66ac)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:16.968114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: WARNING py.warnings [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:22:16.968114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: warnings.warn(msg) Aug 09 11:22:16.968114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: Aug 09 11:22:16.969342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:16.981119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:17.052194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d095aed61e46fa86ecd1bdda5c66ac'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:17.063925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d095aed61e46fa86ecd1bdda5c66ac'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:17.064712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d095aed61e46fa86ecd1bdda5c66ac'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:17.065417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d095aed61e46fa86ecd1bdda5c66ac'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:17.093100 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d095aed61e46fa86ecd1bdda5c66ac'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:17.115392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 753/1507] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:22:16 2022] DELETE /identity/v3/users/b9d095aed61e46fa86ecd1bdda5c66ac => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:22:17.120097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83012c8-402a-4365-85f0-6ac7ff0628fd None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:17.120351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83012c8-402a-4365-85f0-6ac7ff0628fd None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:17.120625 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83012c8-402a-4365-85f0-6ac7ff0628fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:17.185967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-d83012c8-402a-4365-85f0-6ac7ff0628fd None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:17.187244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d83012c8-402a-4365-85f0-6ac7ff0628fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:17.266377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:17.280025 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 755/1508] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:17.291881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:17.293140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:17.405097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8935886-d1bf-42df-a3ee-c6ba6b3f0c64 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:17.476464 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:17.500774 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936138e-0303-44b6-833d-056c6a8594f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:17.501390 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936138e-0303-44b6-833d-056c6a8594f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:17.501662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936138e-0303-44b6-833d-056c6a8594f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:17.501909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936138e-0303-44b6-833d-056c6a8594f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:17.503620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9936138e-0303-44b6-833d-056c6a8594f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:17.621332 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936138e-0303-44b6-833d-056c6a8594f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:17.622988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936138e-0303-44b6-833d-056c6a8594f2 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:17.645823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 754/1509] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:22:18.075691 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83012c8-402a-4365-85f0-6ac7ff0628fd None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:18.077133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d83012c8-402a-4365-85f0-6ac7ff0628fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:18.089526 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83012c8-402a-4365-85f0-6ac7ff0628fd None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:18.203299 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9e13e-6685-4158-a45e-14c46dcbd070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:18.203950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e13e-6685-4158-a45e-14c46dcbd070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:18.204223 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e13e-6685-4158-a45e-14c46dcbd070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:18.204496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e13e-6685-4158-a45e-14c46dcbd070 admin admin] PATH_INFO: `/v3/projects/c8de725528144211a85e38474393b79b` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:18.216157 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9e13e-6685-4158-a45e-14c46dcbd070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8de725528144211a85e38474393b79b)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:18.217219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: WARNING py.warnings [None req-04c9e13e-6685-4158-a45e-14c46dcbd070 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:22:18.217219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: warnings.warn(msg) Aug 09 11:22:18.217219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: Aug 09 11:22:18.218461 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9e13e-6685-4158-a45e-14c46dcbd070 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:18.286515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-04c9e13e-6685-4158-a45e-14c46dcbd070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8de725528144211a85e38474393b79b', 'request_id': 'req-04c9e13e-6685-4158-a45e-14c46dcbd070'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:18.303045 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-04c9e13e-6685-4158-a45e-14c46dcbd070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8de725528144211a85e38474393b79b', 'request_id': 'req-04c9e13e-6685-4158-a45e-14c46dcbd070'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:18.316554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-04c9e13e-6685-4158-a45e-14c46dcbd070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8de725528144211a85e38474393b79b', 'request_id': 'req-04c9e13e-6685-4158-a45e-14c46dcbd070'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:18.343271 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-04c9e13e-6685-4158-a45e-14c46dcbd070 admin admin] The token cache is being invalidate because project c8de725528144211a85e38474393b79b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:22:18.343548 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-04c9e13e-6685-4158-a45e-14c46dcbd070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:18.344080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-04c9e13e-6685-4158-a45e-14c46dcbd070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:18.345422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 756/1510] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:22:18 2022] DELETE /identity/v3/projects/c8de725528144211a85e38474393b79b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:22:27.642988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=62 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:28.341255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:49.616344 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed8fe6-f96c-49d9-8696-1b5ada07e849 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:49.617007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed8fe6-f96c-49d9-8696-1b5ada07e849 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:49.617007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed8fe6-f96c-49d9-8696-1b5ada07e849 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:49.618215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:23:49.624085 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74af93-a62a-4c18-a37a-6550ff690b3b None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:49.624663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74af93-a62a-4c18-a37a-6550ff690b3b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:49.624663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74af93-a62a-4c18-a37a-6550ff690b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:49.718672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-6e74af93-a62a-4c18-a37a-6550ff690b3b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:49.719865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6e74af93-a62a-4c18-a37a-6550ff690b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:49.844870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:23:50.002428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed8fe6-f96c-49d9-8696-1b5ada07e849 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:50.004810 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ceed8fe6-f96c-49d9-8696-1b5ada07e849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:50.143408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed8fe6-f96c-49d9-8696-1b5ada07e849 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:50.149599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f71e32-2818-4d9b-b5b5-d254e21b7aac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:50.150220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f71e32-2818-4d9b-b5b5-d254e21b7aac service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:50.150489 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f71e32-2818-4d9b-b5b5-d254e21b7aac service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:50.150762 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f71e32-2818-4d9b-b5b5-d254e21b7aac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:50.160068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f71e32-2818-4d9b-b5b5-d254e21b7aac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:50.161694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f71e32-2818-4d9b-b5b5-d254e21b7aac service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:50.172478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 756/1513] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:23:51.025291 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad95a7a-2a71-440a-9d70-6ff20cd0074b None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:51.025844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad95a7a-2a71-440a-9d70-6ff20cd0074b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:51.025844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad95a7a-2a71-440a-9d70-6ff20cd0074b None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:51.027482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:23:51.032961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18462e-e2f5-4ac4-98ee-6dfda56be62f None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:51.033522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18462e-e2f5-4ac4-98ee-6dfda56be62f None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:51.033522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18462e-e2f5-4ac4-98ee-6dfda56be62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:51.054439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-1d18462e-e2f5-4ac4-98ee-6dfda56be62f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:51.055726 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-1d18462e-e2f5-4ac4-98ee-6dfda56be62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:51.064839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:23:51.216846 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad95a7a-2a71-440a-9d70-6ff20cd0074b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:51.237861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad95a7a-2a71-440a-9d70-6ff20cd0074b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:51.244496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc260a9-cb5a-42f6-bff2-e72faf8189aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:51.245118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc260a9-cb5a-42f6-bff2-e72faf8189aa service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:51.245393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc260a9-cb5a-42f6-bff2-e72faf8189aa service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:51.245658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc260a9-cb5a-42f6-bff2-e72faf8189aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:51.255822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469d586-8d60-445e-b47c-3ebda39a8b25 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:51.256077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc260a9-cb5a-42f6-bff2-e72faf8189aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:51.256193 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469d586-8d60-445e-b47c-3ebda39a8b25 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:51.256388 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469d586-8d60-445e-b47c-3ebda39a8b25 None None] PATH_INFO: `/v3` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:51.257715 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 758/1516] 10.222.0.49 () {54 vars in 925 bytes} [Tue Aug 9 11:23:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:23:51.258237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc260a9-cb5a-42f6-bff2-e72faf8189aa service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:51.265511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43d2be-031d-43f9-a539-700aa4b983d6 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:51.265802 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43d2be-031d-43f9-a539-700aa4b983d6 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:51.266080 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43d2be-031d-43f9-a539-700aa4b983d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:51.269818 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 759/1517] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:23:51.353049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-3f43d2be-031d-43f9-a539-700aa4b983d6 None None] MFA Rules not processed for user `a04b584a68cb488492046faa23e15463`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:51.354639 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-3f43d2be-031d-43f9-a539-700aa4b983d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:51.416544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:51.439031 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 759/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Aug 9 11:23:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:24:00.527883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ca875-8fe6-43c6-a258-936be0c65bf5 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:00.528488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ca875-8fe6-43c6-a258-936be0c65bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:00.528488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ca875-8fe6-43c6-a258-936be0c65bf5 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:00.529767 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 760/1519] 10.222.0.59 () {54 vars in 961 bytes} [Tue Aug 9 11:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:24:00.535743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfee38b-b3da-4b73-bf6f-d23c1ec0f537 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:00.536465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfee38b-b3da-4b73-bf6f-d23c1ec0f537 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:00.536582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfee38b-b3da-4b73-bf6f-d23c1ec0f537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:00.558448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-dcfee38b-b3da-4b73-bf6f-d23c1ec0f537 None None] MFA Rules not processed for user `a04b584a68cb488492046faa23e15463`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:24:00.559701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-dcfee38b-b3da-4b73-bf6f-d23c1ec0f537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:00.570841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 760/1520] 10.222.0.59 () {58 vars in 1058 bytes} [Tue Aug 9 11:24:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:24:00.579160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ca875-8fe6-43c6-a258-936be0c65bf5 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:00.595280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ca875-8fe6-43c6-a258-936be0c65bf5 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:00.601001 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e69c1c-0612-44b9-b4ac-c39bd101e404 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:00.601676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69c1c-0612-44b9-b4ac-c39bd101e404 service placement] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:00.601952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69c1c-0612-44b9-b4ac-c39bd101e404 service placement] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:00.602209 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69c1c-0612-44b9-b4ac-c39bd101e404 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:00.616947 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e69c1c-0612-44b9-b4ac-c39bd101e404 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:00.623597 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e69c1c-0612-44b9-b4ac-c39bd101e404 service placement] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:00.637450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 761/1521] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:02.529270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ed842-50bd-4529-a0f5-09c837e2cb48 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:02.529873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ed842-50bd-4529-a0f5-09c837e2cb48 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:02.529873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ed842-50bd-4529-a0f5-09c837e2cb48 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:02.531251 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:24:02.536588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a3786-79fd-4708-ba17-96f83037d2bb None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:02.537116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a3786-79fd-4708-ba17-96f83037d2bb None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:02.537116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a3786-79fd-4708-ba17-96f83037d2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:02.558087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-832a3786-79fd-4708-ba17-96f83037d2bb None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:24:02.559353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-832a3786-79fd-4708-ba17-96f83037d2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:02.568101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:24:02.731308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ed842-50bd-4529-a0f5-09c837e2cb48 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:02.748903 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ed842-50bd-4529-a0f5-09c837e2cb48 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:02.755244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425b044-0563-4dcc-88f0-5126f49ed989 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:02.755867 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425b044-0563-4dcc-88f0-5126f49ed989 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:02.756145 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425b044-0563-4dcc-88f0-5126f49ed989 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:02.756414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425b044-0563-4dcc-88f0-5126f49ed989 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:02.765594 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425b044-0563-4dcc-88f0-5126f49ed989 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:02.767242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425b044-0563-4dcc-88f0-5126f49ed989 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:02.777852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 762/1524] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:03.610722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0f8c1-ea38-4b18-ad56-98daafb43097 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:03.611314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0f8c1-ea38-4b18-ad56-98daafb43097 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:03.611721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0f8c1-ea38-4b18-ad56-98daafb43097 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:03.613480 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:24:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:24:03.619540 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da303a-77b2-4ddd-b7df-14b5f6a9e439 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:03.620106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da303a-77b2-4ddd-b7df-14b5f6a9e439 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:03.620214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da303a-77b2-4ddd-b7df-14b5f6a9e439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:03.640230 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-b1da303a-77b2-4ddd-b7df-14b5f6a9e439 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:24:03.641433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b1da303a-77b2-4ddd-b7df-14b5f6a9e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:03.649581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:24:03.803024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0f8c1-ea38-4b18-ad56-98daafb43097 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:03.820960 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0f8c1-ea38-4b18-ad56-98daafb43097 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:03.830332 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3383c2e-38bf-42c2-b0e9-a52fdf8fc99a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:03.831102 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383c2e-38bf-42c2-b0e9-a52fdf8fc99a service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:03.831456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383c2e-38bf-42c2-b0e9-a52fdf8fc99a service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:03.831725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383c2e-38bf-42c2-b0e9-a52fdf8fc99a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:03.841944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3383c2e-38bf-42c2-b0e9-a52fdf8fc99a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:03.843655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3383c2e-38bf-42c2-b0e9-a52fdf8fc99a service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:03.854974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 764/1527] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:07.831791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4770c0-54e4-41b7-ae4a-c494b13a50a1 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:07.832392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4770c0-54e4-41b7-ae4a-c494b13a50a1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:07.832392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4770c0-54e4-41b7-ae4a-c494b13a50a1 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:07.833666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:24:07.839683 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887ca29-c731-40a6-8d22-1cb2d6566e3e None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:07.840177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887ca29-c731-40a6-8d22-1cb2d6566e3e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:07.840177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887ca29-c731-40a6-8d22-1cb2d6566e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:07.863325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-5887ca29-c731-40a6-8d22-1cb2d6566e3e None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:24:07.864532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5887ca29-c731-40a6-8d22-1cb2d6566e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:07.874769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:24:07.952033 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4770c0-54e4-41b7-ae4a-c494b13a50a1 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:07.954264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-bb4770c0-54e4-41b7-ae4a-c494b13a50a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:08.037155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4770c0-54e4-41b7-ae4a-c494b13a50a1 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:08.041103 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62473cdc-e9dd-4512-87e6-6c58a5d42c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:08.041703 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62473cdc-e9dd-4512-87e6-6c58a5d42c9c service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:08.041974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62473cdc-e9dd-4512-87e6-6c58a5d42c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:08.042231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62473cdc-e9dd-4512-87e6-6c58a5d42c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:08.051693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62473cdc-e9dd-4512-87e6-6c58a5d42c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:08.053118 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62473cdc-e9dd-4512-87e6-6c58a5d42c9c service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:08.062567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 765/1530] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:10.036195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f36fa-beea-4fc6-8cc2-6d5291c0fb65 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:10.036861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f36fa-beea-4fc6-8cc2-6d5291c0fb65 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:10.036861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f36fa-beea-4fc6-8cc2-6d5291c0fb65 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:10.038049 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:24:10.043482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c4b01-a753-4b42-82fc-2c762852108d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:10.043925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c4b01-a753-4b42-82fc-2c762852108d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:10.044032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c4b01-a753-4b42-82fc-2c762852108d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:10.065852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c64c4b01-a753-4b42-82fc-2c762852108d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:24:10.067197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c64c4b01-a753-4b42-82fc-2c762852108d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:10.075811 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:24:10.112812 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f36fa-beea-4fc6-8cc2-6d5291c0fb65 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:10.114688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-601f36fa-beea-4fc6-8cc2-6d5291c0fb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:10.128094 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f36fa-beea-4fc6-8cc2-6d5291c0fb65 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:10.131771 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af703d6-e2b6-44b3-837f-4d0501e1bd53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:10.132372 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af703d6-e2b6-44b3-837f-4d0501e1bd53 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:10.132645 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af703d6-e2b6-44b3-837f-4d0501e1bd53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:10.132910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af703d6-e2b6-44b3-837f-4d0501e1bd53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:10.142677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af703d6-e2b6-44b3-837f-4d0501e1bd53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:10.144139 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af703d6-e2b6-44b3-837f-4d0501e1bd53 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:10.154025 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 767/1533] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:24:13.670668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcba0-0a41-4871-a5af-f0fb808c5f21 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:13.671271 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcba0-0a41-4871-a5af-f0fb808c5f21 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:13.671271 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcba0-0a41-4871-a5af-f0fb808c5f21 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:13.672532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:24:13.677898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ccfa8-c32f-4cfb-95b0-34eeef993f4e None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:13.678332 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ccfa8-c32f-4cfb-95b0-34eeef993f4e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:13.678447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ccfa8-c32f-4cfb-95b0-34eeef993f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:13.686142 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:13.706106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-e74ccfa8-c32f-4cfb-95b0-34eeef993f4e None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:24:13.707904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e74ccfa8-c32f-4cfb-95b0-34eeef993f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:13.721592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:24:14.031248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcba0-0a41-4871-a5af-f0fb808c5f21 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:14.032935 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ac3fcba0-0a41-4871-a5af-f0fb808c5f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:14.120315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcba0-0a41-4871-a5af-f0fb808c5f21 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:14.124389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0f4e2-e8bb-4687-8317-86759e0c4ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:14.125014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0f4e2-e8bb-4687-8317-86759e0c4ead service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:14.125288 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0f4e2-e8bb-4687-8317-86759e0c4ead service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:14.125560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0f4e2-e8bb-4687-8317-86759e0c4ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:14.135978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0f4e2-e8bb-4687-8317-86759e0c4ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:14.137412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0f4e2-e8bb-4687-8317-86759e0c4ead service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:14.147226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 768/1536] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:16.171514 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202b07b-980b-492f-b654-53c5c3643bae None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:16.172114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202b07b-980b-492f-b654-53c5c3643bae None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:16.172114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202b07b-980b-492f-b654-53c5c3643bae None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:16.173435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:24:16.179138 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3162e-d4f8-4a08-bf18-75e1cfeeb5b8 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:16.179683 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3162e-d4f8-4a08-bf18-75e1cfeeb5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:16.179683 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3162e-d4f8-4a08-bf18-75e1cfeeb5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:16.200195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-30c3162e-d4f8-4a08-bf18-75e1cfeeb5b8 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:24:16.201445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-30c3162e-d4f8-4a08-bf18-75e1cfeeb5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:16.209904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:24:16.514229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202b07b-980b-492f-b654-53c5c3643bae None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:16.516180 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1202b07b-980b-492f-b654-53c5c3643bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:16.530405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202b07b-980b-492f-b654-53c5c3643bae None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:16.535137 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946e24d-ec6e-4821-8afb-62a2644ce0d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:16.535749 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946e24d-ec6e-4821-8afb-62a2644ce0d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:16.535988 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946e24d-ec6e-4821-8afb-62a2644ce0d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:16.536255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946e24d-ec6e-4821-8afb-62a2644ce0d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:16.546290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946e24d-ec6e-4821-8afb-62a2644ce0d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:16.547789 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946e24d-ec6e-4821-8afb-62a2644ce0d0 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:16.558071 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 770/1539] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:26.195026 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:26.553592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=8 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:43.415639 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515d483-85d8-4740-99e7-593b757fc0d7 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.417932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515d483-85d8-4740-99e7-593b757fc0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.417932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515d483-85d8-4740-99e7-593b757fc0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.452371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-2515d483-85d8-4740-99e7-593b757fc0d7 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:43.453638 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2515d483-85d8-4740-99e7-593b757fc0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:43.465508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 770/1540] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:43.475213 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a8cfe-192e-4935-a1de-5197be0194c5 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.476219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a8cfe-192e-4935-a1de-5197be0194c5 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.476219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a8cfe-192e-4935-a1de-5197be0194c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.508341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f43a8cfe-192e-4935-a1de-5197be0194c5 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:43.509718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f43a8cfe-192e-4935-a1de-5197be0194c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:43.521131 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 771/1541] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:43.526151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515d483-85d8-4740-99e7-593b757fc0d7 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:43.541039 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515d483-85d8-4740-99e7-593b757fc0d7 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:43.552095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb0c92-8f4c-4bcb-a66d-e288958a2c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:43.553303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0c92-8f4c-4bcb-a66d-e288958a2c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.553797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0c92-8f4c-4bcb-a66d-e288958a2c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.554267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0c92-8f4c-4bcb-a66d-e288958a2c38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.555195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb0c92-8f4c-4bcb-a66d-e288958a2c38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:25:43.555771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb0c92-8f4c-4bcb-a66d-e288958a2c38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:43.557012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: WARNING py.warnings [None req-30bb0c92-8f4c-4bcb-a66d-e288958a2c38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:25:43.557012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: warnings.warn(msg) Aug 09 11:25:43.557012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: Aug 09 11:25:43.558466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb0c92-8f4c-4bcb-a66d-e288958a2c38 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:43.582751 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 771/1542] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:25:43.591086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a8cfe-192e-4935-a1de-5197be0194c5 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:43.596109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0d084-eba2-44ab-ba62-8851e4c3cd87 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.596745 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0d084-eba2-44ab-ba62-8851e4c3cd87 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.597240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0d084-eba2-44ab-ba62-8851e4c3cd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.608448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a8cfe-192e-4935-a1de-5197be0194c5 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:43.615539 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac56f9-ff4a-4911-96cd-2b293bbccea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:43.616178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac56f9-ff4a-4911-96cd-2b293bbccea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.616450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac56f9-ff4a-4911-96cd-2b293bbccea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.616712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac56f9-ff4a-4911-96cd-2b293bbccea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.617610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac56f9-ff4a-4911-96cd-2b293bbccea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:43.618800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: WARNING py.warnings [None req-e4ac56f9-ff4a-4911-96cd-2b293bbccea7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:25:43.618800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: warnings.warn(msg) Aug 09 11:25:43.618800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: Aug 09 11:25:43.620027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac56f9-ff4a-4911-96cd-2b293bbccea7 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:43.638376 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-14f0d084-eba2-44ab-ba62-8851e4c3cd87 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:43.640197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-14f0d084-eba2-44ab-ba62-8851e4c3cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:43.659549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 772/1543] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:43.668581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7e82f-5087-4c6f-a965-cc84eac60fa5 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.669380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7e82f-5087-4c6f-a965-cc84eac60fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.669973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7e82f-5087-4c6f-a965-cc84eac60fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.682054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 772/1544] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:43 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:43.686381 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac56f9-ff4a-4911-96cd-2b293bbccea7 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:43.705390 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-38e7e82f-5087-4c6f-a965-cc84eac60fa5 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:43.707195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-38e7e82f-5087-4c6f-a965-cc84eac60fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:43.776491 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac56f9-ff4a-4911-96cd-2b293bbccea7 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:43.791561 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0e915-d3bf-40b3-abaf-0d812d6d075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:43.792194 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0e915-d3bf-40b3-abaf-0d812d6d075e admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.792470 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0e915-d3bf-40b3-abaf-0d812d6d075e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.792752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0e915-d3bf-40b3-abaf-0d812d6d075e admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.793375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0e915-d3bf-40b3-abaf-0d812d6d075e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:43.795478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0e915-d3bf-40b3-abaf-0d812d6d075e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:43.806690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 773/1545] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:25:43.808897 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607def8-707d-47b5-9adc-8e4d9a6ca263 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.809418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607def8-707d-47b5-9adc-8e4d9a6ca263 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.809933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607def8-707d-47b5-9adc-8e4d9a6ca263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.829920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 773/1546] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:43 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:25:43.831396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcab4ef-b0a1-4da9-9488-cb0d6265f680 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.831687 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcab4ef-b0a1-4da9-9488-cb0d6265f680 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.831948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcab4ef-b0a1-4da9-9488-cb0d6265f680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.851863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-9607def8-707d-47b5-9adc-8e4d9a6ca263 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:43.853222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9607def8-707d-47b5-9adc-8e4d9a6ca263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:43.874128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-bfcab4ef-b0a1-4da9-9488-cb0d6265f680 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:43.875387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-bfcab4ef-b0a1-4da9-9488-cb0d6265f680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:43.876586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 774/1547] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:43.877521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607def8-707d-47b5-9adc-8e4d9a6ca263 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:43.888398 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 774/1548] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:43.889659 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcab4ef-b0a1-4da9-9488-cb0d6265f680 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:43.889775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607def8-707d-47b5-9adc-8e4d9a6ca263 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:43.901415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529936a-0ac3-42c2-9a82-981898c3b7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:43.901701 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcab4ef-b0a1-4da9-9488-cb0d6265f680 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:43.902037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529936a-0ac3-42c2-9a82-981898c3b7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.902308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529936a-0ac3-42c2-9a82-981898c3b7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.902572 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529936a-0ac3-42c2-9a82-981898c3b7f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.903249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529936a-0ac3-42c2-9a82-981898c3b7f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:25:43.903545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529936a-0ac3-42c2-9a82-981898c3b7f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:43.905210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529936a-0ac3-42c2-9a82-981898c3b7f7 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:43.906381 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01fc92-33ff-48a5-bbeb-1a95bfb9759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:43.907055 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01fc92-33ff-48a5-bbeb-1a95bfb9759e admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.907327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01fc92-33ff-48a5-bbeb-1a95bfb9759e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.907594 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01fc92-33ff-48a5-bbeb-1a95bfb9759e admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.908245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01fc92-33ff-48a5-bbeb-1a95bfb9759e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:43.909925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01fc92-33ff-48a5-bbeb-1a95bfb9759e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:43.918117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 775/1549] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:25:43.919879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089e7e-b32a-469f-94ac-91f4c8f03b3b None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.920386 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089e7e-b32a-469f-94ac-91f4c8f03b3b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.920757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089e7e-b32a-469f-94ac-91f4c8f03b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.920876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 775/1550] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:43.925770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fe330-edbc-4d66-8587-e2737a0edf4b None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.925770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fe330-edbc-4d66-8587-e2737a0edf4b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.925770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fe330-edbc-4d66-8587-e2737a0edf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.944810 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-be089e7e-b32a-469f-94ac-91f4c8f03b3b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:43.946040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-be089e7e-b32a-469f-94ac-91f4c8f03b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:43.951180 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-823fe330-edbc-4d66-8587-e2737a0edf4b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:43.952418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-823fe330-edbc-4d66-8587-e2737a0edf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:43.954398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 776/1551] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:43.955817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad58aae-ebf1-4a0d-990c-93c11dc617c7 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.956093 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad58aae-ebf1-4a0d-990c-93c11dc617c7 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.956426 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad58aae-ebf1-4a0d-990c-93c11dc617c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.967944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 776/1552] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:43.970195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428f11d-ad60-41c9-84d9-b9821805516d None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:43.970625 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428f11d-ad60-41c9-84d9-b9821805516d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:43.971179 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428f11d-ad60-41c9-84d9-b9821805516d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:43.986997 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-4ad58aae-ebf1-4a0d-990c-93c11dc617c7 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:43.988287 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4ad58aae-ebf1-4a0d-990c-93c11dc617c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:43.996384 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-7428f11d-ad60-41c9-84d9-b9821805516d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:43.997709 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-7428f11d-ad60-41c9-84d9-b9821805516d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:44.000301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 777/1553] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:44.001695 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61184933-d55e-4819-af23-8d3534cf6fec None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.001977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61184933-d55e-4819-af23-8d3534cf6fec None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.002237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61184933-d55e-4819-af23-8d3534cf6fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.006662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 777/1554] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:44.007896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f9d9b-0776-420e-aa77-0b5d4ace9b62 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.008244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f9d9b-0776-420e-aa77-0b5d4ace9b62 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.008517 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f9d9b-0776-420e-aa77-0b5d4ace9b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.028403 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-61184933-d55e-4819-af23-8d3534cf6fec None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:44.029638 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-61184933-d55e-4819-af23-8d3534cf6fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:44.039124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f27f9d9b-0776-420e-aa77-0b5d4ace9b62 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:44.040335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f27f9d9b-0776-420e-aa77-0b5d4ace9b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:44.040473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 778/1555] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:44.041315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61184933-d55e-4819-af23-8d3534cf6fec None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.054274 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61184933-d55e-4819-af23-8d3534cf6fec None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.055123 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 778/1556] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:44.056071 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f9d9b-0776-420e-aa77-0b5d4ace9b62 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.065029 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bef08-36dc-4a45-8ec0-35db279e7558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.065286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bef08-36dc-4a45-8ec0-35db279e7558 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.065410 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bef08-36dc-4a45-8ec0-35db279e7558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.065591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bef08-36dc-4a45-8ec0-35db279e7558 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.066178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f9d9b-0776-420e-aa77-0b5d4ace9b62 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.066296 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bef08-36dc-4a45-8ec0-35db279e7558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.068961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bef08-36dc-4a45-8ec0-35db279e7558 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.077824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34f356-5007-40f4-b275-7e75371a88de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.078451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34f356-5007-40f4-b275-7e75371a88de admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.078726 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34f356-5007-40f4-b275-7e75371a88de admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.079028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34f356-5007-40f4-b275-7e75371a88de admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.079681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34f356-5007-40f4-b275-7e75371a88de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.081313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34f356-5007-40f4-b275-7e75371a88de admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.092423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 779/1557] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:44.093901 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049f3f5-08e6-4f58-a34c-771579ea0248 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.094064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049f3f5-08e6-4f58-a34c-771579ea0248 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.094376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049f3f5-08e6-4f58-a34c-771579ea0248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.101714 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 779/1558] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/projects => generated 393 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:44.103523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd97e3-01a4-4b4c-83b7-86995d0d6cff None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.103523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd97e3-01a4-4b4c-83b7-86995d0d6cff None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.103763 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd97e3-01a4-4b4c-83b7-86995d0d6cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.118717 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-5049f3f5-08e6-4f58-a34c-771579ea0248 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:44.119979 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5049f3f5-08e6-4f58-a34c-771579ea0248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:44.124235 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-a7fd97e3-01a4-4b4c-83b7-86995d0d6cff None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:44.125663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a7fd97e3-01a4-4b4c-83b7-86995d0d6cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:44.186470 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 780/1559] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:44.187284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049f3f5-08e6-4f58-a34c-771579ea0248 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.197616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 780/1560] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:44.197616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad579e-7fb4-40d1-bf2a-8a10812015a8 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.197616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad579e-7fb4-40d1-bf2a-8a10812015a8 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.197616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad579e-7fb4-40d1-bf2a-8a10812015a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.200132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:44.204318 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049f3f5-08e6-4f58-a34c-771579ea0248 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.210116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd134fdc-1b8e-4a1f-841c-37e17c5aa6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.210734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd134fdc-1b8e-4a1f-841c-37e17c5aa6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.211039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd134fdc-1b8e-4a1f-841c-37e17c5aa6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.211309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd134fdc-1b8e-4a1f-841c-37e17c5aa6f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.211962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd134fdc-1b8e-4a1f-841c-37e17c5aa6f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:25:44.212259 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd134fdc-1b8e-4a1f-841c-37e17c5aa6f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.213905 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd134fdc-1b8e-4a1f-841c-37e17c5aa6f5 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.215304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-8aad579e-7fb4-40d1-bf2a-8a10812015a8 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:44.216483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-8aad579e-7fb4-40d1-bf2a-8a10812015a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:44.224873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 781/1561] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:44.226485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f1268-91b9-40dd-8087-dd73ad792eb9 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.226761 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f1268-91b9-40dd-8087-dd73ad792eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.227065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f1268-91b9-40dd-8087-dd73ad792eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.234706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 781/1562] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:25:44.234706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd134fdc-1b8e-4a1f-841c-37e17c5aa6f5 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.241470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:44.244106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd134fdc-1b8e-4a1f-841c-37e17c5aa6f5 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.247465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-2a4f1268-91b9-40dd-8087-dd73ad792eb9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:44.249042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2a4f1268-91b9-40dd-8087-dd73ad792eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:44.249516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990a3f5-fe32-44fb-8ffb-c86eae4f1d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.250134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990a3f5-fe32-44fb-8ffb-c86eae4f1d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.250405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990a3f5-fe32-44fb-8ffb-c86eae4f1d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.250666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990a3f5-fe32-44fb-8ffb-c86eae4f1d4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.252445 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990a3f5-fe32-44fb-8ffb-c86eae4f1d4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:25:44.252747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990a3f5-fe32-44fb-8ffb-c86eae4f1d4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.254369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990a3f5-fe32-44fb-8ffb-c86eae4f1d4c admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.257623 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 782/1563] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:44.258445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f1268-91b9-40dd-8087-dd73ad792eb9 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.268707 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 782/1564] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:25:44.269546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990a3f5-fe32-44fb-8ffb-c86eae4f1d4c admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.269691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f1268-91b9-40dd-8087-dd73ad792eb9 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.274450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c81be1-0c43-47c0-b995-0382b94fd2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.275168 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c81be1-0c43-47c0-b995-0382b94fd2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.275438 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c81be1-0c43-47c0-b995-0382b94fd2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.275709 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c81be1-0c43-47c0-b995-0382b94fd2f7 admin admin] PATH_INFO: `/v3/projects/6c60c68e5637481bba22ab515ee1698c/users/22876106e28646eabfcfb43e191bccd7/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.280500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990a3f5-fe32-44fb-8ffb-c86eae4f1d4c admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.285671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b1395-5dd6-46f9-a401-9f21ced28e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.286367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1395-5dd6-46f9-a401-9f21ced28e88 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.286637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1395-5dd6-46f9-a401-9f21ced28e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.286928 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1395-5dd6-46f9-a401-9f21ced28e88 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.287563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b1395-5dd6-46f9-a401-9f21ced28e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.289478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b1395-5dd6-46f9-a401-9f21ced28e88 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.292612 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c81be1-0c43-47c0-b995-0382b94fd2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c60c68e5637481bba22ab515ee1698c, user_id=22876106e28646eabfcfb43e191bccd7, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.295331 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c81be1-0c43-47c0-b995-0382b94fd2f7 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.311407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 783/1565] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:44 2022] PUT /identity/v3/projects/6c60c68e5637481bba22ab515ee1698c/users/22876106e28646eabfcfb43e191bccd7/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:44.312285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c81be1-0c43-47c0-b995-0382b94fd2f7 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.318264 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 783/1566] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:44.318264 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b1395-5dd6-46f9-a401-9f21ced28e88 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.332171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b1395-5dd6-46f9-a401-9f21ced28e88 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.384144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c81be1-0c43-47c0-b995-0382b94fd2f7 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.388829 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b5daa-f70b-4af2-8aa7-001cfc4be385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.389440 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b5daa-f70b-4af2-8aa7-001cfc4be385 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.389704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b5daa-f70b-4af2-8aa7-001cfc4be385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.389965 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b5daa-f70b-4af2-8aa7-001cfc4be385 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.390349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0c1ca-0593-4302-b027-fa3eef025abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.390613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b5daa-f70b-4af2-8aa7-001cfc4be385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:25:44.390935 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b5daa-f70b-4af2-8aa7-001cfc4be385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.391063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0c1ca-0593-4302-b027-fa3eef025abd admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.391265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0c1ca-0593-4302-b027-fa3eef025abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.391537 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0c1ca-0593-4302-b027-fa3eef025abd admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.392195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0c1ca-0593-4302-b027-fa3eef025abd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:25:44.392496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0c1ca-0593-4302-b027-fa3eef025abd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.392602 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b5daa-f70b-4af2-8aa7-001cfc4be385 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.394106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0c1ca-0593-4302-b027-fa3eef025abd admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.405662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 784/1567] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:25:44.407742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b5daa-f70b-4af2-8aa7-001cfc4be385 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.413694 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 784/1568] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:25:44.416072 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0c1ca-0593-4302-b027-fa3eef025abd admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.418209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b5daa-f70b-4af2-8aa7-001cfc4be385 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.423149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371734e9-7126-43d7-862a-bc403c46b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.423776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371734e9-7126-43d7-862a-bc403c46b383 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.424044 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371734e9-7126-43d7-862a-bc403c46b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.424307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371734e9-7126-43d7-862a-bc403c46b383 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.424951 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371734e9-7126-43d7-862a-bc403c46b383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:25:44.425244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371734e9-7126-43d7-862a-bc403c46b383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.426896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0c1ca-0593-4302-b027-fa3eef025abd admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.427030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371734e9-7126-43d7-862a-bc403c46b383 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.431486 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fcc4c-d60f-4581-924d-600d18191c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.432089 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fcc4c-d60f-4581-924d-600d18191c32 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.432356 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fcc4c-d60f-4581-924d-600d18191c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.432617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fcc4c-d60f-4581-924d-600d18191c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.433238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fcc4c-d60f-4581-924d-600d18191c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.435173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fcc4c-d60f-4581-924d-600d18191c32 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.439714 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 785/1569] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:25:44.440480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371734e9-7126-43d7-862a-bc403c46b383 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.453427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371734e9-7126-43d7-862a-bc403c46b383 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.458315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e917-6458-43c7-abb9-82b7f85c5b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.459000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e917-6458-43c7-abb9-82b7f85c5b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.459261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e917-6458-43c7-abb9-82b7f85c5b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.459525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e917-6458-43c7-abb9-82b7f85c5b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.460170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676e917-6458-43c7-abb9-82b7f85c5b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:25:44.460503 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676e917-6458-43c7-abb9-82b7f85c5b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.462420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676e917-6458-43c7-abb9-82b7f85c5b70 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.480200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 785/1570] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:44.482395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fcc4c-d60f-4581-924d-600d18191c32 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.486855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 786/1571] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:25:44.486855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e917-6458-43c7-abb9-82b7f85c5b70 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.501909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e917-6458-43c7-abb9-82b7f85c5b70 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.564409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fcc4c-d60f-4581-924d-600d18191c32 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.569338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daff2c-0a2e-4d40-94a9-f85dc0b2afc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.569957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daff2c-0a2e-4d40-94a9-f85dc0b2afc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.570219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44001e7-0b25-4d30-99ba-12d2f5762a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.570345 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daff2c-0a2e-4d40-94a9-f85dc0b2afc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.570490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daff2c-0a2e-4d40-94a9-f85dc0b2afc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.570902 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44001e7-0b25-4d30-99ba-12d2f5762a21 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.571164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44001e7-0b25-4d30-99ba-12d2f5762a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.571309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20daff2c-0a2e-4d40-94a9-f85dc0b2afc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.571414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44001e7-0b25-4d30-99ba-12d2f5762a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.572058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44001e7-0b25-4d30-99ba-12d2f5762a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.573247 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20daff2c-0a2e-4d40-94a9-f85dc0b2afc3 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.573636 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44001e7-0b25-4d30-99ba-12d2f5762a21 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.584903 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 787/1572] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:44.585636 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b841-270d-4e5e-b8f0-ae708ce2bfe3 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.586059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b841-270d-4e5e-b8f0-ae708ce2bfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.586183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b841-270d-4e5e-b8f0-ae708ce2bfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.606931 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 786/1573] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:44.607837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daff2c-0a2e-4d40-94a9-f85dc0b2afc3 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.617608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-dd11b841-270d-4e5e-b8f0-ae708ce2bfe3 None None] MFA Rules not processed for user `22876106e28646eabfcfb43e191bccd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:44.618791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-dd11b841-270d-4e5e-b8f0-ae708ce2bfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:44.626501 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:44.648412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:44.674722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daff2c-0a2e-4d40-94a9-f85dc0b2afc3 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.680080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3fd72-8dbd-484a-be73-d28d714ff916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.681072 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3fd72-8dbd-484a-be73-d28d714ff916 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.681561 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3fd72-8dbd-484a-be73-d28d714ff916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.681861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3fd72-8dbd-484a-be73-d28d714ff916 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.682559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3fd72-8dbd-484a-be73-d28d714ff916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.684885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3fd72-8dbd-484a-be73-d28d714ff916 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.687387 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 788/1574] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:44.688206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11b841-270d-4e5e-b8f0-ae708ce2bfe3 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.699257 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11b841-270d-4e5e-b8f0-ae708ce2bfe3 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.703725 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74492ef-228f-4e4a-8d87-482a2b3d46e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.704347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74492ef-228f-4e4a-8d87-482a2b3d46e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.704618 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74492ef-228f-4e4a-8d87-482a2b3d46e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.704897 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74492ef-228f-4e4a-8d87-482a2b3d46e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.705525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74492ef-228f-4e4a-8d87-482a2b3d46e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.707504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74492ef-228f-4e4a-8d87-482a2b3d46e0 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.724081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 787/1575] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:44.724081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3fd72-8dbd-484a-be73-d28d714ff916 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.744888 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 789/1576] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:44.746414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74492ef-228f-4e4a-8d87-482a2b3d46e0 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.792900 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3fd72-8dbd-484a-be73-d28d714ff916 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.807285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74492ef-228f-4e4a-8d87-482a2b3d46e0 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.811971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df8cd5-324d-4a74-9c74-063b90b5dac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.812581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df8cd5-324d-4a74-9c74-063b90b5dac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.812861 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df8cd5-324d-4a74-9c74-063b90b5dac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.813149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df8cd5-324d-4a74-9c74-063b90b5dac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.813776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df8cd5-324d-4a74-9c74-063b90b5dac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.814806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: WARNING py.warnings [None req-30df8cd5-324d-4a74-9c74-063b90b5dac6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:25:44.814806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: warnings.warn(msg) Aug 09 11:25:44.814806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: Aug 09 11:25:44.816034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df8cd5-324d-4a74-9c74-063b90b5dac6 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.841458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 790/1577] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:44.841458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df8cd5-324d-4a74-9c74-063b90b5dac6 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.849141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df8cd5-324d-4a74-9c74-063b90b5dac6 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.850038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dfea8-554f-4ac5-ad36-f354bdd86889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.851068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dfea8-554f-4ac5-ad36-f354bdd86889 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.851347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dfea8-554f-4ac5-ad36-f354bdd86889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.851640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dfea8-554f-4ac5-ad36-f354bdd86889 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.852275 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dfea8-554f-4ac5-ad36-f354bdd86889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.854152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc37c59-71b0-4ca8-8d1e-d02296262f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.854288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dfea8-554f-4ac5-ad36-f354bdd86889 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.854741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc37c59-71b0-4ca8-8d1e-d02296262f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.855051 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc37c59-71b0-4ca8-8d1e-d02296262f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.855317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc37c59-71b0-4ca8-8d1e-d02296262f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.855936 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc37c59-71b0-4ca8-8d1e-d02296262f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.857818 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc37c59-71b0-4ca8-8d1e-d02296262f97 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.881544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 788/1578] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:44.882353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dfea8-554f-4ac5-ad36-f354bdd86889 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.885854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 791/1579] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:44.886831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc37c59-71b0-4ca8-8d1e-d02296262f97 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.923344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:44.947870 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc37c59-71b0-4ca8-8d1e-d02296262f97 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.948957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dfea8-554f-4ac5-ad36-f354bdd86889 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.952737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c54a66-4ae0-46d6-b8c5-aae45398769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.953294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c54a66-4ae0-46d6-b8c5-aae45398769e admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.953575 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c54a66-4ae0-46d6-b8c5-aae45398769e admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.953685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63088489-7d01-4389-9382-c97339cc838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.953845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c54a66-4ae0-46d6-b8c5-aae45398769e admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.954203 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63088489-7d01-4389-9382-c97339cc838a admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.954476 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63088489-7d01-4389-9382-c97339cc838a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.954574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c54a66-4ae0-46d6-b8c5-aae45398769e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.954741 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63088489-7d01-4389-9382-c97339cc838a admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.955407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63088489-7d01-4389-9382-c97339cc838a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.956485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c54a66-4ae0-46d6-b8c5-aae45398769e admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.957028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63088489-7d01-4389-9382-c97339cc838a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:44.967125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 789/1580] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:44.968339 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62dcc8-7b92-4b26-9e08-75183d7efe74 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.968619 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62dcc8-7b92-4b26-9e08-75183d7efe74 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.968880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62dcc8-7b92-4b26-9e08-75183d7efe74 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.970095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 790/1581] 10.222.0.59 () {54 vars in 962 bytes} [Tue Aug 9 11:25:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:25:44.975255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62dcc8-7b92-4b26-9e08-75183d7efe74 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.983725 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 792/1582] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:44.984767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c54a66-4ae0-46d6-b8c5-aae45398769e admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:44.989214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62dcc8-7b92-4b26-9e08-75183d7efe74 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.991709 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:44.994680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd51c50-0d0f-4cfb-812d-420bf5f85963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:44.995461 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd51c50-0d0f-4cfb-812d-420bf5f85963 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:44.995746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd51c50-0d0f-4cfb-812d-420bf5f85963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:44.995868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c54a66-4ae0-46d6-b8c5-aae45398769e admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:44.996060 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd51c50-0d0f-4cfb-812d-420bf5f85963 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:44.996644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd51c50-0d0f-4cfb-812d-420bf5f85963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:44.998783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd51c50-0d0f-4cfb-812d-420bf5f85963 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.001855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bd782-6256-4f8b-be77-715e561a3252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.002468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bd782-6256-4f8b-be77-715e561a3252 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.002747 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bd782-6256-4f8b-be77-715e561a3252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.003068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bd782-6256-4f8b-be77-715e561a3252 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.003701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bd782-6256-4f8b-be77-715e561a3252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.005641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bd782-6256-4f8b-be77-715e561a3252 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.021408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 791/1583] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/users => generated 286 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:45.022329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd51c50-0d0f-4cfb-812d-420bf5f85963 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.035509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd51c50-0d0f-4cfb-812d-420bf5f85963 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.041196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 793/1584] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:44 2022] POST /identity/v3/users => generated 294 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:45.041196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bd782-6256-4f8b-be77-715e561a3252 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.043701 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ffb8b-84df-4295-9b23-101502ac324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.044325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ffb8b-84df-4295-9b23-101502ac324e admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.044601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ffb8b-84df-4295-9b23-101502ac324e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.044868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ffb8b-84df-4295-9b23-101502ac324e admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.045529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ffb8b-84df-4295-9b23-101502ac324e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.047200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ffb8b-84df-4295-9b23-101502ac324e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.049133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bd782-6256-4f8b-be77-715e561a3252 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.054559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766816a7-ee0c-4eeb-9ca7-dd90913d06df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.055233 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766816a7-ee0c-4eeb-9ca7-dd90913d06df admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.055478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766816a7-ee0c-4eeb-9ca7-dd90913d06df admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.055796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766816a7-ee0c-4eeb-9ca7-dd90913d06df admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.056427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766816a7-ee0c-4eeb-9ca7-dd90913d06df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.058344 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766816a7-ee0c-4eeb-9ca7-dd90913d06df admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.058978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 792/1585] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:45.059951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ffb8b-84df-4295-9b23-101502ac324e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.071887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ffb8b-84df-4295-9b23-101502ac324e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.076886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705b4da-9fc5-41a4-9ba2-9df8f554d50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.077511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705b4da-9fc5-41a4-9ba2-9df8f554d50d admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.077787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705b4da-9fc5-41a4-9ba2-9df8f554d50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.078058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705b4da-9fc5-41a4-9ba2-9df8f554d50d admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.078688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705b4da-9fc5-41a4-9ba2-9df8f554d50d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.080694 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705b4da-9fc5-41a4-9ba2-9df8f554d50d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.083288 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 794/1586] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:45 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:45.084080 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766816a7-ee0c-4eeb-9ca7-dd90913d06df admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.094755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766816a7-ee0c-4eeb-9ca7-dd90913d06df admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.099795 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207c71d-528b-4a51-ab55-ed320f6a0b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.100495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c71d-528b-4a51-ab55-ed320f6a0b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.101142 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c71d-528b-4a51-ab55-ed320f6a0b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.101395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c71d-528b-4a51-ab55-ed320f6a0b02 admin admin] PATH_INFO: `/v3/projects/b0a6fd5299a7475bad7836d22b23967d/users/8f9dc600fea34effa2afa8aee54aab7e/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.106306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 793/1587] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:45 2022] POST /identity/v3/users => generated 282 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:45.106306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cbc57-4d67-4dff-b126-012b5f57965c None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.106306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cbc57-4d67-4dff-b126-012b5f57965c None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.106306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cbc57-4d67-4dff-b126-012b5f57965c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.117122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207c71d-528b-4a51-ab55-ed320f6a0b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a6fd5299a7475bad7836d22b23967d, user_id=8f9dc600fea34effa2afa8aee54aab7e, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.119817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207c71d-528b-4a51-ab55-ed320f6a0b02 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.134487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 795/1588] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:45 2022] PUT /identity/v3/projects/b0a6fd5299a7475bad7836d22b23967d/users/8f9dc600fea34effa2afa8aee54aab7e/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:45.135757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207c71d-528b-4a51-ab55-ed320f6a0b02 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.144624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f46cbc57-4d67-4dff-b126-012b5f57965c None None] MFA Rules not processed for user `2136cf1160a64951ad780424cb28403b`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:45.145868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f46cbc57-4d67-4dff-b126-012b5f57965c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:45.198302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207c71d-528b-4a51-ab55-ed320f6a0b02 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.203405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6ff97-0795-4bd5-986f-904887da65b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.203953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6ff97-0795-4bd5-986f-904887da65b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.204236 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6ff97-0795-4bd5-986f-904887da65b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.204505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6ff97-0795-4bd5-986f-904887da65b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.205163 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6ff97-0795-4bd5-986f-904887da65b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.206781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6ff97-0795-4bd5-986f-904887da65b8 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.220574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 796/1589] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:45.220787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 794/1590] 10.222.0.59 () {58 vars in 1059 bytes} [Tue Aug 9 11:25:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:45.220920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6ff97-0795-4bd5-986f-904887da65b8 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.226246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cbc57-4d67-4dff-b126-012b5f57965c None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.232477 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6ff97-0795-4bd5-986f-904887da65b8 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.236708 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cbc57-4d67-4dff-b126-012b5f57965c None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.237651 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcbf74-283c-4eda-ab4a-5b304babb24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.238268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcbf74-283c-4eda-ab4a-5b304babb24d admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.238544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcbf74-283c-4eda-ab4a-5b304babb24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.238878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcbf74-283c-4eda-ab4a-5b304babb24d admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.239693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcbf74-283c-4eda-ab4a-5b304babb24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.241303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcbf74-283c-4eda-ab4a-5b304babb24d admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.241593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96d851-d178-4f2e-b189-f1738f69c7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.241998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96d851-d178-4f2e-b189-f1738f69c7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.242270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96d851-d178-4f2e-b189-f1738f69c7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.242700 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96d851-d178-4f2e-b189-f1738f69c7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.243214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96d851-d178-4f2e-b189-f1738f69c7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.244822 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96d851-d178-4f2e-b189-f1738f69c7f5 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.251893 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 797/1591] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:45.252751 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcbf74-283c-4eda-ab4a-5b304babb24d admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.258712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 795/1592] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:45.260258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96d851-d178-4f2e-b189-f1738f69c7f5 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.263328 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcbf74-283c-4eda-ab4a-5b304babb24d admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.268210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6acb7-e9a9-4cea-802b-d33f2e7a4987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.268812 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6acb7-e9a9-4cea-802b-d33f2e7a4987 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.269083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6acb7-e9a9-4cea-802b-d33f2e7a4987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.269355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6acb7-e9a9-4cea-802b-d33f2e7a4987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.270013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6acb7-e9a9-4cea-802b-d33f2e7a4987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.270770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96d851-d178-4f2e-b189-f1738f69c7f5 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.271656 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6acb7-e9a9-4cea-802b-d33f2e7a4987 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.275571 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa3984-072d-4ab5-8cb0-dc1573e1081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.276178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa3984-072d-4ab5-8cb0-dc1573e1081f admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.276443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa3984-072d-4ab5-8cb0-dc1573e1081f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.276706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa3984-072d-4ab5-8cb0-dc1573e1081f admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.277344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa3984-072d-4ab5-8cb0-dc1573e1081f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.278980 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa3984-072d-4ab5-8cb0-dc1573e1081f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.283988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 798/1593] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:45.284846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6acb7-e9a9-4cea-802b-d33f2e7a4987 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.289989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 796/1594] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:45.291570 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2865c11-7d29-44da-bba7-106d99a331c7 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.291857 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2865c11-7d29-44da-bba7-106d99a331c7 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.292120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2865c11-7d29-44da-bba7-106d99a331c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.298083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6acb7-e9a9-4cea-802b-d33f2e7a4987 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.305589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46945a11-9b62-4a57-83aa-d95cc43052ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.306207 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46945a11-9b62-4a57-83aa-d95cc43052ab admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.306479 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46945a11-9b62-4a57-83aa-d95cc43052ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.306724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46945a11-9b62-4a57-83aa-d95cc43052ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.307404 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46945a11-9b62-4a57-83aa-d95cc43052ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.309023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46945a11-9b62-4a57-83aa-d95cc43052ab admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.312844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c2865c11-7d29-44da-bba7-106d99a331c7 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:45.314112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c2865c11-7d29-44da-bba7-106d99a331c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:45.320163 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 799/1595] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:45.321054 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46945a11-9b62-4a57-83aa-d95cc43052ab admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.324415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 797/1596] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:45.325324 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2865c11-7d29-44da-bba7-106d99a331c7 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.337117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46945a11-9b62-4a57-83aa-d95cc43052ab admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.340426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2865c11-7d29-44da-bba7-106d99a331c7 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.342944 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adc524-aa1d-4a17-94c8-3a9955d532b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.343199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adc524-aa1d-4a17-94c8-3a9955d532b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.343472 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adc524-aa1d-4a17-94c8-3a9955d532b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.343740 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adc524-aa1d-4a17-94c8-3a9955d532b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.344384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adc524-aa1d-4a17-94c8-3a9955d532b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.345982 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adc524-aa1d-4a17-94c8-3a9955d532b1 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.346460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd692f33-7878-4bfe-b264-f2e1f665f200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.347220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd692f33-7878-4bfe-b264-f2e1f665f200 service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.347492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd692f33-7878-4bfe-b264-f2e1f665f200 service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.347755 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd692f33-7878-4bfe-b264-f2e1f665f200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.362185 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 800/1597] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:45.362185 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adc524-aa1d-4a17-94c8-3a9955d532b1 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.369626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adc524-aa1d-4a17-94c8-3a9955d532b1 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.375041 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdd5b4-6e72-4d82-86a4-1ed7cb59b6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.375749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdd5b4-6e72-4d82-86a4-1ed7cb59b6cf admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.376152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdd5b4-6e72-4d82-86a4-1ed7cb59b6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.376660 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdd5b4-6e72-4d82-86a4-1ed7cb59b6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.377585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdd5b4-6e72-4d82-86a4-1ed7cb59b6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.379401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdd5b4-6e72-4d82-86a4-1ed7cb59b6cf admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.389871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:45.392808 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 801/1598] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:45.393548 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdd5b4-6e72-4d82-86a4-1ed7cb59b6cf admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.410846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdd5b4-6e72-4d82-86a4-1ed7cb59b6cf admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.416500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae3780-aa2c-45b3-b7da-a4ab48ad546c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.417266 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae3780-aa2c-45b3-b7da-a4ab48ad546c admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.417541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae3780-aa2c-45b3-b7da-a4ab48ad546c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.417810 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae3780-aa2c-45b3-b7da-a4ab48ad546c admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.418455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae3780-aa2c-45b3-b7da-a4ab48ad546c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.420108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae3780-aa2c-45b3-b7da-a4ab48ad546c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.423523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd692f33-7878-4bfe-b264-f2e1f665f200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.425111 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd692f33-7878-4bfe-b264-f2e1f665f200 service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.430592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 802/1599] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:45.431420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae3780-aa2c-45b3-b7da-a4ab48ad546c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.435028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 798/1600] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:45.435875 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd692f33-7878-4bfe-b264-f2e1f665f200 service nova] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.442506 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae3780-aa2c-45b3-b7da-a4ab48ad546c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.445814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd692f33-7878-4bfe-b264-f2e1f665f200 service nova] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.448139 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9ef19-4196-43f6-84df-468ae4bf7e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.448819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9ef19-4196-43f6-84df-468ae4bf7e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.449058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9ef19-4196-43f6-84df-468ae4bf7e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.449335 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9ef19-4196-43f6-84df-468ae4bf7e84 admin admin] PATH_INFO: `/v3/projects/ec50a06edc0445e798202c786b37aa19/users/00b3cd9e2c3e48c299037759cab9ccce/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.451019 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edf2c9-2ac8-42fe-9350-b54bd1c8151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.451660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edf2c9-2ac8-42fe-9350-b54bd1c8151a admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.452026 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edf2c9-2ac8-42fe-9350-b54bd1c8151a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.452350 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edf2c9-2ac8-42fe-9350-b54bd1c8151a admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.452975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edf2c9-2ac8-42fe-9350-b54bd1c8151a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.454623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edf2c9-2ac8-42fe-9350-b54bd1c8151a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.468276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 799/1601] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:45.468276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edf2c9-2ac8-42fe-9350-b54bd1c8151a admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.469848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9ef19-4196-43f6-84df-468ae4bf7e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec50a06edc0445e798202c786b37aa19, user_id=00b3cd9e2c3e48c299037759cab9ccce, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.472608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9ef19-4196-43f6-84df-468ae4bf7e84 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.480220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edf2c9-2ac8-42fe-9350-b54bd1c8151a admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.487387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0687e66-7b6b-4fac-bf92-677329ef0063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.487998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0687e66-7b6b-4fac-bf92-677329ef0063 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.488260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0687e66-7b6b-4fac-bf92-677329ef0063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.488522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0687e66-7b6b-4fac-bf92-677329ef0063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.489270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0687e66-7b6b-4fac-bf92-677329ef0063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.494114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 803/1602] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:45 2022] PUT /identity/v3/projects/ec50a06edc0445e798202c786b37aa19/users/00b3cd9e2c3e48c299037759cab9ccce/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:45.494266 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0687e66-7b6b-4fac-bf92-677329ef0063 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.494366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9ef19-4196-43f6-84df-468ae4bf7e84 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.501773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 800/1603] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:45.503985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0687e66-7b6b-4fac-bf92-677329ef0063 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.507667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:45.516225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0687e66-7b6b-4fac-bf92-677329ef0063 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.558362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9ef19-4196-43f6-84df-468ae4bf7e84 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.562321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39209ad3-d9b0-4fc7-aed9-76eef9a458b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.563008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39209ad3-d9b0-4fc7-aed9-76eef9a458b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.563314 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39209ad3-d9b0-4fc7-aed9-76eef9a458b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.563562 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39209ad3-d9b0-4fc7-aed9-76eef9a458b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.578950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50076b9f-f6d8-46e0-b6bf-0ab35e3838d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.579723 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50076b9f-f6d8-46e0-b6bf-0ab35e3838d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.580039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50076b9f-f6d8-46e0-b6bf-0ab35e3838d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.580351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50076b9f-f6d8-46e0-b6bf-0ab35e3838d5 admin admin] PATH_INFO: `/v3/projects/cd5f40c54a2b48a7ab38e3fab17297c2/users/5d3f21263efa468ab687c8f443988d76/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.595893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50076b9f-f6d8-46e0-b6bf-0ab35e3838d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5f40c54a2b48a7ab38e3fab17297c2, user_id=5d3f21263efa468ab687c8f443988d76, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.597338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: WARNING py.warnings [None req-50076b9f-f6d8-46e0-b6bf-0ab35e3838d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:25:45.597338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: warnings.warn(msg) Aug 09 11:25:45.597338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: Aug 09 11:25:45.600017 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50076b9f-f6d8-46e0-b6bf-0ab35e3838d5 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.619501 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 801/1604] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:45 2022] PUT /identity/v3/projects/cd5f40c54a2b48a7ab38e3fab17297c2/users/5d3f21263efa468ab687c8f443988d76/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:45.620908 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50076b9f-f6d8-46e0-b6bf-0ab35e3838d5 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.636493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39209ad3-d9b0-4fc7-aed9-76eef9a458b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.637946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39209ad3-d9b0-4fc7-aed9-76eef9a458b3 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.648235 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 804/1605] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:45.649133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39209ad3-d9b0-4fc7-aed9-76eef9a458b3 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.660069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39209ad3-d9b0-4fc7-aed9-76eef9a458b3 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.710575 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50076b9f-f6d8-46e0-b6bf-0ab35e3838d5 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.718412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6ff1f-e027-4b8b-95d8-3fe1d2756130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.719446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6ff1f-e027-4b8b-95d8-3fe1d2756130 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.719722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6ff1f-e027-4b8b-95d8-3fe1d2756130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.719993 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6ff1f-e027-4b8b-95d8-3fe1d2756130 admin admin] PATH_INFO: `/v3/projects/0008ea6d586e4d34a3f505d9d9893034/users/a353be6a7032483a96a85524196b0e8c/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.724559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0e241-b044-4aff-a2a0-e1ebd72a05b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.725231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0e241-b044-4aff-a2a0-e1ebd72a05b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.725509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0e241-b044-4aff-a2a0-e1ebd72a05b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.726148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0e241-b044-4aff-a2a0-e1ebd72a05b8 admin admin] PATH_INFO: `/v3/projects/a8b7219dc6b640f48e8a869dd65ccd25/users/1720108a01cd4648b08d1e02928b6720/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.740362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6ff1f-e027-4b8b-95d8-3fe1d2756130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0008ea6d586e4d34a3f505d9d9893034, user_id=a353be6a7032483a96a85524196b0e8c, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.743762 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6ff1f-e027-4b8b-95d8-3fe1d2756130 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.745628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0e241-b044-4aff-a2a0-e1ebd72a05b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b7219dc6b640f48e8a869dd65ccd25, user_id=1720108a01cd4648b08d1e02928b6720, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.748980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0e241-b044-4aff-a2a0-e1ebd72a05b8 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.760048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 802/1606] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:45 2022] PUT /identity/v3/projects/0008ea6d586e4d34a3f505d9d9893034/users/a353be6a7032483a96a85524196b0e8c/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:45.760852 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6ff1f-e027-4b8b-95d8-3fe1d2756130 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.762858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 805/1607] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:45 2022] PUT /identity/v3/projects/a8b7219dc6b640f48e8a869dd65ccd25/users/1720108a01cd4648b08d1e02928b6720/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:45.764131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1cba0-5bf8-46e1-99a5-9b217ca5c781 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.764440 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1cba0-5bf8-46e1-99a5-9b217ca5c781 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.764677 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1cba0-5bf8-46e1-99a5-9b217ca5c781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.785104 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-cbb1cba0-5bf8-46e1-99a5-9b217ca5c781 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:45.786357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-cbb1cba0-5bf8-46e1-99a5-9b217ca5c781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:45.792098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:45.830111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:45.856725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6ff1f-e027-4b8b-95d8-3fe1d2756130 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.862018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb17b6-ceef-4e2c-b1b1-aa36f729d32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.862806 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb17b6-ceef-4e2c-b1b1-aa36f729d32b admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.863195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb17b6-ceef-4e2c-b1b1-aa36f729d32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.863539 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb17b6-ceef-4e2c-b1b1-aa36f729d32b admin admin] PATH_INFO: `/v3/projects/73d1d7152cc64ac1948d1a97b6b63bd2/users/8512df3e232c4fd59b7abad4e6e05c9d/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.864335 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 806/1608] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:45.864763 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1cba0-5bf8-46e1-99a5-9b217ca5c781 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:45.875787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1cba0-5bf8-46e1-99a5-9b217ca5c781 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:45.880475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841cf2d-daf6-44a0-8dea-adcf6f4073de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:45.881144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841cf2d-daf6-44a0-8dea-adcf6f4073de admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.881421 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841cf2d-daf6-44a0-8dea-adcf6f4073de admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.881693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841cf2d-daf6-44a0-8dea-adcf6f4073de admin admin] PATH_INFO: `/v3/projects/1c89430a03ef4c01bf85dd14b4b98cc9/users/378498d664a34611a48c06455ec4ac5a/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.884280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb17b6-ceef-4e2c-b1b1-aa36f729d32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d1d7152cc64ac1948d1a97b6b63bd2, user_id=8512df3e232c4fd59b7abad4e6e05c9d, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.887484 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb17b6-ceef-4e2c-b1b1-aa36f729d32b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.897445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841cf2d-daf6-44a0-8dea-adcf6f4073de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c89430a03ef4c01bf85dd14b4b98cc9, user_id=378498d664a34611a48c06455ec4ac5a, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:45.900258 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841cf2d-daf6-44a0-8dea-adcf6f4073de admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:45.905474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 803/1609] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:45 2022] PUT /identity/v3/projects/73d1d7152cc64ac1948d1a97b6b63bd2/users/8512df3e232c4fd59b7abad4e6e05c9d/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:45.907068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366fabe-0f74-4460-9a20-d0fe14ca532f None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.907349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366fabe-0f74-4460-9a20-d0fe14ca532f None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.907628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366fabe-0f74-4460-9a20-d0fe14ca532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.921218 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 807/1610] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:45 2022] PUT /identity/v3/projects/1c89430a03ef4c01bf85dd14b4b98cc9/users/378498d664a34611a48c06455ec4ac5a/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:45.923530 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043dcee-bfc1-49e0-a79c-09bcdd65696d None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.923985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043dcee-bfc1-49e0-a79c-09bcdd65696d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.924146 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043dcee-bfc1-49e0-a79c-09bcdd65696d None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.926061 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 808/1611] 10.222.0.59 () {54 vars in 912 bytes} [Tue Aug 9 11:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:25:45.927320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c97e9b-625f-4a3a-97d3-b53a2cb0f691 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:45.927606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c97e9b-625f-4a3a-97d3-b53a2cb0f691 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:45.927974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c97e9b-625f-4a3a-97d3-b53a2cb0f691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:45.944540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-0366fabe-0f74-4460-9a20-d0fe14ca532f None None] MFA Rules not processed for user `5d3f21263efa468ab687c8f443988d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:45.946080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0366fabe-0f74-4460-9a20-d0fe14ca532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:45.960045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-33c97e9b-625f-4a3a-97d3-b53a2cb0f691 None None] MFA Rules not processed for user `a353be6a7032483a96a85524196b0e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:45.961368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-33c97e9b-625f-4a3a-97d3-b53a2cb0f691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:46.022050 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 804/1612] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:46.024161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63676a03-62bd-4f3b-a735-8e24db9d6b4d None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.024435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63676a03-62bd-4f3b-a735-8e24db9d6b4d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.024701 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63676a03-62bd-4f3b-a735-8e24db9d6b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.051783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 809/1613] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:46.052734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c97e9b-625f-4a3a-97d3-b53a2cb0f691 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:46.066538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-63676a03-62bd-4f3b-a735-8e24db9d6b4d None None] MFA Rules not processed for user `1720108a01cd4648b08d1e02928b6720`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:46.068269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-63676a03-62bd-4f3b-a735-8e24db9d6b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:46.130548 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c97e9b-625f-4a3a-97d3-b53a2cb0f691 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:46.135402 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ad0df-b8dc-4f90-ae43-04a68d261103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:46.136143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ad0df-b8dc-4f90-ae43-04a68d261103 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.136421 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ad0df-b8dc-4f90-ae43-04a68d261103 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.136812 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ad0df-b8dc-4f90-ae43-04a68d261103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.157373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 805/1614] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:46.157373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f196-d93a-4b49-8ccf-0b357fa1cd52 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.157373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f196-d93a-4b49-8ccf-0b357fa1cd52 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.157373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f196-d93a-4b49-8ccf-0b357fa1cd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.178392 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-6650f196-d93a-4b49-8ccf-0b357fa1cd52 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:46.179991 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6650f196-d93a-4b49-8ccf-0b357fa1cd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:46.193577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:46.214481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ad0df-b8dc-4f90-ae43-04a68d261103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:46.216015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ad0df-b8dc-4f90-ae43-04a68d261103 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:46.221682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:46.228365 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 810/1615] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:46.229858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9146e7-54a6-40af-b5aa-f07d765ea065 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.231205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9146e7-54a6-40af-b5aa-f07d765ea065 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.231486 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9146e7-54a6-40af-b5aa-f07d765ea065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.253619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-2f9146e7-54a6-40af-b5aa-f07d765ea065 None None] MFA Rules not processed for user `2136cf1160a64951ad780424cb28403b`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:46.254966 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2f9146e7-54a6-40af-b5aa-f07d765ea065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:46.269451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 806/1616] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:46.273022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff2834-a7ae-4d07-9fc5-8ef62866caa6 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.273022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff2834-a7ae-4d07-9fc5-8ef62866caa6 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.273022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff2834-a7ae-4d07-9fc5-8ef62866caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.314560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-66ff2834-a7ae-4d07-9fc5-8ef62866caa6 None None] MFA Rules not processed for user `378498d664a34611a48c06455ec4ac5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:46.316792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-66ff2834-a7ae-4d07-9fc5-8ef62866caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:46.348300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 811/1617] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:25:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:46.357782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9146e7-54a6-40af-b5aa-f07d765ea065 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:46.372670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9146e7-54a6-40af-b5aa-f07d765ea065 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:46.378791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85920981-8bf4-4120-ab92-bbcda27e7faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:46.379549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85920981-8bf4-4120-ab92-bbcda27e7faa admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.380848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85920981-8bf4-4120-ab92-bbcda27e7faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.381122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85920981-8bf4-4120-ab92-bbcda27e7faa admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.381833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85920981-8bf4-4120-ab92-bbcda27e7faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:46.383923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85920981-8bf4-4120-ab92-bbcda27e7faa admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:46.434087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 812/1618] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:46 2022] POST /identity/v3/projects => generated 363 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:46.437595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a8fbf-c80f-4f8e-bb96-fd0e7d806d30 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.437595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a8fbf-c80f-4f8e-bb96-fd0e7d806d30 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.437786 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a8fbf-c80f-4f8e-bb96-fd0e7d806d30 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.438581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 807/1619] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:46.448336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff2834-a7ae-4d07-9fc5-8ef62866caa6 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:46.461337 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff2834-a7ae-4d07-9fc5-8ef62866caa6 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:46.474845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 813/1620] 10.222.0.59 () {54 vars in 962 bytes} [Tue Aug 9 11:25:46 2022] GET /identity => generated 270 bytes in 40 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:25:46.480520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a8fbf-c80f-4f8e-bb96-fd0e7d806d30 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:46.544783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec735689-1ecd-45a4-a79f-ee21d1e41856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:46.545690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec735689-1ecd-45a4-a79f-ee21d1e41856 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.545966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec735689-1ecd-45a4-a79f-ee21d1e41856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.546587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec735689-1ecd-45a4-a79f-ee21d1e41856 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.547290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec735689-1ecd-45a4-a79f-ee21d1e41856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:46.549489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec735689-1ecd-45a4-a79f-ee21d1e41856 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:46.585064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a8fbf-c80f-4f8e-bb96-fd0e7d806d30 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:46.592598 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ba1df-30ef-4daa-81c0-fe43891ea677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:46.593772 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ba1df-30ef-4daa-81c0-fe43891ea677 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.594458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ba1df-30ef-4daa-81c0-fe43891ea677 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.595028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 808/1621] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:46 2022] POST /identity/v3/projects => generated 389 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:46.595623 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ba1df-30ef-4daa-81c0-fe43891ea677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.595811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec735689-1ecd-45a4-a79f-ee21d1e41856 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:46.612202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ba1df-30ef-4daa-81c0-fe43891ea677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:46.615172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ba1df-30ef-4daa-81c0-fe43891ea677 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:46.629046 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 814/1622] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:46.629972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ba1df-30ef-4daa-81c0-fe43891ea677 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:46.645215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ba1df-30ef-4daa-81c0-fe43891ea677 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:46.650788 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:46.671145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec735689-1ecd-45a4-a79f-ee21d1e41856 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:46.675589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34343df8-bb4f-4ffe-abd6-0b5f17a256c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:46.676456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343df8-bb4f-4ffe-abd6-0b5f17a256c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.676831 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343df8-bb4f-4ffe-abd6-0b5f17a256c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.677196 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343df8-bb4f-4ffe-abd6-0b5f17a256c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.738460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a262d-e1a3-4765-ae9f-d3be51607ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:46.739055 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a262d-e1a3-4765-ae9f-d3be51607ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.739791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a262d-e1a3-4765-ae9f-d3be51607ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.740080 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a262d-e1a3-4765-ae9f-d3be51607ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.740711 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a262d-e1a3-4765-ae9f-d3be51607ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:46.743483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a262d-e1a3-4765-ae9f-d3be51607ef9 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:46.777384 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34343df8-bb4f-4ffe-abd6-0b5f17a256c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:46.777626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 815/1623] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:46 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:46.778883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a262d-e1a3-4765-ae9f-d3be51607ef9 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:46.779416 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34343df8-bb4f-4ffe-abd6-0b5f17a256c6 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:46.786693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:46.796114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 809/1624] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:46.797750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a1f4b-e4a4-4d8f-b0f7-0e695a474183 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.798097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a1f4b-e4a4-4d8f-b0f7-0e695a474183 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.798490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a1f4b-e4a4-4d8f-b0f7-0e695a474183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.799681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a262d-e1a3-4765-ae9f-d3be51607ef9 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:46.809047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f5c4b-bc53-483d-a503-72b562096d80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:46.811113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f5c4b-bc53-483d-a503-72b562096d80 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.814914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f5c4b-bc53-483d-a503-72b562096d80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.815441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f5c4b-bc53-483d-a503-72b562096d80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.823428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-521a1f4b-e4a4-4d8f-b0f7-0e695a474183 None None] MFA Rules not processed for user `2136cf1160a64951ad780424cb28403b`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:46.825090 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-521a1f4b-e4a4-4d8f-b0f7-0e695a474183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:46.848311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 810/1625] 10.222.0.59 () {58 vars in 1059 bytes} [Tue Aug 9 11:25:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:46.849464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a1f4b-e4a4-4d8f-b0f7-0e695a474183 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:46.862231 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a1f4b-e4a4-4d8f-b0f7-0e695a474183 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:46.867382 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a0d9c-a3f0-4326-bd3b-5902b80d0a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:46.868096 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a0d9c-a3f0-4326-bd3b-5902b80d0a38 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.868473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a0d9c-a3f0-4326-bd3b-5902b80d0a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.869283 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a0d9c-a3f0-4326-bd3b-5902b80d0a38 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.869699 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a0d9c-a3f0-4326-bd3b-5902b80d0a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:46.871735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a0d9c-a3f0-4326-bd3b-5902b80d0a38 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:46.912886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 811/1626] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:46 2022] POST /identity/v3/users => generated 301 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:46.914750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a0d9c-a3f0-4326-bd3b-5902b80d0a38 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:46.930425 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a0d9c-a3f0-4326-bd3b-5902b80d0a38 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:46.936179 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfc09f-a7f0-44f8-9e2b-2a25fce0dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:46.938290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfc09f-a7f0-44f8-9e2b-2a25fce0dbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.938658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfc09f-a7f0-44f8-9e2b-2a25fce0dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.939205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfc09f-a7f0-44f8-9e2b-2a25fce0dbf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:46.939926 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfc09f-a7f0-44f8-9e2b-2a25fce0dbf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:46.943683 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfc09f-a7f0-44f8-9e2b-2a25fce0dbf7 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:46.972579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 812/1627] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:46.972964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfc09f-a7f0-44f8-9e2b-2a25fce0dbf7 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:46.974970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f5c4b-bc53-483d-a503-72b562096d80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:46.976693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f5c4b-bc53-483d-a503-72b562096d80 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:46.991095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfc09f-a7f0-44f8-9e2b-2a25fce0dbf7 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:46.998095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f2a4f-df9b-40b1-a3bb-d59fc057f68a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:46.998095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f2a4f-df9b-40b1-a3bb-d59fc057f68a service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:46.998306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f2a4f-df9b-40b1-a3bb-d59fc057f68a service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:46.998585 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f2a4f-df9b-40b1-a3bb-d59fc057f68a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:47.020742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 816/1628] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:47.021964 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f5c4b-bc53-483d-a503-72b562096d80 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:47.064789 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f5c4b-bc53-483d-a503-72b562096d80 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:47.079743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca2ebb-42c7-46ac-a778-ad1130b583bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:47.082469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca2ebb-42c7-46ac-a778-ad1130b583bd admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:47.082907 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca2ebb-42c7-46ac-a778-ad1130b583bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:47.083180 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca2ebb-42c7-46ac-a778-ad1130b583bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:47.083750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f2a4f-df9b-40b1-a3bb-d59fc057f68a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:47.083869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca2ebb-42c7-46ac-a778-ad1130b583bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:47.087903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f2a4f-df9b-40b1-a3bb-d59fc057f68a service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:47.092679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca2ebb-42c7-46ac-a778-ad1130b583bd admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:47.116261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 813/1629] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:47.119558 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 817/1630] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:47.132914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca2ebb-42c7-46ac-a778-ad1130b583bd admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:47.135519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f2a4f-df9b-40b1-a3bb-d59fc057f68a service nova] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:47.150438 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca2ebb-42c7-46ac-a778-ad1130b583bd admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:47.165595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b05cd6-36f9-4482-a34d-c34558424bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:47.167212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b05cd6-36f9-4482-a34d-c34558424bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:47.167512 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b05cd6-36f9-4482-a34d-c34558424bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:47.167789 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b05cd6-36f9-4482-a34d-c34558424bbc admin admin] PATH_INFO: `/v3/projects/9a8d533d9cb54377bc373ffb18154902/users/6f58eb3a6c354bada4b57444ccb6f1fc/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:47.194056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f2a4f-df9b-40b1-a3bb-d59fc057f68a service nova] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:47.202253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b05cd6-36f9-4482-a34d-c34558424bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8d533d9cb54377bc373ffb18154902, user_id=6f58eb3a6c354bada4b57444ccb6f1fc, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:47.204942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b05cd6-36f9-4482-a34d-c34558424bbc admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:47.216082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aae1e-40b6-4fa8-9e2c-9466e33b3e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:47.219530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aae1e-40b6-4fa8-9e2c-9466e33b3e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:47.220387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aae1e-40b6-4fa8-9e2c-9466e33b3e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:47.221397 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aae1e-40b6-4fa8-9e2c-9466e33b3e18 admin admin] PATH_INFO: `/v3/projects/3359543b86a5456493955a9f1f1ce419/users/fe14889e128c4cd7ba5d63e0883bf796/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:47.242956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 818/1631] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:47 2022] PUT /identity/v3/projects/9a8d533d9cb54377bc373ffb18154902/users/6f58eb3a6c354bada4b57444ccb6f1fc/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:47.246091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b05cd6-36f9-4482-a34d-c34558424bbc admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:47.263822 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11aae1e-40b6-4fa8-9e2c-9466e33b3e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3359543b86a5456493955a9f1f1ce419, user_id=fe14889e128c4cd7ba5d63e0883bf796, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:47.273125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11aae1e-40b6-4fa8-9e2c-9466e33b3e18 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:47.303493 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 814/1632] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:47 2022] PUT /identity/v3/projects/3359543b86a5456493955a9f1f1ce419/users/fe14889e128c4cd7ba5d63e0883bf796/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:47.311256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aae1e-40b6-4fa8-9e2c-9466e33b3e18 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:47.366676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:47.420619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b05cd6-36f9-4482-a34d-c34558424bbc admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:47.482721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aae1e-40b6-4fa8-9e2c-9466e33b3e18 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:47.501234 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91909e-25ff-4de7-a2ed-9c90944a3e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:47.502129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91909e-25ff-4de7-a2ed-9c90944a3e80 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:47.502407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91909e-25ff-4de7-a2ed-9c90944a3e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:47.504177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91909e-25ff-4de7-a2ed-9c90944a3e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:47.506698 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91909e-25ff-4de7-a2ed-9c90944a3e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:47.508638 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0def3-cb56-4925-ac67-c2854cb6ed8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:47.510097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0def3-cb56-4925-ac67-c2854cb6ed8f admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:47.510884 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0def3-cb56-4925-ac67-c2854cb6ed8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:47.511392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0def3-cb56-4925-ac67-c2854cb6ed8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:47.512109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91909e-25ff-4de7-a2ed-9c90944a3e80 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:47.512603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0def3-cb56-4925-ac67-c2854cb6ed8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:47.514961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0def3-cb56-4925-ac67-c2854cb6ed8f admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:47.529004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 819/1633] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:47.533456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0def3-cb56-4925-ac67-c2854cb6ed8f admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:47.537850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 815/1634] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:47.543384 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91909e-25ff-4de7-a2ed-9c90944a3e80 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:47.565531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0def3-cb56-4925-ac67-c2854cb6ed8f admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:47.577793 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91909e-25ff-4de7-a2ed-9c90944a3e80 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:47.584525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa87c0-faf4-4820-be01-dcfa288cf3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:47.587475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa87c0-faf4-4820-be01-dcfa288cf3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:47.588532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa87c0-faf4-4820-be01-dcfa288cf3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:47.592268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa87c0-faf4-4820-be01-dcfa288cf3bc admin admin] PATH_INFO: `/v3/projects/9a8d533d9cb54377bc373ffb18154902/users/6f58eb3a6c354bada4b57444ccb6f1fc/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:47.597587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503c0e9-2941-4ae5-86c7-da3237c0b458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:47.607177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503c0e9-2941-4ae5-86c7-da3237c0b458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:47.608614 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa87c0-faf4-4820-be01-dcfa288cf3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8d533d9cb54377bc373ffb18154902, user_id=6f58eb3a6c354bada4b57444ccb6f1fc, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:47.610408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503c0e9-2941-4ae5-86c7-da3237c0b458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:47.611163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503c0e9-2941-4ae5-86c7-da3237c0b458 admin admin] PATH_INFO: `/v3/projects/3359543b86a5456493955a9f1f1ce419/users/fe14889e128c4cd7ba5d63e0883bf796/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:47.619489 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa87c0-faf4-4820-be01-dcfa288cf3bc admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:47.625886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503c0e9-2941-4ae5-86c7-da3237c0b458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3359543b86a5456493955a9f1f1ce419, user_id=fe14889e128c4cd7ba5d63e0883bf796, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:47.634678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503c0e9-2941-4ae5-86c7-da3237c0b458 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:47.640966 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:47.671992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 820/1635] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:47 2022] PUT /identity/v3/projects/9a8d533d9cb54377bc373ffb18154902/users/6f58eb3a6c354bada4b57444ccb6f1fc/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:47.676705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 816/1636] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:47 2022] PUT /identity/v3/projects/3359543b86a5456493955a9f1f1ce419/users/fe14889e128c4cd7ba5d63e0883bf796/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:47.685983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21959765-b6af-4f82-81cc-55084cb4f9e3 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:47.685983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21959765-b6af-4f82-81cc-55084cb4f9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:47.685983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21959765-b6af-4f82-81cc-55084cb4f9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:47.692783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533419f-c4ae-46c4-a05b-c24fd1ca4551 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:47.693069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533419f-c4ae-46c4-a05b-c24fd1ca4551 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:47.693344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533419f-c4ae-46c4-a05b-c24fd1ca4551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:47.801665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-21959765-b6af-4f82-81cc-55084cb4f9e3 None None] MFA Rules not processed for user `6f58eb3a6c354bada4b57444ccb6f1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:47.802942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-21959765-b6af-4f82-81cc-55084cb4f9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:47.803966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-6533419f-c4ae-46c4-a05b-c24fd1ca4551 None None] MFA Rules not processed for user `fe14889e128c4cd7ba5d63e0883bf796`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:47.811797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6533419f-c4ae-46c4-a05b-c24fd1ca4551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:47.965722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 817/1637] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:25:47.965722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24d2b-3899-4a4a-9d50-7e6167eae38d None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:47.965722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24d2b-3899-4a4a-9d50-7e6167eae38d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:47.965722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24d2b-3899-4a4a-9d50-7e6167eae38d None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:47.975931 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 818/1638] 10.222.0.59 () {54 vars in 912 bytes} [Tue Aug 9 11:25:47 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:25:47.977933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf773129-752c-4e9f-a21c-99768bbb8436 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:47.978364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf773129-752c-4e9f-a21c-99768bbb8436 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:47.978685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf773129-752c-4e9f-a21c-99768bbb8436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:47.982274 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 821/1639] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:47 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:48.030511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21959765-b6af-4f82-81cc-55084cb4f9e3 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:48.107992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-cf773129-752c-4e9f-a21c-99768bbb8436 None None] MFA Rules not processed for user `2136cf1160a64951ad780424cb28403b`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:48.109419 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cf773129-752c-4e9f-a21c-99768bbb8436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:48.214038 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21959765-b6af-4f82-81cc-55084cb4f9e3 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:48.223029 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73922dc-e8ee-47ef-a1c8-0c70124ecc19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:48.223819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73922dc-e8ee-47ef-a1c8-0c70124ecc19 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:48.224098 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73922dc-e8ee-47ef-a1c8-0c70124ecc19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:48.224377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73922dc-e8ee-47ef-a1c8-0c70124ecc19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:48.246311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73922dc-e8ee-47ef-a1c8-0c70124ecc19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:48.248107 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73922dc-e8ee-47ef-a1c8-0c70124ecc19 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:48.281724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 822/1640] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:25:48.284900 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73922dc-e8ee-47ef-a1c8-0c70124ecc19 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:48.297623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 819/1641] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:25:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:48.324775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73922dc-e8ee-47ef-a1c8-0c70124ecc19 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:48.337197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fbf5f-b8c0-419a-b5dc-62deb3acdde6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:48.337985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fbf5f-b8c0-419a-b5dc-62deb3acdde6 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:48.338311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fbf5f-b8c0-419a-b5dc-62deb3acdde6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:48.338588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fbf5f-b8c0-419a-b5dc-62deb3acdde6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:48.374780 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fbf5f-b8c0-419a-b5dc-62deb3acdde6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:48.376343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fbf5f-b8c0-419a-b5dc-62deb3acdde6 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:48.410741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 823/1642] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:48 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:48.565185 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf773129-752c-4e9f-a21c-99768bbb8436 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:48.580774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf773129-752c-4e9f-a21c-99768bbb8436 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:48.591522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f9fa0-3720-4822-99f0-8ddb5b6f8b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:48.592335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9fa0-3720-4822-99f0-8ddb5b6f8b33 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:48.592711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9fa0-3720-4822-99f0-8ddb5b6f8b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:48.593125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9fa0-3720-4822-99f0-8ddb5b6f8b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:48.609720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f9fa0-3720-4822-99f0-8ddb5b6f8b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:48.620996 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f9fa0-3720-4822-99f0-8ddb5b6f8b33 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:48.660529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 820/1643] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:49.388963 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fbf5f-b8c0-419a-b5dc-62deb3acdde6 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:49.563696 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fbf5f-b8c0-419a-b5dc-62deb3acdde6 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:49.570170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb68ff1-ed0b-49f9-b235-3c3db9a1eeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:49.571116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb68ff1-ed0b-49f9-b235-3c3db9a1eeeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:49.571533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb68ff1-ed0b-49f9-b235-3c3db9a1eeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:49.572034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb68ff1-ed0b-49f9-b235-3c3db9a1eeeb admin admin] PATH_INFO: `/v3/users/1720108a01cd4648b08d1e02928b6720` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:49.573599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb68ff1-ed0b-49f9-b235-3c3db9a1eeeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1720108a01cd4648b08d1e02928b6720)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:49.576671 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb68ff1-ed0b-49f9-b235-3c3db9a1eeeb admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:49.595789 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:49.654013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-8eb68ff1-ed0b-49f9-b235-3c3db9a1eeeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1720108a01cd4648b08d1e02928b6720'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:49.667183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-8eb68ff1-ed0b-49f9-b235-3c3db9a1eeeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1720108a01cd4648b08d1e02928b6720'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:49.668276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-8eb68ff1-ed0b-49f9-b235-3c3db9a1eeeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1720108a01cd4648b08d1e02928b6720'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:49.669104 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-8eb68ff1-ed0b-49f9-b235-3c3db9a1eeeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1720108a01cd4648b08d1e02928b6720'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:49.691849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-8eb68ff1-ed0b-49f9-b235-3c3db9a1eeeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1720108a01cd4648b08d1e02928b6720'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:49.711933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 824/1644] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:25:49 2022] DELETE /identity/v3/users/1720108a01cd4648b08d1e02928b6720 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:25:49.717035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d92a72-9b40-429b-bac3-24479ba55422 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:49.717550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d92a72-9b40-429b-bac3-24479ba55422 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:49.717662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d92a72-9b40-429b-bac3-24479ba55422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:49.724754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:49.750932 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-53d92a72-9b40-429b-bac3-24479ba55422 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:49.752174 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-53d92a72-9b40-429b-bac3-24479ba55422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:49.888148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb68ff1-ed0b-49f9-b235-3c3db9a1eeeb admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:49.889890 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-8eb68ff1-ed0b-49f9-b235-3c3db9a1eeeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:49.891333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 821/1645] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:49.908770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb68ff1-ed0b-49f9-b235-3c3db9a1eeeb admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:49.915040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1e31f-f6ea-4d5d-888f-e8c3571cf5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:49.915472 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1e31f-f6ea-4d5d-888f-e8c3571cf5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:49.915748 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1e31f-f6ea-4d5d-888f-e8c3571cf5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:49.916020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1e31f-f6ea-4d5d-888f-e8c3571cf5d3 admin admin] PATH_INFO: `/v3/users/5d3f21263efa468ab687c8f443988d76` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:49.917431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1e31f-f6ea-4d5d-888f-e8c3571cf5d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d3f21263efa468ab687c8f443988d76)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:49.919671 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1e31f-f6ea-4d5d-888f-e8c3571cf5d3 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:49.925704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d92a72-9b40-429b-bac3-24479ba55422 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:49.927243 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-53d92a72-9b40-429b-bac3-24479ba55422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:49.987694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-f2a1e31f-f6ea-4d5d-888f-e8c3571cf5d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d3f21263efa468ab687c8f443988d76'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:50.006527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-f2a1e31f-f6ea-4d5d-888f-e8c3571cf5d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d3f21263efa468ab687c8f443988d76'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:50.007405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-f2a1e31f-f6ea-4d5d-888f-e8c3571cf5d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d3f21263efa468ab687c8f443988d76'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:50.008148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-f2a1e31f-f6ea-4d5d-888f-e8c3571cf5d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d3f21263efa468ab687c8f443988d76'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:50.025917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-f2a1e31f-f6ea-4d5d-888f-e8c3571cf5d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d3f21263efa468ab687c8f443988d76'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:50.040666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 825/1646] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:25:49 2022] DELETE /identity/v3/users/5d3f21263efa468ab687c8f443988d76 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:50.048162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b29b0-0471-43bd-be2a-e76df18d4ac9 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:50.048716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b29b0-0471-43bd-be2a-e76df18d4ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:50.049091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b29b0-0471-43bd-be2a-e76df18d4ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:50.069660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d92a72-9b40-429b-bac3-24479ba55422 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:50.104071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-361b29b0-0471-43bd-be2a-e76df18d4ac9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:50.109304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-361b29b0-0471-43bd-be2a-e76df18d4ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:50.195503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25230bc-c1df-4cb1-afd5-c529338df24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:50.196146 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25230bc-c1df-4cb1-afd5-c529338df24c service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:50.196426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25230bc-c1df-4cb1-afd5-c529338df24c service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:50.196697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25230bc-c1df-4cb1-afd5-c529338df24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:50.207170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e25230bc-c1df-4cb1-afd5-c529338df24c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:50.218669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 826/1647] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:50.230252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25230bc-c1df-4cb1-afd5-c529338df24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:50.231786 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25230bc-c1df-4cb1-afd5-c529338df24c service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:50.240945 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b29b0-0471-43bd-be2a-e76df18d4ac9 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:50.242635 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-361b29b0-0471-43bd-be2a-e76df18d4ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:50.250497 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:50.261048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 822/1648] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:50.268694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b29b0-0471-43bd-be2a-e76df18d4ac9 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:50.283247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9693d21-b3a1-4ecf-bc5e-77c73dfb1dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:50.285042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9693d21-b3a1-4ecf-bc5e-77c73dfb1dca service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:50.286422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9693d21-b3a1-4ecf-bc5e-77c73dfb1dca service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:50.287076 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9693d21-b3a1-4ecf-bc5e-77c73dfb1dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:50.319544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9693d21-b3a1-4ecf-bc5e-77c73dfb1dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:50.321500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9693d21-b3a1-4ecf-bc5e-77c73dfb1dca service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:50.347818 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 827/1649] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:25:51.534805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25230bc-c1df-4cb1-afd5-c529338df24c service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:51.539817 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e25230bc-c1df-4cb1-afd5-c529338df24c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:51.561709 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25230bc-c1df-4cb1-afd5-c529338df24c service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:51.577120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:51.578237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:51.578775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:51.579566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] PATH_INFO: `/v3/projects/a8b7219dc6b640f48e8a869dd65ccd25` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:51.581180 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8b7219dc6b640f48e8a869dd65ccd25)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:51.584714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:51.696346 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b7219dc6b640f48e8a869dd65ccd25', 'request_id': 'req-b7c2e41f-99fc-4c47-b377-0e377b1f6749'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:51.706153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b7219dc6b640f48e8a869dd65ccd25', 'request_id': 'req-b7c2e41f-99fc-4c47-b377-0e377b1f6749'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:51.710333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:51.720063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b7219dc6b640f48e8a869dd65ccd25', 'request_id': 'req-b7c2e41f-99fc-4c47-b377-0e377b1f6749'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:51.752081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] The token cache is being invalidate because project a8b7219dc6b640f48e8a869dd65ccd25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:25:51.752440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:51.753428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:51.758977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 823/1650] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:25:51 2022] DELETE /identity/v3/projects/a8b7219dc6b640f48e8a869dd65ccd25 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:51.759752 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9693d21-b3a1-4ecf-bc5e-77c73dfb1dca service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:51.779818 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9693d21-b3a1-4ecf-bc5e-77c73dfb1dca service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:51.918920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:51.921302 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:51.976794 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9715a-db33-4289-851b-f5f1ca37fa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:51.977455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9715a-db33-4289-851b-f5f1ca37fa72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:51.977724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9715a-db33-4289-851b-f5f1ca37fa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:51.977998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9715a-db33-4289-851b-f5f1ca37fa72 admin admin] PATH_INFO: `/v3/users/6f58eb3a6c354bada4b57444ccb6f1fc` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:51.988908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9715a-db33-4289-851b-f5f1ca37fa72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f58eb3a6c354bada4b57444ccb6f1fc)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:51.995502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9715a-db33-4289-851b-f5f1ca37fa72 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:52.126404 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-29e9715a-db33-4289-851b-f5f1ca37fa72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f58eb3a6c354bada4b57444ccb6f1fc'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.147811 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-29e9715a-db33-4289-851b-f5f1ca37fa72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f58eb3a6c354bada4b57444ccb6f1fc'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.148402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2e41f-99fc-4c47-b377-0e377b1f6749 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:52.148514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-29e9715a-db33-4289-851b-f5f1ca37fa72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f58eb3a6c354bada4b57444ccb6f1fc'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.149184 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-29e9715a-db33-4289-851b-f5f1ca37fa72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f58eb3a6c354bada4b57444ccb6f1fc'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.162605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:52.163046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:52.163321 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:52.163586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] PATH_INFO: `/v3/projects/cd5f40c54a2b48a7ab38e3fab17297c2` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:52.165112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5f40c54a2b48a7ab38e3fab17297c2)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:52.181563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:52.183472 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-29e9715a-db33-4289-851b-f5f1ca37fa72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f58eb3a6c354bada4b57444ccb6f1fc'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.222950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 828/1651] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:25:51 2022] DELETE /identity/v3/users/6f58eb3a6c354bada4b57444ccb6f1fc => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:52.324700 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5f40c54a2b48a7ab38e3fab17297c2', 'request_id': 'req-57dc8936-c5cf-457c-944b-664597926318'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.343825 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5f40c54a2b48a7ab38e3fab17297c2', 'request_id': 'req-57dc8936-c5cf-457c-944b-664597926318'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.365600 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5f40c54a2b48a7ab38e3fab17297c2', 'request_id': 'req-57dc8936-c5cf-457c-944b-664597926318'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.390273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] The token cache is being invalidate because project cd5f40c54a2b48a7ab38e3fab17297c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:25:52.390273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.394134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.398222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 824/1652] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:25:51 2022] DELETE /identity/v3/projects/cd5f40c54a2b48a7ab38e3fab17297c2 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:25:52.404760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9715a-db33-4289-851b-f5f1ca37fa72 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:52.404760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-29e9715a-db33-4289-851b-f5f1ca37fa72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:52.580985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9715a-db33-4289-851b-f5f1ca37fa72 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:52.594345 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:52.682230 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0985b-6c5f-4109-9152-1fad67b87d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:52.683797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0985b-6c5f-4109-9152-1fad67b87d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:52.684081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0985b-6c5f-4109-9152-1fad67b87d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:52.684355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0985b-6c5f-4109-9152-1fad67b87d26 admin admin] PATH_INFO: `/v3/users/fe14889e128c4cd7ba5d63e0883bf796` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:52.685711 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0985b-6c5f-4109-9152-1fad67b87d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe14889e128c4cd7ba5d63e0883bf796)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:52.689265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0985b-6c5f-4109-9152-1fad67b87d26 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:52.788675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e1d0985b-6c5f-4109-9152-1fad67b87d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe14889e128c4cd7ba5d63e0883bf796'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.804200 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e1d0985b-6c5f-4109-9152-1fad67b87d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe14889e128c4cd7ba5d63e0883bf796'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.804924 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e1d0985b-6c5f-4109-9152-1fad67b87d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe14889e128c4cd7ba5d63e0883bf796'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.805530 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e1d0985b-6c5f-4109-9152-1fad67b87d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe14889e128c4cd7ba5d63e0883bf796'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.831875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e1d0985b-6c5f-4109-9152-1fad67b87d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe14889e128c4cd7ba5d63e0883bf796'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:52.869538 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 829/1653] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:25:52 2022] DELETE /identity/v3/users/fe14889e128c4cd7ba5d63e0883bf796 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:54.094280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:54.096710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:54.116595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc8936-c5cf-457c-944b-664597926318 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:54.141980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0985b-6c5f-4109-9152-1fad67b87d26 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:54.144227 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e1d0985b-6c5f-4109-9152-1fad67b87d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:54.306843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e553be-9826-45c9-91d4-559e87f422e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:54.307676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e553be-9826-45c9-91d4-559e87f422e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:54.308014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e553be-9826-45c9-91d4-559e87f422e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:54.308342 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e553be-9826-45c9-91d4-559e87f422e2 admin admin] PATH_INFO: `/v3/projects/3359543b86a5456493955a9f1f1ce419` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:54.313170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e553be-9826-45c9-91d4-559e87f422e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3359543b86a5456493955a9f1f1ce419)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:54.317220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e553be-9826-45c9-91d4-559e87f422e2 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:54.321311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0985b-6c5f-4109-9152-1fad67b87d26 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:54.329008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301c424-b303-481c-8611-ba3cdf0aca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:54.329770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301c424-b303-481c-8611-ba3cdf0aca24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:54.330112 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301c424-b303-481c-8611-ba3cdf0aca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:54.330455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301c424-b303-481c-8611-ba3cdf0aca24 admin admin] PATH_INFO: `/v3/projects/9a8d533d9cb54377bc373ffb18154902` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:54.332415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301c424-b303-481c-8611-ba3cdf0aca24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8d533d9cb54377bc373ffb18154902)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:54.333662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: WARNING py.warnings [None req-7301c424-b303-481c-8611-ba3cdf0aca24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:25:54.333662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: warnings.warn(msg) Aug 09 11:25:54.333662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: Aug 09 11:25:54.335076 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301c424-b303-481c-8611-ba3cdf0aca24 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:54.385573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:54.419831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:54.465244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7301c424-b303-481c-8611-ba3cdf0aca24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8d533d9cb54377bc373ffb18154902', 'request_id': 'req-7301c424-b303-481c-8611-ba3cdf0aca24'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:54.474097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-56e553be-9826-45c9-91d4-559e87f422e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3359543b86a5456493955a9f1f1ce419', 'request_id': 'req-56e553be-9826-45c9-91d4-559e87f422e2'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:54.484812 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-56e553be-9826-45c9-91d4-559e87f422e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3359543b86a5456493955a9f1f1ce419', 'request_id': 'req-56e553be-9826-45c9-91d4-559e87f422e2'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:54.491382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7301c424-b303-481c-8611-ba3cdf0aca24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8d533d9cb54377bc373ffb18154902', 'request_id': 'req-7301c424-b303-481c-8611-ba3cdf0aca24'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:54.502923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7301c424-b303-481c-8611-ba3cdf0aca24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8d533d9cb54377bc373ffb18154902', 'request_id': 'req-7301c424-b303-481c-8611-ba3cdf0aca24'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:54.512047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-56e553be-9826-45c9-91d4-559e87f422e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3359543b86a5456493955a9f1f1ce419', 'request_id': 'req-56e553be-9826-45c9-91d4-559e87f422e2'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:54.546291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7301c424-b303-481c-8611-ba3cdf0aca24 admin admin] The token cache is being invalidate because project 9a8d533d9cb54377bc373ffb18154902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:25:54.546653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7301c424-b303-481c-8611-ba3cdf0aca24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:54.547524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7301c424-b303-481c-8611-ba3cdf0aca24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:54.561488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-56e553be-9826-45c9-91d4-559e87f422e2 admin admin] The token cache is being invalidate because project 3359543b86a5456493955a9f1f1ce419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:25:54.562073 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-56e553be-9826-45c9-91d4-559e87f422e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:54.563550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-56e553be-9826-45c9-91d4-559e87f422e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:54.571806 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 825/1655] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:25:54 2022] DELETE /identity/v3/projects/3359543b86a5456493955a9f1f1ce419 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:54.574490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a289047-ac31-4c6a-b20b-87b10f979187 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:54.578417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 830/1655] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:25:54 2022] DELETE /identity/v3/projects/9a8d533d9cb54377bc373ffb18154902 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:25:54.578918 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a289047-ac31-4c6a-b20b-87b10f979187 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:54.579295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a289047-ac31-4c6a-b20b-87b10f979187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:54.581221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22f01b-07b8-4231-ba58-35283b7fa3a7 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:54.581647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22f01b-07b8-4231-ba58-35283b7fa3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:54.582068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22f01b-07b8-4231-ba58-35283b7fa3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:54.636292 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-1a289047-ac31-4c6a-b20b-87b10f979187 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:54.659097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1a289047-ac31-4c6a-b20b-87b10f979187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:54.691181 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-db22f01b-07b8-4231-ba58-35283b7fa3a7 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:54.696095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-db22f01b-07b8-4231-ba58-35283b7fa3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:54.864172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 826/1656] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:54.872451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe8478-fc78-4f5d-b4b5-d57dde7cd61d None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:54.872451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe8478-fc78-4f5d-b4b5-d57dde7cd61d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:54.872742 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe8478-fc78-4f5d-b4b5-d57dde7cd61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:54.919206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 831/1657] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:54.921112 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad193-a8d2-432e-b1a0-d6de3ebcf79d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:54.921767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad193-a8d2-432e-b1a0-d6de3ebcf79d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:54.923089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad193-a8d2-432e-b1a0-d6de3ebcf79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:54.934406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-9ebe8478-fc78-4f5d-b4b5-d57dde7cd61d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:54.935690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9ebe8478-fc78-4f5d-b4b5-d57dde7cd61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:54.964567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 827/1658] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:54.965629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe8478-fc78-4f5d-b4b5-d57dde7cd61d None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:54.985199 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe8478-fc78-4f5d-b4b5-d57dde7cd61d None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:55.002424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc075519-dbda-4c20-9767-525cf76d5fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:55.003319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc075519-dbda-4c20-9767-525cf76d5fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:55.003601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc075519-dbda-4c20-9767-525cf76d5fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:55.003908 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc075519-dbda-4c20-9767-525cf76d5fd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:55.006005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc075519-dbda-4c20-9767-525cf76d5fd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:25:55.006422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc075519-dbda-4c20-9767-525cf76d5fd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:55.008137 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc075519-dbda-4c20-9767-525cf76d5fd0 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:55.035786 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 828/1659] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:25:55.036731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc075519-dbda-4c20-9767-525cf76d5fd0 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:55.054047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-14bad193-a8d2-432e-b1a0-d6de3ebcf79d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:55.055314 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-14bad193-a8d2-432e-b1a0-d6de3ebcf79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:55.065641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc075519-dbda-4c20-9767-525cf76d5fd0 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:55.075638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33ecaf-d125-44f5-b908-3c388a9054ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:55.076871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33ecaf-d125-44f5-b908-3c388a9054ec admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:55.077348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33ecaf-d125-44f5-b908-3c388a9054ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:55.077838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33ecaf-d125-44f5-b908-3c388a9054ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:55.079350 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33ecaf-d125-44f5-b908-3c388a9054ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:55.085222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33ecaf-d125-44f5-b908-3c388a9054ec admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:55.088993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 832/1660] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:55.095767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bad193-a8d2-432e-b1a0-d6de3ebcf79d None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:55.118599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bad193-a8d2-432e-b1a0-d6de3ebcf79d None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:55.133191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10171573-6cc6-4c0a-b367-0d1644ab538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:55.133820 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10171573-6cc6-4c0a-b367-0d1644ab538c admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:55.134084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10171573-6cc6-4c0a-b367-0d1644ab538c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:55.134349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10171573-6cc6-4c0a-b367-0d1644ab538c admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:55.135044 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10171573-6cc6-4c0a-b367-0d1644ab538c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:25:55.135437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10171573-6cc6-4c0a-b367-0d1644ab538c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:55.137096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10171573-6cc6-4c0a-b367-0d1644ab538c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:55.163827 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 829/1661] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:55 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:55.169199 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33ecaf-d125-44f5-b908-3c388a9054ec admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:55.177279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 833/1662] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:25:55.183087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10171573-6cc6-4c0a-b367-0d1644ab538c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:55.213302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10171573-6cc6-4c0a-b367-0d1644ab538c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:55.293771 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33ecaf-d125-44f5-b908-3c388a9054ec admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:55.299172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80362baf-e8fb-4298-b84a-f5c229c240aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:55.300057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80362baf-e8fb-4298-b84a-f5c229c240aa admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:55.300335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80362baf-e8fb-4298-b84a-f5c229c240aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:55.301023 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80362baf-e8fb-4298-b84a-f5c229c240aa admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:55.301734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80362baf-e8fb-4298-b84a-f5c229c240aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:55.304162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80362baf-e8fb-4298-b84a-f5c229c240aa admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:55.316282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:55.341652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 830/1663] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:55 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:55.342943 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80362baf-e8fb-4298-b84a-f5c229c240aa admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:55.357782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80362baf-e8fb-4298-b84a-f5c229c240aa admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:55.364085 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b547856-a5d5-4bde-a5f0-232ac9033b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:55.366026 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b547856-a5d5-4bde-a5f0-232ac9033b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:55.366471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b547856-a5d5-4bde-a5f0-232ac9033b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:55.366740 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b547856-a5d5-4bde-a5f0-232ac9033b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:55.368303 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b547856-a5d5-4bde-a5f0-232ac9033b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:55.369921 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b547856-a5d5-4bde-a5f0-232ac9033b59 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:55.389163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 831/1664] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:55.392033 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b547856-a5d5-4bde-a5f0-232ac9033b59 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:55.414492 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dbbea-e91f-45fc-9d6f-b715d0923fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:55.415152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dbbea-e91f-45fc-9d6f-b715d0923fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:55.415438 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dbbea-e91f-45fc-9d6f-b715d0923fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:55.415714 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dbbea-e91f-45fc-9d6f-b715d0923fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:55.416877 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62dbbea-e91f-45fc-9d6f-b715d0923fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:55.418393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b547856-a5d5-4bde-a5f0-232ac9033b59 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:55.419020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62dbbea-e91f-45fc-9d6f-b715d0923fbc admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:55.424449 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e344215-49dc-4612-bf66-d810b7d067ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:55.425531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344215-49dc-4612-bf66-d810b7d067ed admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:55.425943 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344215-49dc-4612-bf66-d810b7d067ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:55.426440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344215-49dc-4612-bf66-d810b7d067ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:55.427651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e344215-49dc-4612-bf66-d810b7d067ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:55.429489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e344215-49dc-4612-bf66-d810b7d067ed admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:55.445061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 832/1665] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:55.449981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e344215-49dc-4612-bf66-d810b7d067ed admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:55.465974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 834/1666] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:55 2022] POST /identity/v3/projects => generated 375 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:55.470801 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dbbea-e91f-45fc-9d6f-b715d0923fbc admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:55.476903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e344215-49dc-4612-bf66-d810b7d067ed admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:55.556991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:55.606972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a83546-ac9f-45ee-864a-761d21832074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:55.607657 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a83546-ac9f-45ee-864a-761d21832074 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:55.607931 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a83546-ac9f-45ee-864a-761d21832074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:55.608204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a83546-ac9f-45ee-864a-761d21832074 admin admin] PATH_INFO: `/v3/projects/795f414999e4467c8cfd3f5dcb7fbe9c/users/9f945dd32a66467387c97bec230a205f/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:55.629999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dbbea-e91f-45fc-9d6f-b715d0923fbc admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:55.645060 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215ba3a-c589-489b-a353-6d2ac7433ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:55.645846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215ba3a-c589-489b-a353-6d2ac7433ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:55.646121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215ba3a-c589-489b-a353-6d2ac7433ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:55.646387 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215ba3a-c589-489b-a353-6d2ac7433ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:55.647154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215ba3a-c589-489b-a353-6d2ac7433ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:55.649376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a83546-ac9f-45ee-864a-761d21832074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=795f414999e4467c8cfd3f5dcb7fbe9c, user_id=9f945dd32a66467387c97bec230a205f, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:55.649939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215ba3a-c589-489b-a353-6d2ac7433ab1 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:55.654731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a83546-ac9f-45ee-864a-761d21832074 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:55.691557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 833/1667] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:55 2022] PUT /identity/v3/projects/795f414999e4467c8cfd3f5dcb7fbe9c/users/9f945dd32a66467387c97bec230a205f/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:55.694048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd173-41e3-4db7-b131-4aebd6f89ca7 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:55.694508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd173-41e3-4db7-b131-4aebd6f89ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:55.695163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd173-41e3-4db7-b131-4aebd6f89ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:55.717006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 835/1668] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:55 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:55.720888 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215ba3a-c589-489b-a353-6d2ac7433ab1 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:55.738439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-414cd173-41e3-4db7-b131-4aebd6f89ca7 None None] MFA Rules not processed for user `9f945dd32a66467387c97bec230a205f`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:55.740018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-414cd173-41e3-4db7-b131-4aebd6f89ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:55.754721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215ba3a-c589-489b-a353-6d2ac7433ab1 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:55.862885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 834/1669] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:55.864114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cd173-41e3-4db7-b131-4aebd6f89ca7 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:55.906843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea752ed1-dfdf-47f8-a648-4fcf1eb02b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:55.912701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea752ed1-dfdf-47f8-a648-4fcf1eb02b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:55.913609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea752ed1-dfdf-47f8-a648-4fcf1eb02b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:55.913905 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea752ed1-dfdf-47f8-a648-4fcf1eb02b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:55.914735 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea752ed1-dfdf-47f8-a648-4fcf1eb02b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:55.918485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea752ed1-dfdf-47f8-a648-4fcf1eb02b8a admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:55.953662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 836/1670] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:55.957005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea752ed1-dfdf-47f8-a648-4fcf1eb02b8a admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:55.960557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:55.993768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea752ed1-dfdf-47f8-a648-4fcf1eb02b8a admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:56.009283 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8746ddc-83b2-45d4-ba72-56081285c952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:56.009532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cd173-41e3-4db7-b131-4aebd6f89ca7 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:56.010445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8746ddc-83b2-45d4-ba72-56081285c952 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:56.010730 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8746ddc-83b2-45d4-ba72-56081285c952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:56.011067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8746ddc-83b2-45d4-ba72-56081285c952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:56.011783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8746ddc-83b2-45d4-ba72-56081285c952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:56.013458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8746ddc-83b2-45d4-ba72-56081285c952 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:56.022110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c148a5-28d4-4fa6-b02a-b388bd38f19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:56.023121 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c148a5-28d4-4fa6-b02a-b388bd38f19c admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:56.023121 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c148a5-28d4-4fa6-b02a-b388bd38f19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:56.023322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c148a5-28d4-4fa6-b02a-b388bd38f19c admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:56.023947 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c148a5-28d4-4fa6-b02a-b388bd38f19c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:56.029395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c148a5-28d4-4fa6-b02a-b388bd38f19c admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:56.038045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 837/1671] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:56.042574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8746ddc-83b2-45d4-ba72-56081285c952 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:56.066236 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8746ddc-83b2-45d4-ba72-56081285c952 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:56.078962 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4334d-4735-41ff-94e2-9ba76030583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:56.079716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4334d-4735-41ff-94e2-9ba76030583c admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:56.080000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4334d-4735-41ff-94e2-9ba76030583c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:56.080268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4334d-4735-41ff-94e2-9ba76030583c admin admin] PATH_INFO: `/v3/projects/19ea1099679243278b07ab1a1c54d504/users/4033d20d359a47b79aa727fd660139e1/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:56.098793 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 835/1672] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:55 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:56.104012 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c148a5-28d4-4fa6-b02a-b388bd38f19c admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:56.123591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4334d-4735-41ff-94e2-9ba76030583c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ea1099679243278b07ab1a1c54d504, user_id=4033d20d359a47b79aa727fd660139e1, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:56.128152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4334d-4735-41ff-94e2-9ba76030583c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:56.161408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 838/1673] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:56 2022] PUT /identity/v3/projects/19ea1099679243278b07ab1a1c54d504/users/4033d20d359a47b79aa727fd660139e1/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:56.172015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f5031-b77b-4430-8e00-a15d900d3caa None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:56.174500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f5031-b77b-4430-8e00-a15d900d3caa None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:56.174940 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f5031-b77b-4430-8e00-a15d900d3caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:56.237954 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c148a5-28d4-4fa6-b02a-b388bd38f19c admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:56.267084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-488f5031-b77b-4430-8e00-a15d900d3caa None None] MFA Rules not processed for user `4033d20d359a47b79aa727fd660139e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:56.269194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-488f5031-b77b-4430-8e00-a15d900d3caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:56.354682 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d2d2d-0a74-4aa4-ae67-5a1152cf1c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:56.356847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d2d2d-0a74-4aa4-ae67-5a1152cf1c23 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:56.357153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d2d2d-0a74-4aa4-ae67-5a1152cf1c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:56.357428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d2d2d-0a74-4aa4-ae67-5a1152cf1c23 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:56.358115 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d2d2d-0a74-4aa4-ae67-5a1152cf1c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:56.361107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d2d2d-0a74-4aa4-ae67-5a1152cf1c23 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:56.402860 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 836/1674] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:56 2022] POST /identity/v3/users => generated 298 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:56.413109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d2d2d-0a74-4aa4-ae67-5a1152cf1c23 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:56.480248 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d2d2d-0a74-4aa4-ae67-5a1152cf1c23 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:56.506318 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a17d93-3882-4154-986a-93c1efb44318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:56.507353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 839/1675] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:56.509069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a17d93-3882-4154-986a-93c1efb44318 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:56.509504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a17d93-3882-4154-986a-93c1efb44318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:56.510603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a17d93-3882-4154-986a-93c1efb44318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:56.511709 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f5031-b77b-4430-8e00-a15d900d3caa None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:56.512588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a17d93-3882-4154-986a-93c1efb44318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:56.514369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a17d93-3882-4154-986a-93c1efb44318 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:56.555263 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f5031-b77b-4430-8e00-a15d900d3caa None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:56.561608 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 837/1676] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:56.566285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a17d93-3882-4154-986a-93c1efb44318 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:56.576698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edff7f7-3c7c-4954-bbff-5bd2664a661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:56.590792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edff7f7-3c7c-4954-bbff-5bd2664a661c admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:56.592783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edff7f7-3c7c-4954-bbff-5bd2664a661c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:56.595243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edff7f7-3c7c-4954-bbff-5bd2664a661c admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:56.595720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a17d93-3882-4154-986a-93c1efb44318 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:56.599300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edff7f7-3c7c-4954-bbff-5bd2664a661c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:56.612343 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fde18c-4125-4c60-bfc9-ed836c2899cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:56.612976 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fde18c-4125-4c60-bfc9-ed836c2899cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:56.613336 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edff7f7-3c7c-4954-bbff-5bd2664a661c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:56.613888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fde18c-4125-4c60-bfc9-ed836c2899cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:56.613984 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fde18c-4125-4c60-bfc9-ed836c2899cd admin admin] PATH_INFO: `/v3/projects/68ebd9c3095a40bab1cd580148fb4a4d/users/ccd158513058413c9d92fd5388969959/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:56.641416 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:56.653775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fde18c-4125-4c60-bfc9-ed836c2899cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ebd9c3095a40bab1cd580148fb4a4d, user_id=ccd158513058413c9d92fd5388969959, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:56.656734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fde18c-4125-4c60-bfc9-ed836c2899cd admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:56.681535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 838/1677] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:56 2022] PUT /identity/v3/projects/68ebd9c3095a40bab1cd580148fb4a4d/users/ccd158513058413c9d92fd5388969959/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:56.685063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fde18c-4125-4c60-bfc9-ed836c2899cd admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:56.705642 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 840/1678] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:56 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:56.707041 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edff7f7-3c7c-4954-bbff-5bd2664a661c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:56.784078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:56.877128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fde18c-4125-4c60-bfc9-ed836c2899cd admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:56.952803 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edff7f7-3c7c-4954-bbff-5bd2664a661c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:56.970273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f274d0-cd1c-4c97-935b-93734052f6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:56.971273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f274d0-cd1c-4c97-935b-93734052f6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:56.971557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f274d0-cd1c-4c97-935b-93734052f6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:56.973430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f274d0-cd1c-4c97-935b-93734052f6b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:56.974162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f274d0-cd1c-4c97-935b-93734052f6b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:56.980224 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f274d0-cd1c-4c97-935b-93734052f6b3 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:57.059976 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 841/1679] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:56 2022] POST /identity/v3/users => generated 294 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:57.067785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f274d0-cd1c-4c97-935b-93734052f6b3 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:57.080742 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7acfcb-d78d-4ec0-bd05-9203f6543a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:57.081386 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7acfcb-d78d-4ec0-bd05-9203f6543a15 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:57.081692 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7acfcb-d78d-4ec0-bd05-9203f6543a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:57.081912 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7acfcb-d78d-4ec0-bd05-9203f6543a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:57.082609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7acfcb-d78d-4ec0-bd05-9203f6543a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:57.084269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7acfcb-d78d-4ec0-bd05-9203f6543a15 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:57.116383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f274d0-cd1c-4c97-935b-93734052f6b3 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:57.129098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 839/1680] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:25:57.130724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7acfcb-d78d-4ec0-bd05-9203f6543a15 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:57.131882 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784f5a2-27bd-4fef-8264-ad482ae94180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:57.133038 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784f5a2-27bd-4fef-8264-ad482ae94180 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:57.133367 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784f5a2-27bd-4fef-8264-ad482ae94180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:57.133634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784f5a2-27bd-4fef-8264-ad482ae94180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:57.140990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784f5a2-27bd-4fef-8264-ad482ae94180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:57.143057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784f5a2-27bd-4fef-8264-ad482ae94180 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:57.165694 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7acfcb-d78d-4ec0-bd05-9203f6543a15 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:57.192857 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 842/1681] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:57.194763 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784f5a2-27bd-4fef-8264-ad482ae94180 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:57.195880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ec0d8-faa9-495c-bd49-9b94706ba070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:57.196572 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ec0d8-faa9-495c-bd49-9b94706ba070 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:57.203286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ec0d8-faa9-495c-bd49-9b94706ba070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:57.204448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ec0d8-faa9-495c-bd49-9b94706ba070 admin admin] PATH_INFO: `/v3/projects/68ebd9c3095a40bab1cd580148fb4a4d/users/ccd158513058413c9d92fd5388969959/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:57.208533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ec0d8-faa9-495c-bd49-9b94706ba070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ebd9c3095a40bab1cd580148fb4a4d, user_id=ccd158513058413c9d92fd5388969959, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:57.213904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ec0d8-faa9-495c-bd49-9b94706ba070 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:57.245172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784f5a2-27bd-4fef-8264-ad482ae94180 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:57.248496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 840/1682] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:57 2022] PUT /identity/v3/projects/68ebd9c3095a40bab1cd580148fb4a4d/users/ccd158513058413c9d92fd5388969959/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:57.250633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a424c-9c85-4318-a170-00c1fa798b3c None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:57.251414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a424c-9c85-4318-a170-00c1fa798b3c None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:57.252454 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a424c-9c85-4318-a170-00c1fa798b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:57.299611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-355a424c-9c85-4318-a170-00c1fa798b3c None None] MFA Rules not processed for user `ccd158513058413c9d92fd5388969959`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:57.301704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-355a424c-9c85-4318-a170-00c1fa798b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:57.396693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be08f9-3a01-4161-9550-91d7029419c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:57.397955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be08f9-3a01-4161-9550-91d7029419c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:57.400389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be08f9-3a01-4161-9550-91d7029419c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:57.400811 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be08f9-3a01-4161-9550-91d7029419c8 admin admin] PATH_INFO: `/v3/projects/9db421ef423e463bb8ef79e5c8ea9b63/users/74551a0095d142338e83fa6078853ede/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:57.440983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be08f9-3a01-4161-9550-91d7029419c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db421ef423e463bb8ef79e5c8ea9b63, user_id=74551a0095d142338e83fa6078853ede, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:57.444219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be08f9-3a01-4161-9550-91d7029419c8 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:57.492495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 841/1683] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:57.501320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 843/1684] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:57 2022] PUT /identity/v3/projects/9db421ef423e463bb8ef79e5c8ea9b63/users/74551a0095d142338e83fa6078853ede/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:57.517753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be08f9-3a01-4161-9550-91d7029419c8 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:57.520492 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-28be08f9-3a01-4161-9550-91d7029419c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:57.524408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a424c-9c85-4318-a170-00c1fa798b3c None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:57.558067 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a424c-9c85-4318-a170-00c1fa798b3c None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:57.729568 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:57.764214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be08f9-3a01-4161-9550-91d7029419c8 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:57.782870 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d66da6-2489-43cd-9d8e-2f5f991985f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:57.783753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66da6-2489-43cd-9d8e-2f5f991985f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:57.784146 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66da6-2489-43cd-9d8e-2f5f991985f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:57.784504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66da6-2489-43cd-9d8e-2f5f991985f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:57.797750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737b6d8-b1d9-4bc6-a63f-95d1f2a817cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:57.798434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737b6d8-b1d9-4bc6-a63f-95d1f2a817cc admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:57.798722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737b6d8-b1d9-4bc6-a63f-95d1f2a817cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:57.799039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737b6d8-b1d9-4bc6-a63f-95d1f2a817cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:57.799714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737b6d8-b1d9-4bc6-a63f-95d1f2a817cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:57.801859 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737b6d8-b1d9-4bc6-a63f-95d1f2a817cc admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:57.805187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:57.862332 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 842/1685] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:57.863725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737b6d8-b1d9-4bc6-a63f-95d1f2a817cc admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:57.893318 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737b6d8-b1d9-4bc6-a63f-95d1f2a817cc admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:57.926565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44059e2-a26b-475f-bbd6-d391d331b4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:57.931487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44059e2-a26b-475f-bbd6-d391d331b4bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:57.931785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44059e2-a26b-475f-bbd6-d391d331b4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:57.932067 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44059e2-a26b-475f-bbd6-d391d331b4bd admin admin] PATH_INFO: `/v3/projects/9db421ef423e463bb8ef79e5c8ea9b63/users/74551a0095d142338e83fa6078853ede/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:57.950049 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44059e2-a26b-475f-bbd6-d391d331b4bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db421ef423e463bb8ef79e5c8ea9b63, user_id=74551a0095d142338e83fa6078853ede, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:57.952866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44059e2-a26b-475f-bbd6-d391d331b4bd admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:57.969573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d66da6-2489-43cd-9d8e-2f5f991985f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:57.972286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d66da6-2489-43cd-9d8e-2f5f991985f6 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:58.012614 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 844/1686] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:58.039339 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 843/1687] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:57 2022] PUT /identity/v3/projects/9db421ef423e463bb8ef79e5c8ea9b63/users/74551a0095d142338e83fa6078853ede/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:58.046953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40e9ff-d6c0-45c0-9ae8-e38a79d5123b None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:58.047312 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40e9ff-d6c0-45c0-9ae8-e38a79d5123b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:58.047650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40e9ff-d6c0-45c0-9ae8-e38a79d5123b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:58.104900 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-6f40e9ff-d6c0-45c0-9ae8-e38a79d5123b None None] MFA Rules not processed for user `74551a0095d142338e83fa6078853ede`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:58.108008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6f40e9ff-d6c0-45c0-9ae8-e38a79d5123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:58.231678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44059e2-a26b-475f-bbd6-d391d331b4bd admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:58.233606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c44059e2-a26b-475f-bbd6-d391d331b4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:58.336957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 845/1688] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:58.385037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40e9ff-d6c0-45c0-9ae8-e38a79d5123b None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:58.444412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44059e2-a26b-475f-bbd6-d391d331b4bd admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:58.449824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd5758-b792-4391-9ec5-93230bce3831 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:58.450536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd5758-b792-4391-9ec5-93230bce3831 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:58.450935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd5758-b792-4391-9ec5-93230bce3831 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:58.451290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd5758-b792-4391-9ec5-93230bce3831 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:58.569201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40e9ff-d6c0-45c0-9ae8-e38a79d5123b None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:58.584018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d609ef-0644-4e90-b424-972c26d145cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:58.584670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d609ef-0644-4e90-b424-972c26d145cb service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:58.590968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d609ef-0644-4e90-b424-972c26d145cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:58.591394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d609ef-0644-4e90-b424-972c26d145cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:58.668146 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd5758-b792-4391-9ec5-93230bce3831 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:58.674521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd5758-b792-4391-9ec5-93230bce3831 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:58.698069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 844/1689] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:58.699603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1fa12-fba9-4b94-a6dc-cb32289f27c1 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:58.699948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1fa12-fba9-4b94-a6dc-cb32289f27c1 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:58.700276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1fa12-fba9-4b94-a6dc-cb32289f27c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:58.733851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:58.784553 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-9ae1fa12-fba9-4b94-a6dc-cb32289f27c1 None None] MFA Rules not processed for user `8f9dc600fea34effa2afa8aee54aab7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:58.785850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9ae1fa12-fba9-4b94-a6dc-cb32289f27c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:58.791885 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d609ef-0644-4e90-b424-972c26d145cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:58.793493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d609ef-0644-4e90-b424-972c26d145cb service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:58.816653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 846/1690] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:58.864032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d7fb3-f37a-40fb-949c-ee36b82e5c31 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:58.864467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d7fb3-f37a-40fb-949c-ee36b82e5c31 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:58.864885 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d7fb3-f37a-40fb-949c-ee36b82e5c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:58.936296 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 845/1691] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:58.937962 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-749d7fb3-f37a-40fb-949c-ee36b82e5c31 None None] MFA Rules not processed for user `8512df3e232c4fd59b7abad4e6e05c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:58.939253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-749d7fb3-f37a-40fb-949c-ee36b82e5c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:58.946693 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c05a18-333d-4154-865c-7722a81a7f59 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:58.947004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c05a18-333d-4154-865c-7722a81a7f59 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:58.947278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c05a18-333d-4154-865c-7722a81a7f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:58.996966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-54c05a18-333d-4154-865c-7722a81a7f59 None None] MFA Rules not processed for user `8f9dc600fea34effa2afa8aee54aab7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:58.998173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-54c05a18-333d-4154-865c-7722a81a7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:59.017204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 846/1692] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:25:59.139460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 847/1693] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:59.140357 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19933e1c-f6e9-421c-8628-2c765200611e None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:59.140645 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19933e1c-f6e9-421c-8628-2c765200611e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:59.140905 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19933e1c-f6e9-421c-8628-2c765200611e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:59.162273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:59.202312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-19933e1c-f6e9-421c-8628-2c765200611e None None] MFA Rules not processed for user `00b3cd9e2c3e48c299037759cab9ccce`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:59.204718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-19933e1c-f6e9-421c-8628-2c765200611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:59.363967 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d7fb3-f37a-40fb-949c-ee36b82e5c31 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:59.371715 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-749d7fb3-f37a-40fb-949c-ee36b82e5c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:59.385341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 847/1694] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:59.396150 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19933e1c-f6e9-421c-8628-2c765200611e None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:59.411009 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-19933e1c-f6e9-421c-8628-2c765200611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:59.606588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d7fb3-f37a-40fb-949c-ee36b82e5c31 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:59.613941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a547fe-9eee-435d-b6b4-4cc5b73e9514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:59.615788 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a547fe-9eee-435d-b6b4-4cc5b73e9514 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:59.616189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a547fe-9eee-435d-b6b4-4cc5b73e9514 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:59.616470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a547fe-9eee-435d-b6b4-4cc5b73e9514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:59.646575 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a547fe-9eee-435d-b6b4-4cc5b73e9514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:59.648337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a547fe-9eee-435d-b6b4-4cc5b73e9514 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:59.654879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19933e1c-f6e9-421c-8628-2c765200611e None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:59.669373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:59.674481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:59.675551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:59.676902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] PATH_INFO: `/v3/users/a353be6a7032483a96a85524196b0e8c` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:59.679074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 848/1695] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:59.680562 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366333ca-b6ce-4299-8d42-3fcfc2ac3b90 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:59.680714 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366333ca-b6ce-4299-8d42-3fcfc2ac3b90 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:59.680983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366333ca-b6ce-4299-8d42-3fcfc2ac3b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:59.683341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a353be6a7032483a96a85524196b0e8c)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:59.688588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: WARNING py.warnings [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:25:59.688588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: warnings.warn(msg) Aug 09 11:25:59.688588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: Aug 09 11:25:59.690664 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:59.763001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-366333ca-b6ce-4299-8d42-3fcfc2ac3b90 None None] MFA Rules not processed for user `00b3cd9e2c3e48c299037759cab9ccce`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:59.764413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-366333ca-b6ce-4299-8d42-3fcfc2ac3b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:59.790375 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 849/1696] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:59.791647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366333ca-b6ce-4299-8d42-3fcfc2ac3b90 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:59.793181 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-366333ca-b6ce-4299-8d42-3fcfc2ac3b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:59.831821 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366333ca-b6ce-4299-8d42-3fcfc2ac3b90 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:59.847996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942b2de-e8de-4408-a9bb-72d6b8a0deae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:59.850785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942b2de-e8de-4408-a9bb-72d6b8a0deae service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:59.851204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942b2de-e8de-4408-a9bb-72d6b8a0deae service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:59.852307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942b2de-e8de-4408-a9bb-72d6b8a0deae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:59.890755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942b2de-e8de-4408-a9bb-72d6b8a0deae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:59.895481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942b2de-e8de-4408-a9bb-72d6b8a0deae service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:59.903376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a353be6a7032483a96a85524196b0e8c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:59.932922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 850/1697] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:59.943145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a353be6a7032483a96a85524196b0e8c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:59.959008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a353be6a7032483a96a85524196b0e8c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:59.960083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a353be6a7032483a96a85524196b0e8c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:59.961497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a353be6a7032483a96a85524196b0e8c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:59.987485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 848/1698] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:25:59 2022] DELETE /identity/v3/users/a353be6a7032483a96a85524196b0e8c => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:59.992016 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff57c-2703-493d-b8b0-1a033b71d106 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:59.992302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff57c-2703-493d-b8b0-1a033b71d106 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:59.992574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff57c-2703-493d-b8b0-1a033b71d106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:00.030085 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c55ff57c-2703-493d-b8b0-1a033b71d106 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:00.031423 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c55ff57c-2703-493d-b8b0-1a033b71d106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:00.076971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:00.079108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:00.129145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:00.136400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:00.198106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 851/1699] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:00.213582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ff57c-2703-493d-b8b0-1a033b71d106 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:00.231353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c55ff57c-2703-493d-b8b0-1a033b71d106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:00.234381 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ad7e8-5eaa-43aa-99bb-0466c4c21965 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:00.239814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcef433-29bb-409f-9e49-51364de30c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:00.241063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcef433-29bb-409f-9e49-51364de30c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:00.241602 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcef433-29bb-409f-9e49-51364de30c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:00.242052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcef433-29bb-409f-9e49-51364de30c8e admin admin] PATH_INFO: `/v3/users/9f945dd32a66467387c97bec230a205f` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:00.243719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcef433-29bb-409f-9e49-51364de30c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f945dd32a66467387c97bec230a205f)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:00.253516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcef433-29bb-409f-9e49-51364de30c8e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:00.330601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6fcef433-29bb-409f-9e49-51364de30c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f945dd32a66467387c97bec230a205f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:00.348033 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6fcef433-29bb-409f-9e49-51364de30c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f945dd32a66467387c97bec230a205f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:00.359279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6fcef433-29bb-409f-9e49-51364de30c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f945dd32a66467387c97bec230a205f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:00.360771 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6fcef433-29bb-409f-9e49-51364de30c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f945dd32a66467387c97bec230a205f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:00.361857 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6fcef433-29bb-409f-9e49-51364de30c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f945dd32a66467387c97bec230a205f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:00.374440 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ff57c-2703-493d-b8b0-1a033b71d106 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:00.383358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 849/1700] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:00 2022] DELETE /identity/v3/users/9f945dd32a66467387c97bec230a205f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:00.387937 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc50342-2a3d-4fb4-a2bd-7df7aef92e49 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:00.388064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f48481-871d-4131-8bcf-566520bd3037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:00.388522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc50342-2a3d-4fb4-a2bd-7df7aef92e49 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:00.388801 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f48481-871d-4131-8bcf-566520bd3037 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:00.389456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f48481-871d-4131-8bcf-566520bd3037 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:00.389544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc50342-2a3d-4fb4-a2bd-7df7aef92e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:00.389642 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f48481-871d-4131-8bcf-566520bd3037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:00.395925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c5f48481-871d-4131-8bcf-566520bd3037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:00.425050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f48481-871d-4131-8bcf-566520bd3037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:00.425635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-cbc50342-2a3d-4fb4-a2bd-7df7aef92e49 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:00.427620 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cbc50342-2a3d-4fb4-a2bd-7df7aef92e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:00.435959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f48481-871d-4131-8bcf-566520bd3037 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:00.456384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 852/1701] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:00.457322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f48481-871d-4131-8bcf-566520bd3037 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:00.458915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c5f48481-871d-4131-8bcf-566520bd3037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:00.521154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 850/1702] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:00.661729 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f48481-871d-4131-8bcf-566520bd3037 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:00.665181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc50342-2a3d-4fb4-a2bd-7df7aef92e49 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:00.666991 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cbc50342-2a3d-4fb4-a2bd-7df7aef92e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:00.753157 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:00.786247 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc50342-2a3d-4fb4-a2bd-7df7aef92e49 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:00.808430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58cbfb-76b2-490d-b805-368702a8258b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:00.809133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58cbfb-76b2-490d-b805-368702a8258b service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:00.809412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58cbfb-76b2-490d-b805-368702a8258b service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:00.809699 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58cbfb-76b2-490d-b805-368702a8258b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:00.845075 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58cbfb-76b2-490d-b805-368702a8258b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:00.846554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58cbfb-76b2-490d-b805-368702a8258b service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:00.848568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a06216-8db4-4d10-8ac0-ff4b6fccb397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:00.849470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06216-8db4-4d10-8ac0-ff4b6fccb397 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:00.851302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06216-8db4-4d10-8ac0-ff4b6fccb397 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:00.851760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06216-8db4-4d10-8ac0-ff4b6fccb397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:00.855600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-82a06216-8db4-4d10-8ac0-ff4b6fccb397 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:00.879343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:00.887136 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 851/1703] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:26:00.889419 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54793ed3-b8a1-462f-a5d1-27ff60ab2d44 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:00.889626 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54793ed3-b8a1-462f-a5d1-27ff60ab2d44 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:00.889923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54793ed3-b8a1-462f-a5d1-27ff60ab2d44 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:00.898201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 852/1704] 10.222.0.59 () {54 vars in 912 bytes} [Tue Aug 9 11:26:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:26:00.904671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669de916-7ef6-4785-b57b-d222a9a06f0c None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:00.904951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669de916-7ef6-4785-b57b-d222a9a06f0c None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:00.905230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669de916-7ef6-4785-b57b-d222a9a06f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:01.002456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a06216-8db4-4d10-8ac0-ff4b6fccb397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:01.010468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a06216-8db4-4d10-8ac0-ff4b6fccb397 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:01.027848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-669de916-7ef6-4785-b57b-d222a9a06f0c None None] MFA Rules not processed for user `54cdc076295642bf945fe63a972b8aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:01.034406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-669de916-7ef6-4785-b57b-d222a9a06f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:01.041005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 853/1705] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:01.059179 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 853/1706] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:26:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:01.099251 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a06216-8db4-4d10-8ac0-ff4b6fccb397 service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:01.102071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-82a06216-8db4-4d10-8ac0-ff4b6fccb397 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:01.135160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a06216-8db4-4d10-8ac0-ff4b6fccb397 service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:01.149873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30907387-942d-48d3-a9ca-5a082844269e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:01.152862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907387-942d-48d3-a9ca-5a082844269e service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:01.153096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907387-942d-48d3-a9ca-5a082844269e service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:01.153419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907387-942d-48d3-a9ca-5a082844269e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:01.182295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669de916-7ef6-4785-b57b-d222a9a06f0c None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:01.183907 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-669de916-7ef6-4785-b57b-d222a9a06f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:01.184419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30907387-942d-48d3-a9ca-5a082844269e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:01.188849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30907387-942d-48d3-a9ca-5a082844269e service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:01.204732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669de916-7ef6-4785-b57b-d222a9a06f0c None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:01.212278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 854/1707] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:01.229838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:01.230430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:01.230663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:01.230963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d admin admin] PATH_INFO: `/v3/projects/0008ea6d586e4d34a3f505d9d9893034` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:01.232946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0008ea6d586e4d34a3f505d9d9893034)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:01.238248 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:01.355018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0008ea6d586e4d34a3f505d9d9893034', 'request_id': 'req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:01.364037 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0008ea6d586e4d34a3f505d9d9893034', 'request_id': 'req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:01.375692 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0008ea6d586e4d34a3f505d9d9893034', 'request_id': 'req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:01.403441 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d admin admin] The token cache is being invalidate because project 0008ea6d586e4d34a3f505d9d9893034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:01.403824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:01.404566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-12c1ac40-cdb2-4c7b-8e0a-f21ef9b2e73d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:01.406870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 854/1708] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:01 2022] DELETE /identity/v3/projects/0008ea6d586e4d34a3f505d9d9893034 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:01.412198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13205d-383f-4af0-b057-5868e8fe8a71 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:01.412454 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13205d-383f-4af0-b057-5868e8fe8a71 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:01.412787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13205d-383f-4af0-b057-5868e8fe8a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:01.446855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-7f13205d-383f-4af0-b057-5868e8fe8a71 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:01.448888 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7f13205d-383f-4af0-b057-5868e8fe8a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:01.606089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 855/1709] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:01.613389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda5c02-4304-4622-888e-72bbf53b4e45 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:01.613675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda5c02-4304-4622-888e-72bbf53b4e45 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:01.613936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda5c02-4304-4622-888e-72bbf53b4e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:01.645350 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-5eda5c02-4304-4622-888e-72bbf53b4e45 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:01.647518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5eda5c02-4304-4622-888e-72bbf53b4e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:01.660014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 855/1710] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:01.661134 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13205d-383f-4af0-b057-5868e8fe8a71 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:01.679519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13205d-383f-4af0-b057-5868e8fe8a71 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:01.707130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b91866-55a4-468d-b8e6-960cfdd99aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:01.708760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b91866-55a4-468d-b8e6-960cfdd99aad admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:01.709041 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b91866-55a4-468d-b8e6-960cfdd99aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:01.709347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b91866-55a4-468d-b8e6-960cfdd99aad admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:01.712331 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b91866-55a4-468d-b8e6-960cfdd99aad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:01.712647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b91866-55a4-468d-b8e6-960cfdd99aad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:01.719378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b91866-55a4-468d-b8e6-960cfdd99aad admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:01.732751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda5c02-4304-4622-888e-72bbf53b4e45 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:01.734423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5eda5c02-4304-4622-888e-72bbf53b4e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:01.751893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda5c02-4304-4622-888e-72bbf53b4e45 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:01.757173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94507c-ee5a-456d-8953-848d0f49fd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:01.757857 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94507c-ee5a-456d-8953-848d0f49fd72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:01.758090 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94507c-ee5a-456d-8953-848d0f49fd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:01.758363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94507c-ee5a-456d-8953-848d0f49fd72 admin admin] PATH_INFO: `/v3/projects/795f414999e4467c8cfd3f5dcb7fbe9c` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:01.759555 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94507c-ee5a-456d-8953-848d0f49fd72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=795f414999e4467c8cfd3f5dcb7fbe9c)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:01.761623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94507c-ee5a-456d-8953-848d0f49fd72 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:01.767536 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 856/1711] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:01.772086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b91866-55a4-468d-b8e6-960cfdd99aad admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:01.784973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b91866-55a4-468d-b8e6-960cfdd99aad admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:01.791001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67277018-5c39-43e9-85a8-9754b6fbe8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:01.791636 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67277018-5c39-43e9-85a8-9754b6fbe8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:01.791974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67277018-5c39-43e9-85a8-9754b6fbe8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:01.792304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67277018-5c39-43e9-85a8-9754b6fbe8d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:01.793044 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67277018-5c39-43e9-85a8-9754b6fbe8d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:01.795155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67277018-5c39-43e9-85a8-9754b6fbe8d0 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:01.828940 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-2c94507c-ee5a-456d-8953-848d0f49fd72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795f414999e4467c8cfd3f5dcb7fbe9c', 'request_id': 'req-2c94507c-ee5a-456d-8953-848d0f49fd72'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:01.841432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 857/1712] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:01 2022] POST /identity/v3/projects => generated 403 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:01.841432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ddc7-7a44-4c20-91b4-e6293696f0de None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:01.841432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ddc7-7a44-4c20-91b4-e6293696f0de None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:01.841432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ddc7-7a44-4c20-91b4-e6293696f0de None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:01.842397 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-2c94507c-ee5a-456d-8953-848d0f49fd72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795f414999e4467c8cfd3f5dcb7fbe9c', 'request_id': 'req-2c94507c-ee5a-456d-8953-848d0f49fd72'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:01.842996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 858/1713] 10.222.0.59 () {54 vars in 912 bytes} [Tue Aug 9 11:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:26:01.843932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2ddc7-7a44-4c20-91b4-e6293696f0de None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:01.855114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-2c94507c-ee5a-456d-8953-848d0f49fd72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795f414999e4467c8cfd3f5dcb7fbe9c', 'request_id': 'req-2c94507c-ee5a-456d-8953-848d0f49fd72'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:01.869715 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-2c94507c-ee5a-456d-8953-848d0f49fd72 admin admin] The token cache is being invalidate because project 795f414999e4467c8cfd3f5dcb7fbe9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:01.870401 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-2c94507c-ee5a-456d-8953-848d0f49fd72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:01.871304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-2c94507c-ee5a-456d-8953-848d0f49fd72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:01.877200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 856/1714] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:01 2022] DELETE /identity/v3/projects/795f414999e4467c8cfd3f5dcb7fbe9c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:01.879776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e52a0e-49e9-43b7-8b4c-45d5d697a4bf None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:01.880493 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e52a0e-49e9-43b7-8b4c-45d5d697a4bf None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:01.880941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e52a0e-49e9-43b7-8b4c-45d5d697a4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:01.914071 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-73e52a0e-49e9-43b7-8b4c-45d5d697a4bf None None] MFA Rules not processed for user `54cdc076295642bf945fe63a972b8aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:01.916301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-73e52a0e-49e9-43b7-8b4c-45d5d697a4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:01.953250 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:01.977081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2ddc7-7a44-4c20-91b4-e6293696f0de None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:01.984679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782b611-4117-462a-b8ca-9e8d20ea3da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:01.985106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b611-4117-462a-b8ca-9e8d20ea3da8 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:01.985524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b611-4117-462a-b8ca-9e8d20ea3da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:01.985816 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b611-4117-462a-b8ca-9e8d20ea3da8 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:01.986517 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782b611-4117-462a-b8ca-9e8d20ea3da8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:01.989793 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782b611-4117-462a-b8ca-9e8d20ea3da8 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:02.006069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:02.026045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 859/1715] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:01 2022] POST /identity/v3/users => generated 302 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:02.027697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782b611-4117-462a-b8ca-9e8d20ea3da8 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:02.030360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7782b611-4117-462a-b8ca-9e8d20ea3da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:02.046959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782b611-4117-462a-b8ca-9e8d20ea3da8 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:02.054691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ac62f-f973-4708-ad39-71d81ada97e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:02.056721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ac62f-f973-4708-ad39-71d81ada97e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:02.057010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ac62f-f973-4708-ad39-71d81ada97e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:02.057395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ac62f-f973-4708-ad39-71d81ada97e1 admin admin] PATH_INFO: `/v3/users/ccd158513058413c9d92fd5388969959` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:02.059272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ac62f-f973-4708-ad39-71d81ada97e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd158513058413c9d92fd5388969959)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:02.061167 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ac62f-f973-4708-ad39-71d81ada97e1 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:02.080706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 857/1716] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:26:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:02.087633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e52a0e-49e9-43b7-8b4c-45d5d697a4bf None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:02.089816 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-73e52a0e-49e9-43b7-8b4c-45d5d697a4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:02.107577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e52a0e-49e9-43b7-8b4c-45d5d697a4bf None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:02.112996 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61253-45fd-4df8-b9e4-ad9704234501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:02.113693 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61253-45fd-4df8-b9e4-ad9704234501 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:02.113982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61253-45fd-4df8-b9e4-ad9704234501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:02.114252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61253-45fd-4df8-b9e4-ad9704234501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:02.115044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab61253-45fd-4df8-b9e4-ad9704234501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:02.116774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab61253-45fd-4df8-b9e4-ad9704234501 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:02.128102 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 858/1717] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:02.132346 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61253-45fd-4df8-b9e4-ad9704234501 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:02.134334 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-eab61253-45fd-4df8-b9e4-ad9704234501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:02.147206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61253-45fd-4df8-b9e4-ad9704234501 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:02.151337 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414ee18-44f9-4b4b-8b24-99957a2eec1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:02.152054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414ee18-44f9-4b4b-8b24-99957a2eec1e service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:02.152350 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414ee18-44f9-4b4b-8b24-99957a2eec1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:02.152600 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414ee18-44f9-4b4b-8b24-99957a2eec1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:02.168046 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-583ac62f-f973-4708-ad39-71d81ada97e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd158513058413c9d92fd5388969959'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:02.171826 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414ee18-44f9-4b4b-8b24-99957a2eec1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:02.174135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414ee18-44f9-4b4b-8b24-99957a2eec1e service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:02.186129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 859/1718] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:02.187291 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414ee18-44f9-4b4b-8b24-99957a2eec1e service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:02.191249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-583ac62f-f973-4708-ad39-71d81ada97e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd158513058413c9d92fd5388969959'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:02.193115 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-583ac62f-f973-4708-ad39-71d81ada97e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd158513058413c9d92fd5388969959'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:02.194127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-583ac62f-f973-4708-ad39-71d81ada97e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd158513058413c9d92fd5388969959'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:02.200956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414ee18-44f9-4b4b-8b24-99957a2eec1e service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:02.208104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4caab-185b-4e2a-aa24-00414b188504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:02.208748 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4caab-185b-4e2a-aa24-00414b188504 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:02.209055 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4caab-185b-4e2a-aa24-00414b188504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:02.209621 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4caab-185b-4e2a-aa24-00414b188504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:02.210434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4caab-185b-4e2a-aa24-00414b188504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:02.212989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4caab-185b-4e2a-aa24-00414b188504 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:02.218267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-583ac62f-f973-4708-ad39-71d81ada97e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd158513058413c9d92fd5388969959'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:02.231217 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 860/1719] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:02.234024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4caab-185b-4e2a-aa24-00414b188504 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:02.239820 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-05e4caab-185b-4e2a-aa24-00414b188504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:02.250968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 860/1720] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:02 2022] DELETE /identity/v3/users/ccd158513058413c9d92fd5388969959 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:02.297590 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4caab-185b-4e2a-aa24-00414b188504 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:02.459468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06395-fa57-41bc-9376-e1459adc4c62 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:02.459764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06395-fa57-41bc-9376-e1459adc4c62 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:02.460017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06395-fa57-41bc-9376-e1459adc4c62 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:02.461352 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 861/1721] 10.222.0.59 () {54 vars in 961 bytes} [Tue Aug 9 11:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:26:02.467361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beecf45-d7ad-4cfa-b253-ccb567d6beb4 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:02.467640 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beecf45-d7ad-4cfa-b253-ccb567d6beb4 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:02.467935 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beecf45-d7ad-4cfa-b253-ccb567d6beb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:02.490398 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49eb875-32ea-462a-9dd2-3d8dea538c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:02.491220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49eb875-32ea-462a-9dd2-3d8dea538c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:02.491568 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49eb875-32ea-462a-9dd2-3d8dea538c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:02.492087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49eb875-32ea-462a-9dd2-3d8dea538c04 admin admin] PATH_INFO: `/v3/projects/3040c15d5e34481699643c898e997090/users/6e89300829514bd6949a86866d684428/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:02.517788 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-3beecf45-d7ad-4cfa-b253-ccb567d6beb4 None None] MFA Rules not processed for user `a04b584a68cb488492046faa23e15463`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:02.522518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-3beecf45-d7ad-4cfa-b253-ccb567d6beb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:02.531809 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49eb875-32ea-462a-9dd2-3d8dea538c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3040c15d5e34481699643c898e997090, user_id=6e89300829514bd6949a86866d684428, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:02.535400 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49eb875-32ea-462a-9dd2-3d8dea538c04 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:02.568942 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 861/1722] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:02 2022] PUT /identity/v3/projects/3040c15d5e34481699643c898e997090/users/6e89300829514bd6949a86866d684428/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:02.571328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728be34-240b-4149-9c40-f1ded2c8023b None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:02.572263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728be34-240b-4149-9c40-f1ded2c8023b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:02.572618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728be34-240b-4149-9c40-f1ded2c8023b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:02.613408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b728be34-240b-4149-9c40-f1ded2c8023b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:02.616306 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 862/1723] 10.222.0.59 () {58 vars in 1058 bytes} [Tue Aug 9 11:26:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:02.624071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beecf45-d7ad-4cfa-b253-ccb567d6beb4 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:02.624637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b728be34-240b-4149-9c40-f1ded2c8023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:02.636534 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beecf45-d7ad-4cfa-b253-ccb567d6beb4 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:02.766175 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 862/1724] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:02.769078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd2c4-92a1-40a2-b117-681f64eaf08b None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:02.769887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd2c4-92a1-40a2-b117-681f64eaf08b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:02.770482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd2c4-92a1-40a2-b117-681f64eaf08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:02.799985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-57edd2c4-92a1-40a2-b117-681f64eaf08b None None] MFA Rules not processed for user `8f9dc600fea34effa2afa8aee54aab7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:02.801163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-57edd2c4-92a1-40a2-b117-681f64eaf08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:02.813748 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:02.835488 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b0462-fbee-480f-9630-4f9837a00158 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:02.838425 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b0462-fbee-480f-9630-4f9837a00158 service placement] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:02.839586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b0462-fbee-480f-9630-4f9837a00158 service placement] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:02.841035 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b0462-fbee-480f-9630-4f9837a00158 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:02.846027 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-940b0462-fbee-480f-9630-4f9837a00158 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:02.869643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:02.880724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 863/1725] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:02.881358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b0462-fbee-480f-9630-4f9837a00158 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:02.882053 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edd2c4-92a1-40a2-b117-681f64eaf08b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:02.883535 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b0462-fbee-480f-9630-4f9837a00158 service placement] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:02.883656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-57edd2c4-92a1-40a2-b117-681f64eaf08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:02.913383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 863/1726] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:26:03.066720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edd2c4-92a1-40a2-b117-681f64eaf08b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:03.076249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd7d9e-e604-4b09-9c8f-00c84861d5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:03.077118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd7d9e-e604-4b09-9c8f-00c84861d5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:03.077539 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd7d9e-e604-4b09-9c8f-00c84861d5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:03.077941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd7d9e-e604-4b09-9c8f-00c84861d5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:03.096823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b0462-fbee-480f-9630-4f9837a00158 service placement] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:03.098883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-940b0462-fbee-480f-9630-4f9837a00158 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:03.165315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd7d9e-e604-4b09-9c8f-00c84861d5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:03.166805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd7d9e-e604-4b09-9c8f-00c84861d5b4 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:03.174647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b0462-fbee-480f-9630-4f9837a00158 service placement] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:03.179655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 864/1727] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:03.216299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecc6ab-e175-47ec-8abb-0ef35a6315d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:03.216971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecc6ab-e175-47ec-8abb-0ef35a6315d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:03.217253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecc6ab-e175-47ec-8abb-0ef35a6315d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:03.217531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecc6ab-e175-47ec-8abb-0ef35a6315d3 admin admin] PATH_INFO: `/v3/users/22876106e28646eabfcfb43e191bccd7` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:03.220950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ecc6ab-e175-47ec-8abb-0ef35a6315d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22876106e28646eabfcfb43e191bccd7)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:03.223095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ecc6ab-e175-47ec-8abb-0ef35a6315d3 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:03.389381 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-76ecc6ab-e175-47ec-8abb-0ef35a6315d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22876106e28646eabfcfb43e191bccd7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:03.416699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-76ecc6ab-e175-47ec-8abb-0ef35a6315d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22876106e28646eabfcfb43e191bccd7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:03.417823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-76ecc6ab-e175-47ec-8abb-0ef35a6315d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22876106e28646eabfcfb43e191bccd7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:03.418976 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-76ecc6ab-e175-47ec-8abb-0ef35a6315d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22876106e28646eabfcfb43e191bccd7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:03.449901 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-76ecc6ab-e175-47ec-8abb-0ef35a6315d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22876106e28646eabfcfb43e191bccd7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:03.466285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 864/1728] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:03 2022] DELETE /identity/v3/users/22876106e28646eabfcfb43e191bccd7 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:03.470549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6931-7ef2-4567-8ac2-ecace93bdb97 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:03.470841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6931-7ef2-4567-8ac2-ecace93bdb97 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:03.471127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6931-7ef2-4567-8ac2-ecace93bdb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:03.512388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-cdcf6931-7ef2-4567-8ac2-ecace93bdb97 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:03.513780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cdcf6931-7ef2-4567-8ac2-ecace93bdb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:03.619307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecc6ab-e175-47ec-8abb-0ef35a6315d3 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:03.621057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-76ecc6ab-e175-47ec-8abb-0ef35a6315d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:03.687240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 865/1729] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:03.714402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf6931-7ef2-4567-8ac2-ecace93bdb97 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:03.715700 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cdcf6931-7ef2-4567-8ac2-ecace93bdb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:03.788484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecc6ab-e175-47ec-8abb-0ef35a6315d3 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:03.800067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324247a1-b52a-41bd-9e28-8e212ce6187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:03.800938 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324247a1-b52a-41bd-9e28-8e212ce6187b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:03.801214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324247a1-b52a-41bd-9e28-8e212ce6187b admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:03.801887 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324247a1-b52a-41bd-9e28-8e212ce6187b admin admin] PATH_INFO: `/v3/projects/68ebd9c3095a40bab1cd580148fb4a4d` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:03.804406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324247a1-b52a-41bd-9e28-8e212ce6187b admin admin] RBAC: Authorizing `identity:delete_project(project_id=68ebd9c3095a40bab1cd580148fb4a4d)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:03.808757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324247a1-b52a-41bd-9e28-8e212ce6187b admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:03.901090 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf6931-7ef2-4567-8ac2-ecace93bdb97 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:03.912256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc46a56-2cef-4d59-8c2c-43e269bab239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:03.912948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc46a56-2cef-4d59-8c2c-43e269bab239 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:03.913224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc46a56-2cef-4d59-8c2c-43e269bab239 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:03.913533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc46a56-2cef-4d59-8c2c-43e269bab239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:03.953159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc46a56-2cef-4d59-8c2c-43e269bab239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:03.954639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc46a56-2cef-4d59-8c2c-43e269bab239 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:04.001059 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 866/1730] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:04.049989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-324247a1-b52a-41bd-9e28-8e212ce6187b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68ebd9c3095a40bab1cd580148fb4a4d', 'request_id': 'req-324247a1-b52a-41bd-9e28-8e212ce6187b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:04.078398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-324247a1-b52a-41bd-9e28-8e212ce6187b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68ebd9c3095a40bab1cd580148fb4a4d', 'request_id': 'req-324247a1-b52a-41bd-9e28-8e212ce6187b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:04.097526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-324247a1-b52a-41bd-9e28-8e212ce6187b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68ebd9c3095a40bab1cd580148fb4a4d', 'request_id': 'req-324247a1-b52a-41bd-9e28-8e212ce6187b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:04.109223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:04.148502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-324247a1-b52a-41bd-9e28-8e212ce6187b admin admin] The token cache is being invalidate because project 68ebd9c3095a40bab1cd580148fb4a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:04.148502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-324247a1-b52a-41bd-9e28-8e212ce6187b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:04.153913 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-324247a1-b52a-41bd-9e28-8e212ce6187b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:04.157057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 865/1731] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:03 2022] DELETE /identity/v3/projects/68ebd9c3095a40bab1cd580148fb4a4d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:04.162020 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab772-06df-4353-a44e-fe287431d097 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:04.162346 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab772-06df-4353-a44e-fe287431d097 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:04.162566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab772-06df-4353-a44e-fe287431d097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:04.199586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47b23d-f2c4-4882-9fec-bfa13366d0b0 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:04.200078 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47b23d-f2c4-4882-9fec-bfa13366d0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:04.200513 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47b23d-f2c4-4882-9fec-bfa13366d0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:04.202596 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:04.238956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-3f47b23d-f2c4-4882-9fec-bfa13366d0b0 None None] MFA Rules not processed for user `8512df3e232c4fd59b7abad4e6e05c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:04.240987 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-3f47b23d-f2c4-4882-9fec-bfa13366d0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:04.267972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c77ab772-06df-4353-a44e-fe287431d097 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:04.272550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c77ab772-06df-4353-a44e-fe287431d097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:04.409553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 866/1732] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:04.434117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 867/1733] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:04.444763 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c2503-f66e-4af9-8231-11f4e3c145ed None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:04.445050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c2503-f66e-4af9-8231-11f4e3c145ed None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:04.445379 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c2503-f66e-4af9-8231-11f4e3c145ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:04.481255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-d69c2503-f66e-4af9-8231-11f4e3c145ed None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:04.483048 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d69c2503-f66e-4af9-8231-11f4e3c145ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:04.499710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 867/1734] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:04.503090 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ab772-06df-4353-a44e-fe287431d097 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:04.517931 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ab772-06df-4353-a44e-fe287431d097 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:04.559697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6108cd-eea2-4cbd-b923-85b7eda64b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:04.560688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6108cd-eea2-4cbd-b923-85b7eda64b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:04.561113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6108cd-eea2-4cbd-b923-85b7eda64b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:04.561531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6108cd-eea2-4cbd-b923-85b7eda64b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:04.562369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6108cd-eea2-4cbd-b923-85b7eda64b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:04.562841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6108cd-eea2-4cbd-b923-85b7eda64b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:04.564664 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6108cd-eea2-4cbd-b923-85b7eda64b29 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:04.607260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 868/1735] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:04.608581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c2503-f66e-4af9-8231-11f4e3c145ed None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:04.624243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c2503-f66e-4af9-8231-11f4e3c145ed None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:04.635556 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4c0a8-513a-4ff8-b988-5415137e0e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:04.636260 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4c0a8-513a-4ff8-b988-5415137e0e27 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:04.636613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4c0a8-513a-4ff8-b988-5415137e0e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:04.636939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4c0a8-513a-4ff8-b988-5415137e0e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:04.639005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4c0a8-513a-4ff8-b988-5415137e0e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:04.646693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4c0a8-513a-4ff8-b988-5415137e0e27 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:04.748931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 868/1736] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:04 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:04.753631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6108cd-eea2-4cbd-b923-85b7eda64b29 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:04.793194 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6108cd-eea2-4cbd-b923-85b7eda64b29 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:04.998247 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90238c3-f9ae-4760-87fa-c490cdd806d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:04.998890 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90238c3-f9ae-4760-87fa-c490cdd806d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:04.999169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90238c3-f9ae-4760-87fa-c490cdd806d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:04.999429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90238c3-f9ae-4760-87fa-c490cdd806d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:05.000355 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90238c3-f9ae-4760-87fa-c490cdd806d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:05.002315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90238c3-f9ae-4760-87fa-c490cdd806d6 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:05.083528 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 869/1737] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:04 2022] POST /identity/v3/users => generated 286 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:05.087890 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4c0a8-513a-4ff8-b988-5415137e0e27 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:05.108964 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4c0a8-513a-4ff8-b988-5415137e0e27 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:05.126963 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b51cdf-59b5-4d0d-b6ba-1e98e09c31ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:05.128130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b51cdf-59b5-4d0d-b6ba-1e98e09c31ad admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:05.128349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b51cdf-59b5-4d0d-b6ba-1e98e09c31ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:05.128622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b51cdf-59b5-4d0d-b6ba-1e98e09c31ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:05.131513 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b51cdf-59b5-4d0d-b6ba-1e98e09c31ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:05.133232 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b51cdf-59b5-4d0d-b6ba-1e98e09c31ad admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:05.169508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 869/1738] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:05.173858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90238c3-f9ae-4760-87fa-c490cdd806d6 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:05.208518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90238c3-f9ae-4760-87fa-c490cdd806d6 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:05.240825 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdaf95-25d6-4c58-8851-2e82a6f99351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:05.241879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdaf95-25d6-4c58-8851-2e82a6f99351 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:05.243962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdaf95-25d6-4c58-8851-2e82a6f99351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:05.244425 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdaf95-25d6-4c58-8851-2e82a6f99351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:05.247168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdaf95-25d6-4c58-8851-2e82a6f99351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:05.249206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdaf95-25d6-4c58-8851-2e82a6f99351 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:05.267188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 870/1739] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:26:05.271532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b51cdf-59b5-4d0d-b6ba-1e98e09c31ad admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:05.285544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b51cdf-59b5-4d0d-b6ba-1e98e09c31ad admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:05.307221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e472f9-a74b-4d49-bb97-d52628b6f62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:05.307916 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e472f9-a74b-4d49-bb97-d52628b6f62e admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:05.308193 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e472f9-a74b-4d49-bb97-d52628b6f62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:05.308475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e472f9-a74b-4d49-bb97-d52628b6f62e admin admin] PATH_INFO: `/v3/projects/36b289f269db46689c0cf1dea50070f5/users/116ff2ae1dd64e349c5f755446980414/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:05.371523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdaf95-25d6-4c58-8851-2e82a6f99351 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:05.373527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a2bdaf95-25d6-4c58-8851-2e82a6f99351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:05.376294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e472f9-a74b-4d49-bb97-d52628b6f62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b289f269db46689c0cf1dea50070f5, user_id=116ff2ae1dd64e349c5f755446980414, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:05.382675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e472f9-a74b-4d49-bb97-d52628b6f62e admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:05.437268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 870/1740] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:05 2022] PUT /identity/v3/projects/36b289f269db46689c0cf1dea50070f5/users/116ff2ae1dd64e349c5f755446980414/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:05.449690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f666b2-515b-42c5-981d-695d83c1ca04 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:05.449961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f666b2-515b-42c5-981d-695d83c1ca04 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:05.450232 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f666b2-515b-42c5-981d-695d83c1ca04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:05.551435 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c1f666b2-515b-42c5-981d-695d83c1ca04 None None] MFA Rules not processed for user `116ff2ae1dd64e349c5f755446980414`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:05.552687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c1f666b2-515b-42c5-981d-695d83c1ca04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:05.582927 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdaf95-25d6-4c58-8851-2e82a6f99351 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:05.685198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:05.743533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d435b-ba4c-4762-93bd-b69dfd809c02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:05.745985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d435b-ba4c-4762-93bd-b69dfd809c02 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:05.746261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d435b-ba4c-4762-93bd-b69dfd809c02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:05.749989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d435b-ba4c-4762-93bd-b69dfd809c02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:05.755679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-3d8d435b-ba4c-4762-93bd-b69dfd809c02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:05.766422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 871/1741] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:05.771597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f666b2-515b-42c5-981d-695d83c1ca04 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:05.775452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c1f666b2-515b-42c5-981d-695d83c1ca04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:05.861047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:05.921028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d435b-ba4c-4762-93bd-b69dfd809c02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:05.923745 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d435b-ba4c-4762-93bd-b69dfd809c02 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:05.954998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 871/1742] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:26:05.955931 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d435b-ba4c-4762-93bd-b69dfd809c02 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:05.960890 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-3d8d435b-ba4c-4762-93bd-b69dfd809c02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:05.967199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f666b2-515b-42c5-981d-695d83c1ca04 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:05.985474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d435b-ba4c-4762-93bd-b69dfd809c02 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:05.987687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:05.988250 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:05.988543 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:05.988808 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5 admin admin] PATH_INFO: `/v3/projects/6c60c68e5637481bba22ab515ee1698c` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:05.991615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c60c68e5637481bba22ab515ee1698c)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:05.995294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:05.997589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacf1c7-7a2f-4b27-b635-0ba6527c56c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:05.998432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacf1c7-7a2f-4b27-b635-0ba6527c56c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:05.999358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacf1c7-7a2f-4b27-b635-0ba6527c56c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:05.999760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacf1c7-7a2f-4b27-b635-0ba6527c56c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:06.032373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcacf1c7-7a2f-4b27-b635-0ba6527c56c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:06.038546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcacf1c7-7a2f-4b27-b635-0ba6527c56c2 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:06.065524 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 872/1743] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:06.091515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacf1c7-7a2f-4b27-b635-0ba6527c56c2 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:06.108010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacf1c7-7a2f-4b27-b635-0ba6527c56c2 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:06.121303 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62646b-7e77-4cd4-98b4-efeb65fba7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:06.121948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62646b-7e77-4cd4-98b4-efeb65fba7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:06.122226 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62646b-7e77-4cd4-98b4-efeb65fba7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:06.123178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62646b-7e77-4cd4-98b4-efeb65fba7b2 admin admin] PATH_INFO: `/v3/users/116ff2ae1dd64e349c5f755446980414` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:06.124677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62646b-7e77-4cd4-98b4-efeb65fba7b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=116ff2ae1dd64e349c5f755446980414)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:06.129177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62646b-7e77-4cd4-98b4-efeb65fba7b2 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:06.182187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c60c68e5637481bba22ab515ee1698c', 'request_id': 'req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:06.226487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c60c68e5637481bba22ab515ee1698c', 'request_id': 'req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:06.251267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9c62646b-7e77-4cd4-98b4-efeb65fba7b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '116ff2ae1dd64e349c5f755446980414'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:06.271441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c60c68e5637481bba22ab515ee1698c', 'request_id': 'req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:06.283795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9c62646b-7e77-4cd4-98b4-efeb65fba7b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '116ff2ae1dd64e349c5f755446980414'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:06.314011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9c62646b-7e77-4cd4-98b4-efeb65fba7b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '116ff2ae1dd64e349c5f755446980414'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:06.317040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9c62646b-7e77-4cd4-98b4-efeb65fba7b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '116ff2ae1dd64e349c5f755446980414'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:06.318927 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9c62646b-7e77-4cd4-98b4-efeb65fba7b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '116ff2ae1dd64e349c5f755446980414'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:06.346030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5 admin admin] The token cache is being invalidate because project 6c60c68e5637481bba22ab515ee1698c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:06.346327 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:06.355010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fc2c1aeb-cb29-4ac3-8277-c30fd93f0ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:06.371253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 872/1745] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:05 2022] DELETE /identity/v3/projects/6c60c68e5637481bba22ab515ee1698c => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:06.372259 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 873/1745] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:06 2022] DELETE /identity/v3/users/116ff2ae1dd64e349c5f755446980414 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:06.373243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751688c0-0044-4370-ae7d-c309649d10a6 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:06.373528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751688c0-0044-4370-ae7d-c309649d10a6 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:06.373809 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751688c0-0044-4370-ae7d-c309649d10a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:06.374119 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63179d9-288b-4266-a826-7039af9a0ac8 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:06.374564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63179d9-288b-4266-a826-7039af9a0ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:06.374863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63179d9-288b-4266-a826-7039af9a0ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:06.451408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b63179d9-288b-4266-a826-7039af9a0ac8 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:06.454160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b63179d9-288b-4266-a826-7039af9a0ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:06.493837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-751688c0-0044-4370-ae7d-c309649d10a6 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:06.497815 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-751688c0-0044-4370-ae7d-c309649d10a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:06.615369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:06.800827 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 874/1746] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:06.810102 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff8de1-ea92-48c0-be2b-912b1f1ad333 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:06.811895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff8de1-ea92-48c0-be2b-912b1f1ad333 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:06.812197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff8de1-ea92-48c0-be2b-912b1f1ad333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:06.818681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 873/1747] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:06.820254 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af88d69-5dbc-4cc4-82b3-7a4341d530d8 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:06.825034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af88d69-5dbc-4cc4-82b3-7a4341d530d8 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:06.825363 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af88d69-5dbc-4cc4-82b3-7a4341d530d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:06.927179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-7af88d69-5dbc-4cc4-82b3-7a4341d530d8 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:06.937103 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7af88d69-5dbc-4cc4-82b3-7a4341d530d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:06.980462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 874/1748] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:06.989720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af88d69-5dbc-4cc4-82b3-7a4341d530d8 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:07.001640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a2ff8de1-ea92-48c0-be2b-912b1f1ad333 None None] MFA Rules not processed for user `6e89300829514bd6949a86866d684428`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:07.002981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a2ff8de1-ea92-48c0-be2b-912b1f1ad333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:07.025202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af88d69-5dbc-4cc4-82b3-7a4341d530d8 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:07.038616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42163c85-f2e1-4e08-bb61-bf99251b8eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:07.039698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42163c85-f2e1-4e08-bb61-bf99251b8eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:07.041064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42163c85-f2e1-4e08-bb61-bf99251b8eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:07.042428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42163c85-f2e1-4e08-bb61-bf99251b8eb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:07.043310 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42163c85-f2e1-4e08-bb61-bf99251b8eb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:07.044605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42163c85-f2e1-4e08-bb61-bf99251b8eb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:07.050147 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42163c85-f2e1-4e08-bb61-bf99251b8eb0 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:07.094677 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 875/1749] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:07.095890 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42163c85-f2e1-4e08-bb61-bf99251b8eb0 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:07.101523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-42163c85-f2e1-4e08-bb61-bf99251b8eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:07.238985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:07.271358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42163c85-f2e1-4e08-bb61-bf99251b8eb0 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:07.293338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54287b2d-26f9-470d-a189-455e849fe359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:07.294196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54287b2d-26f9-470d-a189-455e849fe359 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:07.295508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54287b2d-26f9-470d-a189-455e849fe359 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:07.296123 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54287b2d-26f9-470d-a189-455e849fe359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:07.320595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54287b2d-26f9-470d-a189-455e849fe359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:07.328230 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54287b2d-26f9-470d-a189-455e849fe359 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:07.363236 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 876/1750] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:07.366406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54287b2d-26f9-470d-a189-455e849fe359 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:07.392192 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 875/1751] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:06 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 587 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:07.395470 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff8de1-ea92-48c0-be2b-912b1f1ad333 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:07.398587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a2ff8de1-ea92-48c0-be2b-912b1f1ad333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:07.399099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54287b2d-26f9-470d-a189-455e849fe359 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:07.416548 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95b337-70ff-4779-b8be-5e7feded9a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:07.417100 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95b337-70ff-4779-b8be-5e7feded9a93 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:07.417374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95b337-70ff-4779-b8be-5e7feded9a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:07.417645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95b337-70ff-4779-b8be-5e7feded9a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:07.426128 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95b337-70ff-4779-b8be-5e7feded9a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:07.432667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95b337-70ff-4779-b8be-5e7feded9a93 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:07.441730 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff8de1-ea92-48c0-be2b-912b1f1ad333 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:07.455193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c643a3-72e7-46bb-b9de-fc84ddc53354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:07.456542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c643a3-72e7-46bb-b9de-fc84ddc53354 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:07.458712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c643a3-72e7-46bb-b9de-fc84ddc53354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:07.459130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c643a3-72e7-46bb-b9de-fc84ddc53354 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:07.460720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c643a3-72e7-46bb-b9de-fc84ddc53354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:07.463250 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c643a3-72e7-46bb-b9de-fc84ddc53354 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:07.507687 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 876/1752] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:07 2022] POST /identity/v3/projects => generated 405 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:07.511991 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c643a3-72e7-46bb-b9de-fc84ddc53354 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:07.515269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 877/1753] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:07 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:07.540334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95b337-70ff-4779-b8be-5e7feded9a93 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:07.652878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c643a3-72e7-46bb-b9de-fc84ddc53354 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:07.783042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95b337-70ff-4779-b8be-5e7feded9a93 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:07.806308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862bd88-69e1-44dd-aff5-60305ffe9f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:07.806988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862bd88-69e1-44dd-aff5-60305ffe9f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:07.807267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862bd88-69e1-44dd-aff5-60305ffe9f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:07.807540 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862bd88-69e1-44dd-aff5-60305ffe9f86 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:07.808190 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862bd88-69e1-44dd-aff5-60305ffe9f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:07.810136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862bd88-69e1-44dd-aff5-60305ffe9f86 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:07.885453 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 878/1754] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:07 2022] POST /identity/v3/users => generated 288 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:07.886719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:07.892179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862bd88-69e1-44dd-aff5-60305ffe9f86 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:07.930054 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862bd88-69e1-44dd-aff5-60305ffe9f86 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:07.951952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff13a26-ab70-4e18-a45e-8c88bdf35c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:07.956546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff13a26-ab70-4e18-a45e-8c88bdf35c5c admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:07.956857 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff13a26-ab70-4e18-a45e-8c88bdf35c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:07.958416 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff13a26-ab70-4e18-a45e-8c88bdf35c5c admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:07.961422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff13a26-ab70-4e18-a45e-8c88bdf35c5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:07.961838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e15ee0-1768-42aa-8cd9-4c3741bfee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:07.962063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15ee0-1768-42aa-8cd9-4c3741bfee11 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:07.962321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15ee0-1768-42aa-8cd9-4c3741bfee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:07.962588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15ee0-1768-42aa-8cd9-4c3741bfee11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:07.963333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e15ee0-1768-42aa-8cd9-4c3741bfee11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:07.964999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e15ee0-1768-42aa-8cd9-4c3741bfee11 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:07.968080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff13a26-ab70-4e18-a45e-8c88bdf35c5c admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:08.018910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 879/1755] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:08.020016 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e15ee0-1768-42aa-8cd9-4c3741bfee11 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:08.053397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e15ee0-1768-42aa-8cd9-4c3741bfee11 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:08.065504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177e2ea-6ec8-4962-be14-00d9dc45ba28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:08.066135 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177e2ea-6ec8-4962-be14-00d9dc45ba28 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:08.066443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177e2ea-6ec8-4962-be14-00d9dc45ba28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:08.066713 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177e2ea-6ec8-4962-be14-00d9dc45ba28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:08.073012 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 877/1756] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:07 2022] POST /identity/v3/users => generated 309 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:08.074197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff13a26-ab70-4e18-a45e-8c88bdf35c5c admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:08.074483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177e2ea-6ec8-4962-be14-00d9dc45ba28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:08.081031 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177e2ea-6ec8-4962-be14-00d9dc45ba28 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:08.100860 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff13a26-ab70-4e18-a45e-8c88bdf35c5c admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:08.115686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 880/1757] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:08.116679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177e2ea-6ec8-4962-be14-00d9dc45ba28 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:08.148912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177e2ea-6ec8-4962-be14-00d9dc45ba28 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:08.152616 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210cad9-24a7-4be2-b2e9-0cee891f9c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:08.153302 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210cad9-24a7-4be2-b2e9-0cee891f9c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:08.153590 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210cad9-24a7-4be2-b2e9-0cee891f9c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:08.153868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210cad9-24a7-4be2-b2e9-0cee891f9c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:08.154621 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210cad9-24a7-4be2-b2e9-0cee891f9c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:08.162569 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210cad9-24a7-4be2-b2e9-0cee891f9c8d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:08.166374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c24e4-6471-4730-a469-a4538f53cf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:08.167104 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c24e4-6471-4730-a469-a4538f53cf2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:08.167378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c24e4-6471-4730-a469-a4538f53cf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:08.167646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c24e4-6471-4730-a469-a4538f53cf2c admin admin] PATH_INFO: `/v3/projects/e57121d25149469ca093abb33c9082f4/users/44cd0733cef0489997c52c3bc44e2a8c/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:08.211099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c24e4-6471-4730-a469-a4538f53cf2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57121d25149469ca093abb33c9082f4, user_id=44cd0733cef0489997c52c3bc44e2a8c, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:08.213845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c24e4-6471-4730-a469-a4538f53cf2c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:08.216894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 878/1758] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:08.222327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210cad9-24a7-4be2-b2e9-0cee891f9c8d admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:08.270904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 881/1759] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:08 2022] PUT /identity/v3/projects/e57121d25149469ca093abb33c9082f4/users/44cd0733cef0489997c52c3bc44e2a8c/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:08.278311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8758e-c682-46f7-be12-dbd40c0eb03e None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:08.278311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8758e-c682-46f7-be12-dbd40c0eb03e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:08.278311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8758e-c682-46f7-be12-dbd40c0eb03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:08.291654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210cad9-24a7-4be2-b2e9-0cee891f9c8d admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:08.356860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-28a8758e-c682-46f7-be12-dbd40c0eb03e None None] MFA Rules not processed for user `44cd0733cef0489997c52c3bc44e2a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:08.357619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-28a8758e-c682-46f7-be12-dbd40c0eb03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:08.499604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:08.521980 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2b7f1-1643-4866-9fa4-6d7cf4651d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:08.523182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b7f1-1643-4866-9fa4-6d7cf4651d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:08.523521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b7f1-1643-4866-9fa4-6d7cf4651d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:08.523995 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b7f1-1643-4866-9fa4-6d7cf4651d35 admin admin] PATH_INFO: `/v3/projects/65ce53dd25ff47168f4a68e2bce2ae56/users/0131d58c18e14834ba951a56de90a850/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:08.540812 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 882/1760] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:08.552959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8758e-c682-46f7-be12-dbd40c0eb03e None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:08.556206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-28a8758e-c682-46f7-be12-dbd40c0eb03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:08.562477 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2b7f1-1643-4866-9fa4-6d7cf4651d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ce53dd25ff47168f4a68e2bce2ae56, user_id=0131d58c18e14834ba951a56de90a850, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:08.571593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2b7f1-1643-4866-9fa4-6d7cf4651d35 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:08.597225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 879/1761] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:08 2022] PUT /identity/v3/projects/65ce53dd25ff47168f4a68e2bce2ae56/users/0131d58c18e14834ba951a56de90a850/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:08.602013 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2b7f1-1643-4866-9fa4-6d7cf4651d35 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:08.725666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2b7f1-1643-4866-9fa4-6d7cf4651d35 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:08.729623 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8758e-c682-46f7-be12-dbd40c0eb03e None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:08.742488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818b882-960b-4eed-bdeb-1f8ed27f5a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:08.743439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818b882-960b-4eed-bdeb-1f8ed27f5a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:08.744043 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818b882-960b-4eed-bdeb-1f8ed27f5a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:08.744471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818b882-960b-4eed-bdeb-1f8ed27f5a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:08.745395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818b882-960b-4eed-bdeb-1f8ed27f5a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:08.753444 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818b882-960b-4eed-bdeb-1f8ed27f5a9a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:08.775783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 880/1762] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:26:08.779902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818b882-960b-4eed-bdeb-1f8ed27f5a9a admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:08.802695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818b882-960b-4eed-bdeb-1f8ed27f5a9a admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:08.817996 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db63ba-d072-4b96-84d5-ee1353517c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:08.818870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db63ba-d072-4b96-84d5-ee1353517c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:08.819246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db63ba-d072-4b96-84d5-ee1353517c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:08.819613 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db63ba-d072-4b96-84d5-ee1353517c2f admin admin] PATH_INFO: `/v3/projects/65ce53dd25ff47168f4a68e2bce2ae56/users/0131d58c18e14834ba951a56de90a850/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:08.823469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b05e9c-9117-461f-941b-8c4ea4ec559c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:08.824111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b05e9c-9117-461f-941b-8c4ea4ec559c service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:08.824385 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b05e9c-9117-461f-941b-8c4ea4ec559c service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:08.824649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db63ba-d072-4b96-84d5-ee1353517c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ce53dd25ff47168f4a68e2bce2ae56, user_id=0131d58c18e14834ba951a56de90a850, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:08.824748 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b05e9c-9117-461f-941b-8c4ea4ec559c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:08.827676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db63ba-d072-4b96-84d5-ee1353517c2f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:08.860291 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 881/1763] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:08 2022] PUT /identity/v3/projects/65ce53dd25ff47168f4a68e2bce2ae56/users/0131d58c18e14834ba951a56de90a850/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:08.896030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b05e9c-9117-461f-941b-8c4ea4ec559c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:08.898146 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b05e9c-9117-461f-941b-8c4ea4ec559c service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:08.908980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 883/1764] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:09.186665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db63ba-d072-4b96-84d5-ee1353517c2f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:09.188987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a7db63ba-d072-4b96-84d5-ee1353517c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:09.303217 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:09.356548 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db63ba-d072-4b96-84d5-ee1353517c2f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:09.384166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:09.384986 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:09.385115 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:09.385337 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d admin admin] PATH_INFO: `/v3/projects/36b289f269db46689c0cf1dea50070f5` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:09.385912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b05e9c-9117-461f-941b-8c4ea4ec559c service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:09.390470 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b289f269db46689c0cf1dea50070f5)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:09.396432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:09.397693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b05e9c-9117-461f-941b-8c4ea4ec559c service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:09.412643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3fcc4-a8a2-41aa-b312-f77a0ef2ef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:09.413412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3fcc4-a8a2-41aa-b312-f77a0ef2ef84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:09.413862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3fcc4-a8a2-41aa-b312-f77a0ef2ef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:09.414248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3fcc4-a8a2-41aa-b312-f77a0ef2ef84 admin admin] PATH_INFO: `/v3/users/44cd0733cef0489997c52c3bc44e2a8c` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:09.415661 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3fcc4-a8a2-41aa-b312-f77a0ef2ef84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44cd0733cef0489997c52c3bc44e2a8c)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:09.418091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3fcc4-a8a2-41aa-b312-f77a0ef2ef84 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:09.463704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:09.525184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b289f269db46689c0cf1dea50070f5', 'request_id': 'req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:09.529459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7ff3fcc4-a8a2-41aa-b312-f77a0ef2ef84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44cd0733cef0489997c52c3bc44e2a8c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:09.534067 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b289f269db46689c0cf1dea50070f5', 'request_id': 'req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:09.546365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b289f269db46689c0cf1dea50070f5', 'request_id': 'req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:09.554499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7ff3fcc4-a8a2-41aa-b312-f77a0ef2ef84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44cd0733cef0489997c52c3bc44e2a8c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:09.556474 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7ff3fcc4-a8a2-41aa-b312-f77a0ef2ef84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44cd0733cef0489997c52c3bc44e2a8c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:09.557333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7ff3fcc4-a8a2-41aa-b312-f77a0ef2ef84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44cd0733cef0489997c52c3bc44e2a8c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:09.566235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d admin admin] The token cache is being invalidate because project 36b289f269db46689c0cf1dea50070f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:09.567164 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:09.568281 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-0fb4fc6a-ec3b-49a0-8fff-fa8ea0c8da6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:09.571769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 882/1765] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:09 2022] DELETE /identity/v3/projects/36b289f269db46689c0cf1dea50070f5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:09.580146 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7ff3fcc4-a8a2-41aa-b312-f77a0ef2ef84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44cd0733cef0489997c52c3bc44e2a8c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:09.584374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a750f9-c3d3-4dc4-85da-878706bf7b9a None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:09.584728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a750f9-c3d3-4dc4-85da-878706bf7b9a None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:09.585060 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a750f9-c3d3-4dc4-85da-878706bf7b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:09.629268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 884/1766] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:09 2022] DELETE /identity/v3/users/44cd0733cef0489997c52c3bc44e2a8c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:09.630732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a3a750f9-c3d3-4dc4-85da-878706bf7b9a None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:09.631429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451a854-984f-49f2-a065-953edf0a42c3 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:09.631720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451a854-984f-49f2-a065-953edf0a42c3 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:09.631999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451a854-984f-49f2-a065-953edf0a42c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:09.639616 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a3a750f9-c3d3-4dc4-85da-878706bf7b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:09.684563 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-a451a854-984f-49f2-a065-953edf0a42c3 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:09.685863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a451a854-984f-49f2-a065-953edf0a42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:09.841064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 885/1767] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:09.856423 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451a854-984f-49f2-a065-953edf0a42c3 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:09.858804 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a451a854-984f-49f2-a065-953edf0a42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:09.862709 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 883/1768] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:09.870641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c75c6-374f-447d-9ea0-2087a4f00b29 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:09.870966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c75c6-374f-447d-9ea0-2087a4f00b29 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:09.871237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c75c6-374f-447d-9ea0-2087a4f00b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:09.896305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a34c75c6-374f-447d-9ea0-2087a4f00b29 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:09.898494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a34c75c6-374f-447d-9ea0-2087a4f00b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:09.925391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 884/1769] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:09.926211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451a854-984f-49f2-a065-953edf0a42c3 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:09.930399 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768976d-fe5e-446d-9fdd-437e61444e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:09.931871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c75c6-374f-447d-9ea0-2087a4f00b29 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:09.932509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768976d-fe5e-446d-9fdd-437e61444e9f service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:09.932799 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768976d-fe5e-446d-9fdd-437e61444e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:09.933072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768976d-fe5e-446d-9fdd-437e61444e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:09.943065 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c75c6-374f-447d-9ea0-2087a4f00b29 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:09.949270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768976d-fe5e-446d-9fdd-437e61444e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:09.950437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d944-721b-45cd-8407-1eb5b8fb651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:09.950980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768976d-fe5e-446d-9fdd-437e61444e9f service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:09.951177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d944-721b-45cd-8407-1eb5b8fb651e admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:09.951473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d944-721b-45cd-8407-1eb5b8fb651e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:09.951817 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d944-721b-45cd-8407-1eb5b8fb651e admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:09.952526 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0d944-721b-45cd-8407-1eb5b8fb651e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:09.952830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0d944-721b-45cd-8407-1eb5b8fb651e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:09.954630 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0d944-721b-45cd-8407-1eb5b8fb651e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:09.965573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 886/1770] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:09.971734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 885/1771] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:09.977202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768976d-fe5e-446d-9fdd-437e61444e9f service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:09.993342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768976d-fe5e-446d-9fdd-437e61444e9f service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:10.003233 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7684a7-21ed-4643-8074-dd924a88e5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:10.004440 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7684a7-21ed-4643-8074-dd924a88e5ed admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:10.005063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7684a7-21ed-4643-8074-dd924a88e5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:10.005063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7684a7-21ed-4643-8074-dd924a88e5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:10.005632 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7684a7-21ed-4643-8074-dd924a88e5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:10.007686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7684a7-21ed-4643-8074-dd924a88e5ed admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:10.085161 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 887/1772] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:09 2022] POST /identity/v3/projects => generated 359 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:10.090243 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d944-721b-45cd-8407-1eb5b8fb651e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:10.115530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d944-721b-45cd-8407-1eb5b8fb651e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:10.211764 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:10.255474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903951fa-3dc5-4d24-aea6-63d517256e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:10.256988 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903951fa-3dc5-4d24-aea6-63d517256e5a admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:10.257434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903951fa-3dc5-4d24-aea6-63d517256e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:10.258066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903951fa-3dc5-4d24-aea6-63d517256e5a admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:10.259401 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903951fa-3dc5-4d24-aea6-63d517256e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:10.262471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903951fa-3dc5-4d24-aea6-63d517256e5a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:10.301517 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 886/1773] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:10 2022] POST /identity/v3/users => generated 280 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:10.303274 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7684a7-21ed-4643-8074-dd924a88e5ed admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:10.328901 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7684a7-21ed-4643-8074-dd924a88e5ed admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:10.351684 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea18300-cc1c-4b05-9e08-48cacbfd43a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:10.352381 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea18300-cc1c-4b05-9e08-48cacbfd43a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:10.352658 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea18300-cc1c-4b05-9e08-48cacbfd43a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:10.352983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea18300-cc1c-4b05-9e08-48cacbfd43a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:10.353721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea18300-cc1c-4b05-9e08-48cacbfd43a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:10.355583 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea18300-cc1c-4b05-9e08-48cacbfd43a7 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:10.367284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 888/1774] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:10.371635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903951fa-3dc5-4d24-aea6-63d517256e5a admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:10.389241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903951fa-3dc5-4d24-aea6-63d517256e5a admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:10.395739 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8cd54-9f41-4865-ac60-2285b79075b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:10.396535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8cd54-9f41-4865-ac60-2285b79075b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:10.396876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8cd54-9f41-4865-ac60-2285b79075b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:10.397222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8cd54-9f41-4865-ac60-2285b79075b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:10.397952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8cd54-9f41-4865-ac60-2285b79075b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:10.399739 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8cd54-9f41-4865-ac60-2285b79075b9 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:10.414868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 887/1775] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:10.416807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea18300-cc1c-4b05-9e08-48cacbfd43a7 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:10.431595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea18300-cc1c-4b05-9e08-48cacbfd43a7 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:10.438153 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba67ff-8c81-4480-8030-374941a1e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:10.440134 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba67ff-8c81-4480-8030-374941a1e6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:10.440134 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba67ff-8c81-4480-8030-374941a1e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:10.440134 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba67ff-8c81-4480-8030-374941a1e6f4 admin admin] PATH_INFO: `/v3/projects/8e05cc943d8c47a4891e21a8abc95a31/users/9c1fe80dd36d44d9a2c73fff80817153/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:10.446166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:10.498337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba67ff-8c81-4480-8030-374941a1e6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e05cc943d8c47a4891e21a8abc95a31, user_id=9c1fe80dd36d44d9a2c73fff80817153, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:10.508398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba67ff-8c81-4480-8030-374941a1e6f4 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:10.558946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 889/1776] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:10 2022] PUT /identity/v3/projects/8e05cc943d8c47a4891e21a8abc95a31/users/9c1fe80dd36d44d9a2c73fff80817153/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:10.564492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38700d89-7856-450b-be3b-f46845d40965 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:10.564807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38700d89-7856-450b-be3b-f46845d40965 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:10.565080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38700d89-7856-450b-be3b-f46845d40965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:10.632661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-38700d89-7856-450b-be3b-f46845d40965 None None] MFA Rules not processed for user `9c1fe80dd36d44d9a2c73fff80817153`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:10.633213 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120dd20-9c03-4a42-80d8-419d70944557 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:10.633624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120dd20-9c03-4a42-80d8-419d70944557 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:10.633951 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120dd20-9c03-4a42-80d8-419d70944557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:10.634052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-38700d89-7856-450b-be3b-f46845d40965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:10.730351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-4120dd20-9c03-4a42-80d8-419d70944557 None None] MFA Rules not processed for user `0131d58c18e14834ba951a56de90a850`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:10.731685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4120dd20-9c03-4a42-80d8-419d70944557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:10.807313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 888/1777] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:10.827011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38700d89-7856-450b-be3b-f46845d40965 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:10.840524 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-38700d89-7856-450b-be3b-f46845d40965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:10.862258 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 890/1778] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:10 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:10.863975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120dd20-9c03-4a42-80d8-419d70944557 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:10.865391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4120dd20-9c03-4a42-80d8-419d70944557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:10.983644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120dd20-9c03-4a42-80d8-419d70944557 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:10.988198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087553e1-f98f-4166-b020-99c172c40451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:10.988838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087553e1-f98f-4166-b020-99c172c40451 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:10.989270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087553e1-f98f-4166-b020-99c172c40451 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:10.989730 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087553e1-f98f-4166-b020-99c172c40451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:11.000948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087553e1-f98f-4166-b020-99c172c40451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:11.004130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087553e1-f98f-4166-b020-99c172c40451 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:11.021792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 891/1779] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:11.046840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087553e1-f98f-4166-b020-99c172c40451 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:11.089614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38700d89-7856-450b-be3b-f46845d40965 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:11.103294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:11.104184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:11.104513 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:11.104874 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072 admin admin] PATH_INFO: `/v3/projects/e57121d25149469ca093abb33c9082f4` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:11.107482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e57121d25149469ca093abb33c9082f4)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:11.112240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:11.195617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087553e1-f98f-4166-b020-99c172c40451 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:11.218385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e57121d25149469ca093abb33c9082f4', 'request_id': 'req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:11.230209 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e57121d25149469ca093abb33c9082f4', 'request_id': 'req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:11.235439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:11.243873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e57121d25149469ca093abb33c9082f4', 'request_id': 'req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:11.261424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:11.261868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072 admin admin] The token cache is being invalidate because project e57121d25149469ca093abb33c9082f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:11.262177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:11.263396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-ad3b4651-d2ac-41b9-9056-e0d3ec6fe072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:11.266516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 889/1780] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:10 2022] DELETE /identity/v3/projects/e57121d25149469ca093abb33c9082f4 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:11.268000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741efe5-38d6-4b28-92b9-ba70a776324f None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:11.269584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741efe5-38d6-4b28-92b9-ba70a776324f None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:11.269584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741efe5-38d6-4b28-92b9-ba70a776324f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:11.329652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-1741efe5-38d6-4b28-92b9-ba70a776324f None None] MFA Rules not processed for user `54cdc076295642bf945fe63a972b8aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:11.333472 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1741efe5-38d6-4b28-92b9-ba70a776324f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:11.447173 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f87faa-45b4-4e9e-8845-54a3749ca5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:11.447912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f87faa-45b4-4e9e-8845-54a3749ca5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:11.448189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f87faa-45b4-4e9e-8845-54a3749ca5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:11.449113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f87faa-45b4-4e9e-8845-54a3749ca5a2 admin admin] PATH_INFO: `/v3/users/9c1fe80dd36d44d9a2c73fff80817153` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:11.451702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f87faa-45b4-4e9e-8845-54a3749ca5a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1fe80dd36d44d9a2c73fff80817153)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:11.454656 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f87faa-45b4-4e9e-8845-54a3749ca5a2 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:11.455964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 890/1781] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Aug 9 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:11.457847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6959d-71a8-4476-8874-6605df6b905f None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:11.459136 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6959d-71a8-4476-8874-6605df6b905f None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:11.459648 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6959d-71a8-4476-8874-6605df6b905f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:11.569156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f0e6959d-71a8-4476-8874-6605df6b905f None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:11.569373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c9f87faa-45b4-4e9e-8845-54a3749ca5a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1fe80dd36d44d9a2c73fff80817153'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:11.571852 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f0e6959d-71a8-4476-8874-6605df6b905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:11.585581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c9f87faa-45b4-4e9e-8845-54a3749ca5a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1fe80dd36d44d9a2c73fff80817153'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:11.592408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c9f87faa-45b4-4e9e-8845-54a3749ca5a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1fe80dd36d44d9a2c73fff80817153'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:11.593224 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c9f87faa-45b4-4e9e-8845-54a3749ca5a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1fe80dd36d44d9a2c73fff80817153'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:11.629571 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c9f87faa-45b4-4e9e-8845-54a3749ca5a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1fe80dd36d44d9a2c73fff80817153'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:11.651878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 892/1782] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:11 2022] DELETE /identity/v3/users/9c1fe80dd36d44d9a2c73fff80817153 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:11.653442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5b5dc-4b8b-4eb7-a4d8-f3951bf660b8 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:11.653731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5b5dc-4b8b-4eb7-a4d8-f3951bf660b8 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:11.653995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5b5dc-4b8b-4eb7-a4d8-f3951bf660b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:11.696054 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-4dc5b5dc-4b8b-4eb7-a4d8-f3951bf660b8 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:11.698554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4dc5b5dc-4b8b-4eb7-a4d8-f3951bf660b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:11.740503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 891/1783] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:11.741637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6959d-71a8-4476-8874-6605df6b905f None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:11.745417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f0e6959d-71a8-4476-8874-6605df6b905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:11.769691 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6959d-71a8-4476-8874-6605df6b905f None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:11.861349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 893/1784] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:11.863435 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5b5dc-4b8b-4eb7-a4d8-f3951bf660b8 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:11.865330 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4dc5b5dc-4b8b-4eb7-a4d8-f3951bf660b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:11.877502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf9e5f-58de-41b6-89c5-79e938b817d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:11.878643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9e5f-58de-41b6-89c5-79e938b817d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:11.879604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9e5f-58de-41b6-89c5-79e938b817d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:11.880073 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9e5f-58de-41b6-89c5-79e938b817d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:11.882415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f9bf9e5f-58de-41b6-89c5-79e938b817d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:11.893255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5b5dc-4b8b-4eb7-a4d8-f3951bf660b8 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:11.894386 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf9e5f-58de-41b6-89c5-79e938b817d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:11.895926 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf9e5f-58de-41b6-89c5-79e938b817d2 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:11.899298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b623e-194c-48f7-aa9c-1e6865f5f0a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:11.900199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b623e-194c-48f7-aa9c-1e6865f5f0a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:11.900568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b623e-194c-48f7-aa9c-1e6865f5f0a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:11.901103 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b623e-194c-48f7-aa9c-1e6865f5f0a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:11.908418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 892/1785] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:11.910141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a347157-aa21-445c-a04b-8f339bc08855 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:11.910432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a347157-aa21-445c-a04b-8f339bc08855 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:11.910710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a347157-aa21-445c-a04b-8f339bc08855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:11.911043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b623e-194c-48f7-aa9c-1e6865f5f0a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:11.912662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b623e-194c-48f7-aa9c-1e6865f5f0a3 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:11.926798 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 894/1786] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:11.928791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb81fe-90a0-464c-85f1-ca213d281f61 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:11.929264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb81fe-90a0-464c-85f1-ca213d281f61 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:11.929671 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb81fe-90a0-464c-85f1-ca213d281f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:11.959862 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-7a347157-aa21-445c-a04b-8f339bc08855 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:11.961567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-7a347157-aa21-445c-a04b-8f339bc08855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:11.968768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-63cb81fe-90a0-464c-85f1-ca213d281f61 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:11.970023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-63cb81fe-90a0-464c-85f1-ca213d281f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:11.981255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 895/1787] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:11.983127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb81fe-90a0-464c-85f1-ca213d281f61 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:11.985861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 893/1788] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:11.987090 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-63cb81fe-90a0-464c-85f1-ca213d281f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:11.988219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a347157-aa21-445c-a04b-8f339bc08855 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:11.998689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:12.010729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a347157-aa21-445c-a04b-8f339bc08855 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:12.015909 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d4b70-0e11-46d9-9aff-ceb97a41249f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:12.016667 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d4b70-0e11-46d9-9aff-ceb97a41249f admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:12.016946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d4b70-0e11-46d9-9aff-ceb97a41249f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:12.017215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d4b70-0e11-46d9-9aff-ceb97a41249f admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:12.017915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d4b70-0e11-46d9-9aff-ceb97a41249f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:12.018324 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d4b70-0e11-46d9-9aff-ceb97a41249f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:12.020115 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d4b70-0e11-46d9-9aff-ceb97a41249f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:12.027144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:12.047112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 894/1789] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:12.047112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d4b70-0e11-46d9-9aff-ceb97a41249f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:12.058286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d4b70-0e11-46d9-9aff-ceb97a41249f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:12.063126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59980dca-9ba7-4061-8855-3b41a3e7629e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:12.063797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59980dca-9ba7-4061-8855-3b41a3e7629e service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:12.064078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59980dca-9ba7-4061-8855-3b41a3e7629e service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:12.064362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59980dca-9ba7-4061-8855-3b41a3e7629e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:12.080893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59980dca-9ba7-4061-8855-3b41a3e7629e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:12.085140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59980dca-9ba7-4061-8855-3b41a3e7629e service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:12.098746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 895/1790] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:12.102088 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59980dca-9ba7-4061-8855-3b41a3e7629e service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:12.119848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59980dca-9ba7-4061-8855-3b41a3e7629e service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:12.140005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9ac11-8a17-41e6-9987-6ae041aa1640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:12.140911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9ac11-8a17-41e6-9987-6ae041aa1640 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:12.141370 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9ac11-8a17-41e6-9987-6ae041aa1640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:12.141786 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9ac11-8a17-41e6-9987-6ae041aa1640 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:12.142503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9ac11-8a17-41e6-9987-6ae041aa1640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:12.144757 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9ac11-8a17-41e6-9987-6ae041aa1640 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:12.193258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 896/1791] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:12 2022] POST /identity/v3/projects => generated 403 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:12.194870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9ac11-8a17-41e6-9987-6ae041aa1640 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:12.223755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb81fe-90a0-464c-85f1-ca213d281f61 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:12.305378 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9ac11-8a17-41e6-9987-6ae041aa1640 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:12.330877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7392209-fe4c-4eeb-9862-9708e4ef369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:12.331437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7392209-fe4c-4eeb-9862-9708e4ef369f admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:12.331780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7392209-fe4c-4eeb-9862-9708e4ef369f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:12.332225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7392209-fe4c-4eeb-9862-9708e4ef369f admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:12.332805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7392209-fe4c-4eeb-9862-9708e4ef369f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:12.335715 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7392209-fe4c-4eeb-9862-9708e4ef369f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:12.399737 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 897/1792] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:12 2022] POST /identity/v3/users => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:12.408942 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7392209-fe4c-4eeb-9862-9708e4ef369f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:12.417183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa212e7-03c3-425c-9c0e-98e253f3e697 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:12.417444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa212e7-03c3-425c-9c0e-98e253f3e697 service swift] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:12.417721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa212e7-03c3-425c-9c0e-98e253f3e697 service swift] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:12.419279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa212e7-03c3-425c-9c0e-98e253f3e697 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:12.422060 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7392209-fe4c-4eeb-9862-9708e4ef369f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:12.434804 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569608a7-104d-4f50-8a3f-c942a0402265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:12.434804 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569608a7-104d-4f50-8a3f-c942a0402265 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:12.434804 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569608a7-104d-4f50-8a3f-c942a0402265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:12.434804 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569608a7-104d-4f50-8a3f-c942a0402265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:12.435299 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569608a7-104d-4f50-8a3f-c942a0402265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:12.442169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569608a7-104d-4f50-8a3f-c942a0402265 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:12.472101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 898/1793] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:12.476610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569608a7-104d-4f50-8a3f-c942a0402265 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:12.498317 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569608a7-104d-4f50-8a3f-c942a0402265 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:12.503660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ff5cf-b611-4e5c-a137-079b6fbdfe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:12.504508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ff5cf-b611-4e5c-a137-079b6fbdfe14 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:12.504787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ff5cf-b611-4e5c-a137-079b6fbdfe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:12.505109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ff5cf-b611-4e5c-a137-079b6fbdfe14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:12.505777 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ff5cf-b611-4e5c-a137-079b6fbdfe14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:12.507570 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ff5cf-b611-4e5c-a137-079b6fbdfe14 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:12.530216 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 899/1794] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:26:12.530216 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ff5cf-b611-4e5c-a137-079b6fbdfe14 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:12.542100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ff5cf-b611-4e5c-a137-079b6fbdfe14 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:12.551135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c37fc-2a69-485c-95db-4f51e014f8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:12.552152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c37fc-2a69-485c-95db-4f51e014f8be admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:12.552558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c37fc-2a69-485c-95db-4f51e014f8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:12.552908 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c37fc-2a69-485c-95db-4f51e014f8be admin admin] PATH_INFO: `/v3/projects/86ec6211eff24bbe9098ac53babace8e/users/671ddb77178141c6b455f48f083e0ba4/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:12.572373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c37fc-2a69-485c-95db-4f51e014f8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ec6211eff24bbe9098ac53babace8e, user_id=671ddb77178141c6b455f48f083e0ba4, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:12.576088 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c37fc-2a69-485c-95db-4f51e014f8be admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:12.622333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 900/1795] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:12 2022] PUT /identity/v3/projects/86ec6211eff24bbe9098ac53babace8e/users/671ddb77178141c6b455f48f083e0ba4/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:12.633116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8490c8-23a6-4d36-ab08-b7788775493c None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:12.636325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8490c8-23a6-4d36-ab08-b7788775493c None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:12.637490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8490c8-23a6-4d36-ab08-b7788775493c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:12.687128 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa212e7-03c3-425c-9c0e-98e253f3e697 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:12.694072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa212e7-03c3-425c-9c0e-98e253f3e697 service swift] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:12.742306 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 896/1796] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:26:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:26:12.788455 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-db8490c8-23a6-4d36-ab08-b7788775493c None None] MFA Rules not processed for user `671ddb77178141c6b455f48f083e0ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:12.799859 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-db8490c8-23a6-4d36-ab08-b7788775493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:13.019445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa7e8f-c303-4cbd-ac69-6895e961c382 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:13.019897 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa7e8f-c303-4cbd-ac69-6895e961c382 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:13.020177 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa7e8f-c303-4cbd-ac69-6895e961c382 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:13.022076 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 897/1797] 10.222.0.59 () {54 vars in 921 bytes} [Tue Aug 9 11:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:26:13.050108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:13.138078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 901/1798] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:12 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:13.139428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa7e8f-c303-4cbd-ac69-6895e961c382 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:13.145583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e124d1-7a3c-4190-ae81-319f52d041e7 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:13.145953 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e124d1-7a3c-4190-ae81-319f52d041e7 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:13.146196 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e124d1-7a3c-4190-ae81-319f52d041e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:13.228108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-80e124d1-7a3c-4190-ae81-319f52d041e7 None None] MFA Rules not processed for user `a04b584a68cb488492046faa23e15463`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:13.230970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-80e124d1-7a3c-4190-ae81-319f52d041e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:13.333108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:13.379292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa7e8f-c303-4cbd-ac69-6895e961c382 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:13.389730 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ec9de-df81-4ab0-8f79-eb0008bc92b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:13.390170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ec9de-df81-4ab0-8f79-eb0008bc92b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:13.390475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ec9de-df81-4ab0-8f79-eb0008bc92b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:13.390589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ec9de-df81-4ab0-8f79-eb0008bc92b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:13.391268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ec9de-df81-4ab0-8f79-eb0008bc92b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:13.393231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ec9de-df81-4ab0-8f79-eb0008bc92b2 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:13.449312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 902/1799] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Aug 9 11:26:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:13.503567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 898/1800] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:13 2022] POST /identity/v3/projects => generated 405 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:13.504229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e124d1-7a3c-4190-ae81-319f52d041e7 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:13.514922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ec9de-df81-4ab0-8f79-eb0008bc92b2 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:13.519808 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e124d1-7a3c-4190-ae81-319f52d041e7 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:13.526566 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-572ec9de-df81-4ab0-8f79-eb0008bc92b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:13.693972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ec9de-df81-4ab0-8f79-eb0008bc92b2 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:13.703174 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082017df-1b7b-49c2-8c09-e202b295dea3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:13.703814 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082017df-1b7b-49c2-8c09-e202b295dea3 service placement] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:13.704086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082017df-1b7b-49c2-8c09-e202b295dea3 service placement] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:13.704354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082017df-1b7b-49c2-8c09-e202b295dea3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:13.706525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2a5ac-a88b-4abb-8c29-39aced3774cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:13.707218 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2a5ac-a88b-4abb-8c29-39aced3774cd admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:13.707485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2a5ac-a88b-4abb-8c29-39aced3774cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:13.713580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2a5ac-a88b-4abb-8c29-39aced3774cd admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:13.714665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2a5ac-a88b-4abb-8c29-39aced3774cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:13.717771 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2a5ac-a88b-4abb-8c29-39aced3774cd admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:13.730182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082017df-1b7b-49c2-8c09-e202b295dea3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:13.736334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082017df-1b7b-49c2-8c09-e202b295dea3 service placement] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:13.764133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 903/1801] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:13 2022] POST /identity/v3/users => generated 309 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:13.765646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 899/1802] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:13.770077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2a5ac-a88b-4abb-8c29-39aced3774cd admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:13.790956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2a5ac-a88b-4abb-8c29-39aced3774cd admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:13.804356 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab95c02-1212-497b-8f30-1354c288a19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:13.804994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab95c02-1212-497b-8f30-1354c288a19a admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:13.805269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab95c02-1212-497b-8f30-1354c288a19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:13.808357 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab95c02-1212-497b-8f30-1354c288a19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:13.809084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab95c02-1212-497b-8f30-1354c288a19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:13.810791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab95c02-1212-497b-8f30-1354c288a19a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:13.847688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 904/1803] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:13.853104 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082017df-1b7b-49c2-8c09-e202b295dea3 service placement] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:13.888431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082017df-1b7b-49c2-8c09-e202b295dea3 service placement] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:13.903416 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aadfec-c261-4300-96e7-bbf1dc84a898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:13.904099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aadfec-c261-4300-96e7-bbf1dc84a898 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:13.904372 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aadfec-c261-4300-96e7-bbf1dc84a898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:13.904639 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aadfec-c261-4300-96e7-bbf1dc84a898 admin admin] PATH_INFO: `/v3/projects/6249e47b6c924d0d9ec510ad02cf2d5b/users/14d8d586faaa4101bc2af1e59fc50060/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:13.953481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aadfec-c261-4300-96e7-bbf1dc84a898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6249e47b6c924d0d9ec510ad02cf2d5b, user_id=14d8d586faaa4101bc2af1e59fc50060, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:13.959315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aadfec-c261-4300-96e7-bbf1dc84a898 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:14.000850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 900/1804] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:13 2022] PUT /identity/v3/projects/6249e47b6c924d0d9ec510ad02cf2d5b/users/14d8d586faaa4101bc2af1e59fc50060/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:14.011623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab95c02-1212-497b-8f30-1354c288a19a admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:14.073896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab95c02-1212-497b-8f30-1354c288a19a admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:14.320592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5fd83-926f-4923-8782-f52ce518f3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:14.321360 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5fd83-926f-4923-8782-f52ce518f3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:14.322835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5fd83-926f-4923-8782-f52ce518f3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:14.323451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5fd83-926f-4923-8782-f52ce518f3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:14.328755 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5fd83-926f-4923-8782-f52ce518f3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:14.331400 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5fd83-926f-4923-8782-f52ce518f3e8 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:14.344250 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:14.361299 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 905/1805] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:14.362264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aadfec-c261-4300-96e7-bbf1dc84a898 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:14.373383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aadfec-c261-4300-96e7-bbf1dc84a898 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:14.424445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcab91-d7f0-4a0f-b725-00dbd9040837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:14.426846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcab91-d7f0-4a0f-b725-00dbd9040837 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:14.429213 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcab91-d7f0-4a0f-b725-00dbd9040837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:14.429743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcab91-d7f0-4a0f-b725-00dbd9040837 admin admin] PATH_INFO: `/v3/projects/6249e47b6c924d0d9ec510ad02cf2d5b/users/14d8d586faaa4101bc2af1e59fc50060/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:14.438490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcab91-d7f0-4a0f-b725-00dbd9040837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6249e47b6c924d0d9ec510ad02cf2d5b, user_id=14d8d586faaa4101bc2af1e59fc50060, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:14.443832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcab91-d7f0-4a0f-b725-00dbd9040837 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:14.491086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 901/1806] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:14 2022] PUT /identity/v3/projects/6249e47b6c924d0d9ec510ad02cf2d5b/users/14d8d586faaa4101bc2af1e59fc50060/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:14.495284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c6b15-69f9-497d-b51f-c03affb9cda8 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:14.496032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c6b15-69f9-497d-b51f-c03affb9cda8 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:14.496032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c6b15-69f9-497d-b51f-c03affb9cda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:14.598550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-9b1c6b15-69f9-497d-b51f-c03affb9cda8 None None] MFA Rules not processed for user `14d8d586faaa4101bc2af1e59fc50060`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:14.600780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9b1c6b15-69f9-497d-b51f-c03affb9cda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:14.884004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 906/1807] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:14 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:14.895083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcab91-d7f0-4a0f-b725-00dbd9040837 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:14.899011 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-13dcab91-d7f0-4a0f-b725-00dbd9040837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:14.999851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcab91-d7f0-4a0f-b725-00dbd9040837 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:15.004933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cffb5d-5f75-4c59-8df1-3e6b700c0820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:15.006116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cffb5d-5f75-4c59-8df1-3e6b700c0820 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:15.006496 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cffb5d-5f75-4c59-8df1-3e6b700c0820 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:15.006905 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cffb5d-5f75-4c59-8df1-3e6b700c0820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:15.021543 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cffb5d-5f75-4c59-8df1-3e6b700c0820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:15.030277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cffb5d-5f75-4c59-8df1-3e6b700c0820 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:15.046634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 902/1808] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:14 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:15.110428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b269e6-5b70-43f4-a913-40552fc14649 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:15.110742 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b269e6-5b70-43f4-a913-40552fc14649 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:15.111112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b269e6-5b70-43f4-a913-40552fc14649 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:15.114211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 907/1809] 10.222.0.59 () {54 vars in 921 bytes} [Tue Aug 9 11:26:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:26:15.137885 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deacca1-1114-4004-8103-db488258d785 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:15.138305 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deacca1-1114-4004-8103-db488258d785 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:15.138728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deacca1-1114-4004-8103-db488258d785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:15.244142 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-2deacca1-1114-4004-8103-db488258d785 None None] MFA Rules not processed for user `2136cf1160a64951ad780424cb28403b`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:15.264284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2deacca1-1114-4004-8103-db488258d785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:15.311099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:15.337701 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b269e6-5b70-43f4-a913-40552fc14649 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:15.342472 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-45b269e6-5b70-43f4-a913-40552fc14649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:15.432011 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 903/1810] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Aug 9 11:26:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:15.454247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deacca1-1114-4004-8103-db488258d785 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:15.455720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2deacca1-1114-4004-8103-db488258d785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:15.566563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b269e6-5b70-43f4-a913-40552fc14649 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:15.573689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb91ae-4485-44a1-a438-6519c99d19d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:15.574359 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb91ae-4485-44a1-a438-6519c99d19d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:15.574634 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb91ae-4485-44a1-a438-6519c99d19d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:15.574884 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deacca1-1114-4004-8103-db488258d785 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:15.575016 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb91ae-4485-44a1-a438-6519c99d19d2 admin admin] PATH_INFO: `/v3/projects/8e05cc943d8c47a4891e21a8abc95a31` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:15.576345 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb91ae-4485-44a1-a438-6519c99d19d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e05cc943d8c47a4891e21a8abc95a31)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:15.578547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb91ae-4485-44a1-a438-6519c99d19d2 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:15.586489 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b7a63-8cd5-4f86-b0d7-f5e868aa5ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:15.587195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7a63-8cd5-4f86-b0d7-f5e868aa5ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:15.587467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7a63-8cd5-4f86-b0d7-f5e868aa5ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:15.587738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7a63-8cd5-4f86-b0d7-f5e868aa5ff9 admin admin] PATH_INFO: `/v3/users/378498d664a34611a48c06455ec4ac5a` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:15.588958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b7a63-8cd5-4f86-b0d7-f5e868aa5ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=378498d664a34611a48c06455ec4ac5a)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:15.590980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b7a63-8cd5-4f86-b0d7-f5e868aa5ff9 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:15.685864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e7cb91ae-4485-44a1-a438-6519c99d19d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e05cc943d8c47a4891e21a8abc95a31', 'request_id': 'req-e7cb91ae-4485-44a1-a438-6519c99d19d2'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:15.693909 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e7cb91ae-4485-44a1-a438-6519c99d19d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e05cc943d8c47a4891e21a8abc95a31', 'request_id': 'req-e7cb91ae-4485-44a1-a438-6519c99d19d2'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:15.706344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e7cb91ae-4485-44a1-a438-6519c99d19d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e05cc943d8c47a4891e21a8abc95a31', 'request_id': 'req-e7cb91ae-4485-44a1-a438-6519c99d19d2'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:15.721410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e7cb91ae-4485-44a1-a438-6519c99d19d2 admin admin] The token cache is being invalidate because project 8e05cc943d8c47a4891e21a8abc95a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:15.721995 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e7cb91ae-4485-44a1-a438-6519c99d19d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:15.722930 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e7cb91ae-4485-44a1-a438-6519c99d19d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:15.725330 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 908/1811] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:15 2022] DELETE /identity/v3/projects/8e05cc943d8c47a4891e21a8abc95a31 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:15.732509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d118c5-71e1-4a3a-9bc8-463b60171852 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:15.732813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d118c5-71e1-4a3a-9bc8-463b60171852 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:15.733157 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-663b7a63-8cd5-4f86-b0d7-f5e868aa5ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378498d664a34611a48c06455ec4ac5a'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:15.736165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d118c5-71e1-4a3a-9bc8-463b60171852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:15.751485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-663b7a63-8cd5-4f86-b0d7-f5e868aa5ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378498d664a34611a48c06455ec4ac5a'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:15.753035 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-663b7a63-8cd5-4f86-b0d7-f5e868aa5ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378498d664a34611a48c06455ec4ac5a'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:15.754101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-663b7a63-8cd5-4f86-b0d7-f5e868aa5ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378498d664a34611a48c06455ec4ac5a'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:15.771744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c3d118c5-71e1-4a3a-9bc8-463b60171852 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:15.772957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-663b7a63-8cd5-4f86-b0d7-f5e868aa5ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378498d664a34611a48c06455ec4ac5a'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:15.774020 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c3d118c5-71e1-4a3a-9bc8-463b60171852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:15.796325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 904/1812] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:15 2022] DELETE /identity/v3/users/378498d664a34611a48c06455ec4ac5a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:15.797519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:15.798052 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708350-a105-4b77-96bf-3d6e2bdd82d1 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:15.798957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708350-a105-4b77-96bf-3d6e2bdd82d1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:15.799938 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708350-a105-4b77-96bf-3d6e2bdd82d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:15.855162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ee708350-a105-4b77-96bf-3d6e2bdd82d1 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:15.856567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ee708350-a105-4b77-96bf-3d6e2bdd82d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:15.922551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 909/1813] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:15.923714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d118c5-71e1-4a3a-9bc8-463b60171852 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:15.927887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c3d118c5-71e1-4a3a-9bc8-463b60171852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:15.928743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:15.977770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 905/1814] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:15.979693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec4523-d870-4c0f-aa33-e0dedfe70992 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:15.980212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec4523-d870-4c0f-aa33-e0dedfe70992 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:15.980687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec4523-d870-4c0f-aa33-e0dedfe70992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:16.009142 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-4aec4523-d870-4c0f-aa33-e0dedfe70992 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:16.011645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4aec4523-d870-4c0f-aa33-e0dedfe70992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:16.029606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 906/1815] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:16.029606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec4523-d870-4c0f-aa33-e0dedfe70992 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:16.031691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4aec4523-d870-4c0f-aa33-e0dedfe70992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:16.041828 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d118c5-71e1-4a3a-9bc8-463b60171852 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:16.132223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec4523-d870-4c0f-aa33-e0dedfe70992 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:16.139423 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecbd2e-d9ec-4ca5-a1f4-c5f93aa6100e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:16.140522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecbd2e-d9ec-4ca5-a1f4-c5f93aa6100e service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:16.141071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecbd2e-d9ec-4ca5-a1f4-c5f93aa6100e service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:16.141551 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecbd2e-d9ec-4ca5-a1f4-c5f93aa6100e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:16.157744 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecbd2e-d9ec-4ca5-a1f4-c5f93aa6100e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:16.159557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecbd2e-d9ec-4ca5-a1f4-c5f93aa6100e service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:16.162882 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8a6b7-8f75-4d5d-96b4-b39919d19029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:16.165946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8a6b7-8f75-4d5d-96b4-b39919d19029 service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:16.166540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8a6b7-8f75-4d5d-96b4-b39919d19029 service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:16.167077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8a6b7-8f75-4d5d-96b4-b39919d19029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:16.173239 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-34e8a6b7-8f75-4d5d-96b4-b39919d19029 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:16.174006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 907/1816] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:16.175131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecbd2e-d9ec-4ca5-a1f4-c5f93aa6100e service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:16.188755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecbd2e-d9ec-4ca5-a1f4-c5f93aa6100e service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:16.198746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038ff8c-b1f4-43be-ba09-581ac1657dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:16.200182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038ff8c-b1f4-43be-ba09-581ac1657dee admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:16.200781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038ff8c-b1f4-43be-ba09-581ac1657dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:16.201361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038ff8c-b1f4-43be-ba09-581ac1657dee admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:16.202858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038ff8c-b1f4-43be-ba09-581ac1657dee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:16.203516 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038ff8c-b1f4-43be-ba09-581ac1657dee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:16.207416 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038ff8c-b1f4-43be-ba09-581ac1657dee admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:16.241156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8a6b7-8f75-4d5d-96b4-b39919d19029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:16.245070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8a6b7-8f75-4d5d-96b4-b39919d19029 service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:16.252182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 908/1817] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:16.257993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038ff8c-b1f4-43be-ba09-581ac1657dee admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:16.311660 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038ff8c-b1f4-43be-ba09-581ac1657dee admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:16.313163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 910/1818] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:16.324929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a80131-81c1-4234-985b-6486bd547045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:16.327091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a80131-81c1-4234-985b-6486bd547045 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:16.327683 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a80131-81c1-4234-985b-6486bd547045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:16.328226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a80131-81c1-4234-985b-6486bd547045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:16.329665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a80131-81c1-4234-985b-6486bd547045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:16.333564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a80131-81c1-4234-985b-6486bd547045 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:16.399972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 909/1819] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:16 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:16.411565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8a6b7-8f75-4d5d-96b4-b39919d19029 service nova] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:16.442166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8a6b7-8f75-4d5d-96b4-b39919d19029 service nova] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:16.554737 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:16.562778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a80131-81c1-4234-985b-6486bd547045 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:16.567275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f2a80131-81c1-4234-985b-6486bd547045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:16.606711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd1d37-17a8-4c3e-8a8e-3fe63d59d16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:16.607534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1d37-17a8-4c3e-8a8e-3fe63d59d16d admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:16.607672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1d37-17a8-4c3e-8a8e-3fe63d59d16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:16.608400 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1d37-17a8-4c3e-8a8e-3fe63d59d16d admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:16.609065 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd1d37-17a8-4c3e-8a8e-3fe63d59d16d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:16.611089 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd1d37-17a8-4c3e-8a8e-3fe63d59d16d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:16.670939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 911/1820] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:16 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:16.678222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a2ac5-76ef-4b6f-ae72-405c4a034e75 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:16.678715 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a2ac5-76ef-4b6f-ae72-405c4a034e75 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:16.679100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a2ac5-76ef-4b6f-ae72-405c4a034e75 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:16.681356 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 912/1821] 10.222.0.59 () {54 vars in 921 bytes} [Tue Aug 9 11:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:26:16.682427 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a2ac5-76ef-4b6f-ae72-405c4a034e75 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:16.684831 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ef4a2ac5-76ef-4b6f-ae72-405c4a034e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:16.724448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a2ac5-76ef-4b6f-ae72-405c4a034e75 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:16.730106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a80131-81c1-4234-985b-6486bd547045 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:16.732513 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81990ab4-8234-4d8a-9606-85108a72a9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:16.733270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990ab4-8234-4d8a-9606-85108a72a9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:16.733579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990ab4-8234-4d8a-9606-85108a72a9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:16.733808 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990ab4-8234-4d8a-9606-85108a72a9c0 admin admin] PATH_INFO: `/v3/projects/1c89430a03ef4c01bf85dd14b4b98cc9` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:16.736820 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81990ab4-8234-4d8a-9606-85108a72a9c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c89430a03ef4c01bf85dd14b4b98cc9)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:16.737126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ee7fa-2443-4183-8d40-89bd598cf82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:16.737955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ee7fa-2443-4183-8d40-89bd598cf82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:16.738207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81990ab4-8234-4d8a-9606-85108a72a9c0 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:16.738368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ee7fa-2443-4183-8d40-89bd598cf82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:16.738691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ee7fa-2443-4183-8d40-89bd598cf82e admin admin] PATH_INFO: `/v3/users/6e89300829514bd6949a86866d684428` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:16.740231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ee7fa-2443-4183-8d40-89bd598cf82e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e89300829514bd6949a86866d684428)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:16.742697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ee7fa-2443-4183-8d40-89bd598cf82e admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:16.818082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:16.831608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-f57ee7fa-2443-4183-8d40-89bd598cf82e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e89300829514bd6949a86866d684428'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:16.841262 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-81990ab4-8234-4d8a-9606-85108a72a9c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c89430a03ef4c01bf85dd14b4b98cc9', 'request_id': 'req-81990ab4-8234-4d8a-9606-85108a72a9c0'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:16.846140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-f57ee7fa-2443-4183-8d40-89bd598cf82e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e89300829514bd6949a86866d684428'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:16.846732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-f57ee7fa-2443-4183-8d40-89bd598cf82e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e89300829514bd6949a86866d684428'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:16.847681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-f57ee7fa-2443-4183-8d40-89bd598cf82e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e89300829514bd6949a86866d684428'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:16.856966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-81990ab4-8234-4d8a-9606-85108a72a9c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c89430a03ef4c01bf85dd14b4b98cc9', 'request_id': 'req-81990ab4-8234-4d8a-9606-85108a72a9c0'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:16.875745 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-f57ee7fa-2443-4183-8d40-89bd598cf82e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e89300829514bd6949a86866d684428'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:16.876113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-81990ab4-8234-4d8a-9606-85108a72a9c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c89430a03ef4c01bf85dd14b4b98cc9', 'request_id': 'req-81990ab4-8234-4d8a-9606-85108a72a9c0'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:16.896619 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 910/1822] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:16 2022] DELETE /identity/v3/users/6e89300829514bd6949a86866d684428 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:16.897829 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ee7fa-2443-4183-8d40-89bd598cf82e admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:16.898443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-81990ab4-8234-4d8a-9606-85108a72a9c0 admin admin] The token cache is being invalidate because project 1c89430a03ef4c01bf85dd14b4b98cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:16.898996 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-81990ab4-8234-4d8a-9606-85108a72a9c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:16.900152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-81990ab4-8234-4d8a-9606-85108a72a9c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:16.900422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f57ee7fa-2443-4183-8d40-89bd598cf82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:16.903667 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 913/1823] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:16 2022] DELETE /identity/v3/projects/1c89430a03ef4c01bf85dd14b4b98cc9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:16.913306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6ce17-83d6-4ee9-b98b-216ea7262681 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:16.913798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6ce17-83d6-4ee9-b98b-216ea7262681 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:16.914265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6ce17-83d6-4ee9-b98b-216ea7262681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:16.970705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-54f6ce17-83d6-4ee9-b98b-216ea7262681 None None] MFA Rules not processed for user `2136cf1160a64951ad780424cb28403b`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:16.973000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-54f6ce17-83d6-4ee9-b98b-216ea7262681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:17.050927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ee7fa-2443-4183-8d40-89bd598cf82e admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:17.056476 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a2027-ea2f-43c0-81d9-c089778c7950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:17.057373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2027-ea2f-43c0-81d9-c089778c7950 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.057791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2027-ea2f-43c0-81d9-c089778c7950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.058247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2027-ea2f-43c0-81d9-c089778c7950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.059185 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a2027-ea2f-43c0-81d9-c089778c7950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:17.061252 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a2027-ea2f-43c0-81d9-c089778c7950 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:17.075655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 911/1824] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:17.075655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f3925-94c4-4393-9400-c1e26f900ad2 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.075655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f3925-94c4-4393-9400-c1e26f900ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.075655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f3925-94c4-4393-9400-c1e26f900ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.090037 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 914/1825] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Aug 9 11:26:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:17.091181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6ce17-83d6-4ee9-b98b-216ea7262681 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:17.093854 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-54f6ce17-83d6-4ee9-b98b-216ea7262681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:17.097800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ca6f3925-94c4-4393-9400-c1e26f900ad2 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:17.099942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ca6f3925-94c4-4393-9400-c1e26f900ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:17.129269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 912/1826] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:17.129269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f3925-94c4-4393-9400-c1e26f900ad2 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:17.129671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6ce17-83d6-4ee9-b98b-216ea7262681 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:17.129846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ca6f3925-94c4-4393-9400-c1e26f900ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:17.135727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324e73a-9092-4fda-af48-54e78f759a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:17.136360 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324e73a-9092-4fda-af48-54e78f759a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.136635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324e73a-9092-4fda-af48-54e78f759a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.136903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324e73a-9092-4fda-af48-54e78f759a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.137559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324e73a-9092-4fda-af48-54e78f759a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:17.139225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324e73a-9092-4fda-af48-54e78f759a5d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:17.151336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 915/1827] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:17.152789 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fe4fc-b165-4129-a8cc-a7acaf038373 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.153071 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fe4fc-b165-4129-a8cc-a7acaf038373 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.153338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fe4fc-b165-4129-a8cc-a7acaf038373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.160661 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f3925-94c4-4393-9400-c1e26f900ad2 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:17.168742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ae8aa-1e51-41ba-8c5e-fa575e925445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:17.169379 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ae8aa-1e51-41ba-8c5e-fa575e925445 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.170641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ae8aa-1e51-41ba-8c5e-fa575e925445 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.170962 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ae8aa-1e51-41ba-8c5e-fa575e925445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.176338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f44fe4fc-b165-4129-a8cc-a7acaf038373 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:17.177656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f44fe4fc-b165-4129-a8cc-a7acaf038373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:17.182677 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ae8aa-1e51-41ba-8c5e-fa575e925445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:17.184478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ae8aa-1e51-41ba-8c5e-fa575e925445 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:17.194459 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 916/1828] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:17.194459 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fe4fc-b165-4129-a8cc-a7acaf038373 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:17.198655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 913/1829] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:17.199464 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ae8aa-1e51-41ba-8c5e-fa575e925445 service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:17.207826 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fe4fc-b165-4129-a8cc-a7acaf038373 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:17.215139 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ae8aa-1e51-41ba-8c5e-fa575e925445 service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:17.217482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb1f5d-1504-430f-a96d-2fd7653d46c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:17.218473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb1f5d-1504-430f-a96d-2fd7653d46c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.219057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb1f5d-1504-430f-a96d-2fd7653d46c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.219615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb1f5d-1504-430f-a96d-2fd7653d46c7 admin admin] PATH_INFO: `/v3/projects/acf8fcf61478446894bdee927797f811/users/82ca9ea2c08e47c9bc732e70b2fbf53b/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.220953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7063d9e-f0e5-436a-bc4b-f190af520309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:17.221584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7063d9e-f0e5-436a-bc4b-f190af520309 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.221923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7063d9e-f0e5-436a-bc4b-f190af520309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.222259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7063d9e-f0e5-436a-bc4b-f190af520309 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.222974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7063d9e-f0e5-436a-bc4b-f190af520309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:17.223279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7063d9e-f0e5-436a-bc4b-f190af520309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:17.226371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7063d9e-f0e5-436a-bc4b-f190af520309 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:17.244377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 914/1830] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:17.246586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7063d9e-f0e5-436a-bc4b-f190af520309 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:17.252672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb1f5d-1504-430f-a96d-2fd7653d46c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf8fcf61478446894bdee927797f811, user_id=82ca9ea2c08e47c9bc732e70b2fbf53b, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:17.258070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb1f5d-1504-430f-a96d-2fd7653d46c7 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:17.260306 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7063d9e-f0e5-436a-bc4b-f190af520309 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:17.266541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c10db6-3dfa-4644-9f3a-1eeb8ffbe78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:17.267265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c10db6-3dfa-4644-9f3a-1eeb8ffbe78c admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.267595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c10db6-3dfa-4644-9f3a-1eeb8ffbe78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.267840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c10db6-3dfa-4644-9f3a-1eeb8ffbe78c admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.268612 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c10db6-3dfa-4644-9f3a-1eeb8ffbe78c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:17.271406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c10db6-3dfa-4644-9f3a-1eeb8ffbe78c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:17.281660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 917/1831] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:17 2022] PUT /identity/v3/projects/acf8fcf61478446894bdee927797f811/users/82ca9ea2c08e47c9bc732e70b2fbf53b/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:17.296409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aee7e6-36a3-497b-9ae5-114ccbea89db None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.297078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aee7e6-36a3-497b-9ae5-114ccbea89db None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.297390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aee7e6-36a3-497b-9ae5-114ccbea89db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.307433 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:17.332674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 915/1832] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:17 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:17.333881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b1aee7e6-36a3-497b-9ae5-114ccbea89db None None] MFA Rules not processed for user `82ca9ea2c08e47c9bc732e70b2fbf53b`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:17.334479 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c10db6-3dfa-4644-9f3a-1eeb8ffbe78c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:17.338683 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b1aee7e6-36a3-497b-9ae5-114ccbea89db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:17.458089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:17.463115 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 918/1833] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:17.464603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aee7e6-36a3-497b-9ae5-114ccbea89db None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:17.464879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c10db6-3dfa-4644-9f3a-1eeb8ffbe78c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:17.466319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b1aee7e6-36a3-497b-9ae5-114ccbea89db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:17.485556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aee7e6-36a3-497b-9ae5-114ccbea89db None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:17.490702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:17.491003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92e7de-022c-4731-ba9f-a7838d75628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:17.491601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.492023 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.492213 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92e7de-022c-4731-ba9f-a7838d75628a admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.492353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] PATH_INFO: `/v3/projects/3040c15d5e34481699643c898e997090` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.492502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92e7de-022c-4731-ba9f-a7838d75628a admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.492895 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92e7de-022c-4731-ba9f-a7838d75628a admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.494731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92e7de-022c-4731-ba9f-a7838d75628a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:17.494897 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3040c15d5e34481699643c898e997090)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:17.497001 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:17.497166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92e7de-022c-4731-ba9f-a7838d75628a admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:17.541366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 916/1834] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:17 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:17.541366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92e7de-022c-4731-ba9f-a7838d75628a admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:17.544299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ae92e7de-022c-4731-ba9f-a7838d75628a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:17.599230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3040c15d5e34481699643c898e997090', 'request_id': 'req-52f3a895-e7a6-4d20-8942-caf9958ce4f5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:17.607458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3040c15d5e34481699643c898e997090', 'request_id': 'req-52f3a895-e7a6-4d20-8942-caf9958ce4f5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:17.617706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3040c15d5e34481699643c898e997090', 'request_id': 'req-52f3a895-e7a6-4d20-8942-caf9958ce4f5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:17.634970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] The token cache is being invalidate because project 3040c15d5e34481699643c898e997090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:17.635390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:17.636474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:17.638962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 919/1835] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:17 2022] DELETE /identity/v3/projects/3040c15d5e34481699643c898e997090 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:17.640304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:17.642380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:17.645076 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92e7de-022c-4731-ba9f-a7838d75628a admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:17.716929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f65aa0-fb55-409c-99bc-7300cbf0a558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:17.717782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f65aa0-fb55-409c-99bc-7300cbf0a558 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.718140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f65aa0-fb55-409c-99bc-7300cbf0a558 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.718545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f65aa0-fb55-409c-99bc-7300cbf0a558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.720648 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b5f65aa0-fb55-409c-99bc-7300cbf0a558 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:17.734634 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a895-e7a6-4d20-8942-caf9958ce4f5 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:17.741399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d1d27-16c8-42f6-bcfe-53878e21990e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:17.742326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d1d27-16c8-42f6-bcfe-53878e21990e admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.742765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d1d27-16c8-42f6-bcfe-53878e21990e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.743223 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d1d27-16c8-42f6-bcfe-53878e21990e admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.744288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d1d27-16c8-42f6-bcfe-53878e21990e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:17.747131 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d1d27-16c8-42f6-bcfe-53878e21990e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:17.766805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 920/1836] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:17.766805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d1d27-16c8-42f6-bcfe-53878e21990e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:17.766805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f01d1d27-16c8-42f6-bcfe-53878e21990e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:17.781274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d1d27-16c8-42f6-bcfe-53878e21990e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:17.786396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a61a5a-0ad0-4117-95b4-c4c03e1f5835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:17.786997 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a61a5a-0ad0-4117-95b4-c4c03e1f5835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.787379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a61a5a-0ad0-4117-95b4-c4c03e1f5835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.787568 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a61a5a-0ad0-4117-95b4-c4c03e1f5835 admin admin] PATH_INFO: `/v3/users/0131d58c18e14834ba951a56de90a850` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.788893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a61a5a-0ad0-4117-95b4-c4c03e1f5835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0131d58c18e14834ba951a56de90a850)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:17.790842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a61a5a-0ad0-4117-95b4-c4c03e1f5835 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:17.796329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:17.804215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f65aa0-fb55-409c-99bc-7300cbf0a558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:17.805593 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f65aa0-fb55-409c-99bc-7300cbf0a558 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:17.816465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 917/1837] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:17.817163 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f65aa0-fb55-409c-99bc-7300cbf0a558 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:17.829974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f65aa0-fb55-409c-99bc-7300cbf0a558 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:17.835702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa3bb3-e2d0-4a8c-9317-6033c33a9d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:17.836346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa3bb3-e2d0-4a8c-9317-6033c33a9d54 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.836626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa3bb3-e2d0-4a8c-9317-6033c33a9d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.836893 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa3bb3-e2d0-4a8c-9317-6033c33a9d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.837579 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa3bb3-e2d0-4a8c-9317-6033c33a9d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:17.839275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa3bb3-e2d0-4a8c-9317-6033c33a9d54 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:17.851524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 918/1838] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:17.851956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b5a61a5a-0ad0-4117-95b4-c4c03e1f5835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0131d58c18e14834ba951a56de90a850'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:17.856237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa3bb3-e2d0-4a8c-9317-6033c33a9d54 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:17.867904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa3bb3-e2d0-4a8c-9317-6033c33a9d54 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:17.869127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b5a61a5a-0ad0-4117-95b4-c4c03e1f5835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0131d58c18e14834ba951a56de90a850'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:17.872987 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669c88d-4bb0-4531-a209-6b48fcce0d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:17.873898 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669c88d-4bb0-4531-a209-6b48fcce0d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.874167 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669c88d-4bb0-4531-a209-6b48fcce0d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.874444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669c88d-4bb0-4531-a209-6b48fcce0d6c admin admin] PATH_INFO: `/v3/projects/9895821b80e9421e825f2ef793b9a486/users/70cba32409b748a4b12f9f3b3430f277/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.880741 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b5a61a5a-0ad0-4117-95b4-c4c03e1f5835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0131d58c18e14834ba951a56de90a850'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:17.881990 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b5a61a5a-0ad0-4117-95b4-c4c03e1f5835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0131d58c18e14834ba951a56de90a850'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:17.882954 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b5a61a5a-0ad0-4117-95b4-c4c03e1f5835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0131d58c18e14834ba951a56de90a850'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:17.893088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669c88d-4bb0-4531-a209-6b48fcce0d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9895821b80e9421e825f2ef793b9a486, user_id=70cba32409b748a4b12f9f3b3430f277, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:17.896152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669c88d-4bb0-4531-a209-6b48fcce0d6c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:17.901348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 921/1839] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:17 2022] DELETE /identity/v3/users/0131d58c18e14834ba951a56de90a850 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:17.915133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 919/1840] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:17 2022] PUT /identity/v3/projects/9895821b80e9421e825f2ef793b9a486/users/70cba32409b748a4b12f9f3b3430f277/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:17.927585 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301234c1-f496-4a72-bb01-c39627cf6437 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:17.927868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301234c1-f496-4a72-bb01-c39627cf6437 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:17.928134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301234c1-f496-4a72-bb01-c39627cf6437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:17.963658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-301234c1-f496-4a72-bb01-c39627cf6437 None None] MFA Rules not processed for user `70cba32409b748a4b12f9f3b3430f277`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:17.964957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-301234c1-f496-4a72-bb01-c39627cf6437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:18.094326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 922/1841] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:18.095607 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669c88d-4bb0-4531-a209-6b48fcce0d6c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:18.097581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-3669c88d-4bb0-4531-a209-6b48fcce0d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:18.140077 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:18.153454 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301234c1-f496-4a72-bb01-c39627cf6437 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:18.155358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-301234c1-f496-4a72-bb01-c39627cf6437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:18.226113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669c88d-4bb0-4531-a209-6b48fcce0d6c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:18.234252 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca575b54-cb19-469b-a85e-6b07201db94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:18.234504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301234c1-f496-4a72-bb01-c39627cf6437 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:18.235187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca575b54-cb19-469b-a85e-6b07201db94e admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.235560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca575b54-cb19-469b-a85e-6b07201db94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.236089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca575b54-cb19-469b-a85e-6b07201db94e admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.236812 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca575b54-cb19-469b-a85e-6b07201db94e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:18.239032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca575b54-cb19-469b-a85e-6b07201db94e admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:18.239261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d7540-9ecc-4099-96c0-290cde7240dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:18.239927 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7540-9ecc-4099-96c0-290cde7240dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.240167 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7540-9ecc-4099-96c0-290cde7240dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.240435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7540-9ecc-4099-96c0-290cde7240dc admin admin] PATH_INFO: `/v3/projects/65ce53dd25ff47168f4a68e2bce2ae56` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.241654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d7540-9ecc-4099-96c0-290cde7240dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ce53dd25ff47168f4a68e2bce2ae56)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:18.243560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d7540-9ecc-4099-96c0-290cde7240dc admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:18.263909 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:18.297928 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 920/1842] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:18 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:18.302682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca575b54-cb19-469b-a85e-6b07201db94e admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:18.328220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-922d7540-9ecc-4099-96c0-290cde7240dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ce53dd25ff47168f4a68e2bce2ae56', 'request_id': 'req-922d7540-9ecc-4099-96c0-290cde7240dc'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:18.340351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-922d7540-9ecc-4099-96c0-290cde7240dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ce53dd25ff47168f4a68e2bce2ae56', 'request_id': 'req-922d7540-9ecc-4099-96c0-290cde7240dc'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:18.356583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-922d7540-9ecc-4099-96c0-290cde7240dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ce53dd25ff47168f4a68e2bce2ae56', 'request_id': 'req-922d7540-9ecc-4099-96c0-290cde7240dc'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:18.371862 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-922d7540-9ecc-4099-96c0-290cde7240dc admin admin] The token cache is being invalidate because project 65ce53dd25ff47168f4a68e2bce2ae56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:18.372379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-922d7540-9ecc-4099-96c0-290cde7240dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:18.373015 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-922d7540-9ecc-4099-96c0-290cde7240dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:18.375312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 923/1843] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:18 2022] DELETE /identity/v3/projects/65ce53dd25ff47168f4a68e2bce2ae56 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:18.380018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2063-2ae5-41ca-85af-a9861bec3ddb None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.380371 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2063-2ae5-41ca-85af-a9861bec3ddb None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.380752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2063-2ae5-41ca-85af-a9861bec3ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.391387 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca575b54-cb19-469b-a85e-6b07201db94e admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:18.407142 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-5cba2063-2ae5-41ca-85af-a9861bec3ddb None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:18.408732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5cba2063-2ae5-41ca-85af-a9861bec3ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:18.491881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 924/1844] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:18.492083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49d09e-3051-4672-b3aa-665633e1d5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:18.492083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49d09e-3051-4672-b3aa-665633e1d5ce admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.492083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49d09e-3051-4672-b3aa-665633e1d5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.492492 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49d09e-3051-4672-b3aa-665633e1d5ce admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.493028 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49d09e-3051-4672-b3aa-665633e1d5ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:18.494270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7f72d-9086-4fb4-a47c-578ca02ad6e8 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.494557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7f72d-9086-4fb4-a47c-578ca02ad6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.494856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7f72d-9086-4fb4-a47c-578ca02ad6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.495074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49d09e-3051-4672-b3aa-665633e1d5ce admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:18.519937 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c8c7f72d-9086-4fb4-a47c-578ca02ad6e8 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:18.521217 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c8c7f72d-9086-4fb4-a47c-578ca02ad6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:18.523342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 921/1845] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:18 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:18.528056 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49d09e-3051-4672-b3aa-665633e1d5ce admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:18.529992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-db49d09e-3051-4672-b3aa-665633e1d5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:18.540151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 925/1846] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:18.541388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7f72d-9086-4fb4-a47c-578ca02ad6e8 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:18.544414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49d09e-3051-4672-b3aa-665633e1d5ce admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:18.551431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8577036-23d5-4f02-a6e5-255ad9a08759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:18.553520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8577036-23d5-4f02-a6e5-255ad9a08759 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.553520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8577036-23d5-4f02-a6e5-255ad9a08759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.553520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8577036-23d5-4f02-a6e5-255ad9a08759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.553801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7f72d-9086-4fb4-a47c-578ca02ad6e8 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:18.553922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8577036-23d5-4f02-a6e5-255ad9a08759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:18.555593 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8577036-23d5-4f02-a6e5-255ad9a08759 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:18.560169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d091968-5492-4561-99f7-2fd8d31183dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:18.561013 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d091968-5492-4561-99f7-2fd8d31183dd admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.561260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d091968-5492-4561-99f7-2fd8d31183dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.561529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d091968-5492-4561-99f7-2fd8d31183dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.562220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d091968-5492-4561-99f7-2fd8d31183dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:18.562476 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d091968-5492-4561-99f7-2fd8d31183dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:18.565228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d091968-5492-4561-99f7-2fd8d31183dd admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:18.574742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 922/1847] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:18.576167 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8577036-23d5-4f02-a6e5-255ad9a08759 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:18.581790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 926/1848] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:26:18.585976 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d091968-5492-4561-99f7-2fd8d31183dd admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:18.598682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8577036-23d5-4f02-a6e5-255ad9a08759 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:18.600824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d091968-5492-4561-99f7-2fd8d31183dd admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:18.606864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b823df0-6ab0-4849-9bef-a2b22bac1282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:18.606864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b823df0-6ab0-4849-9bef-a2b22bac1282 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.606864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b823df0-6ab0-4849-9bef-a2b22bac1282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.606864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b823df0-6ab0-4849-9bef-a2b22bac1282 admin admin] PATH_INFO: `/v3/projects/6085a31a8df0438980cdb30dee204ad3/users/0482d9fb2d414930b10a2d57c08f9d86/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.614977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef9ebd-4cba-4c6b-a3dc-1fe2916225cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:18.616288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef9ebd-4cba-4c6b-a3dc-1fe2916225cd admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.616566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef9ebd-4cba-4c6b-a3dc-1fe2916225cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.616839 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef9ebd-4cba-4c6b-a3dc-1fe2916225cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.617483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef9ebd-4cba-4c6b-a3dc-1fe2916225cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:18.619499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef9ebd-4cba-4c6b-a3dc-1fe2916225cd admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:18.635970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b823df0-6ab0-4849-9bef-a2b22bac1282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6085a31a8df0438980cdb30dee204ad3, user_id=0482d9fb2d414930b10a2d57c08f9d86, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:18.639873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b823df0-6ab0-4849-9bef-a2b22bac1282 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:18.660191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 927/1849] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:18 2022] POST /identity/v3/projects => generated 355 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:18.663800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 923/1850] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:18 2022] PUT /identity/v3/projects/6085a31a8df0438980cdb30dee204ad3/users/0482d9fb2d414930b10a2d57c08f9d86/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:18.666660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef9ebd-4cba-4c6b-a3dc-1fe2916225cd admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:18.667766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b823df0-6ab0-4849-9bef-a2b22bac1282 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:18.679168 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:18.755360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b823df0-6ab0-4849-9bef-a2b22bac1282 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:18.756511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef9ebd-4cba-4c6b-a3dc-1fe2916225cd admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:18.761809 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb1566-bc3c-4fb9-9aec-5f4e98d6cc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:18.762054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274b6f5-f75f-457e-9a6c-e2d45bcfb7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:18.762530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274b6f5-f75f-457e-9a6c-e2d45bcfb7df admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.762831 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274b6f5-f75f-457e-9a6c-e2d45bcfb7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.763105 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274b6f5-f75f-457e-9a6c-e2d45bcfb7df admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.763743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274b6f5-f75f-457e-9a6c-e2d45bcfb7df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:18.763933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb1566-bc3c-4fb9-9aec-5f4e98d6cc03 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.764488 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb1566-bc3c-4fb9-9aec-5f4e98d6cc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.765111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb1566-bc3c-4fb9-9aec-5f4e98d6cc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.765718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274b6f5-f75f-457e-9a6c-e2d45bcfb7df admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:18.767249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb1566-bc3c-4fb9-9aec-5f4e98d6cc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:18.769708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb1566-bc3c-4fb9-9aec-5f4e98d6cc03 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:18.781464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:18.783649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 924/1851] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:18.792161 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb1566-bc3c-4fb9-9aec-5f4e98d6cc03 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:18.804070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 928/1852] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:18 2022] POST /identity/v3/users => generated 278 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:18.805932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb1566-bc3c-4fb9-9aec-5f4e98d6cc03 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:18.813505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47848f-b97c-49c9-86af-2be5171e59d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:18.814156 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47848f-b97c-49c9-86af-2be5171e59d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.814429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47848f-b97c-49c9-86af-2be5171e59d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.814696 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47848f-b97c-49c9-86af-2be5171e59d9 admin admin] PATH_INFO: `/v3/projects/6085a31a8df0438980cdb30dee204ad3/users/0482d9fb2d414930b10a2d57c08f9d86/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.816860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47848f-b97c-49c9-86af-2be5171e59d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6085a31a8df0438980cdb30dee204ad3, user_id=0482d9fb2d414930b10a2d57c08f9d86, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:18.819080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274b6f5-f75f-457e-9a6c-e2d45bcfb7df admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:18.819714 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47848f-b97c-49c9-86af-2be5171e59d9 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:18.829495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274b6f5-f75f-457e-9a6c-e2d45bcfb7df admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:18.831158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 925/1853] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:18 2022] PUT /identity/v3/projects/6085a31a8df0438980cdb30dee204ad3/users/0482d9fb2d414930b10a2d57c08f9d86/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:18.841655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4f748-9bdc-4825-a4c9-feb52a76c893 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.841945 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4f748-9bdc-4825-a4c9-feb52a76c893 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.842199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4f748-9bdc-4825-a4c9-feb52a76c893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.874445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-8ee4f748-9bdc-4825-a4c9-feb52a76c893 None None] MFA Rules not processed for user `0482d9fb2d414930b10a2d57c08f9d86`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:18.875715 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-8ee4f748-9bdc-4825-a4c9-feb52a76c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:18.893970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333b22c-a6df-4178-8a2f-ca358d00caca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:18.894603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333b22c-a6df-4178-8a2f-ca358d00caca admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.894893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333b22c-a6df-4178-8a2f-ca358d00caca admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.895158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333b22c-a6df-4178-8a2f-ca358d00caca admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.895807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333b22c-a6df-4178-8a2f-ca358d00caca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:18.897434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333b22c-a6df-4178-8a2f-ca358d00caca admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:18.910969 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 929/1854] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:26:18.912631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333b22c-a6df-4178-8a2f-ca358d00caca admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:18.922215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333b22c-a6df-4178-8a2f-ca358d00caca admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:18.927584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e32be-cd46-452a-b0b6-138f046b4c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:18.928195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e32be-cd46-452a-b0b6-138f046b4c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.928469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e32be-cd46-452a-b0b6-138f046b4c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.928914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e32be-cd46-452a-b0b6-138f046b4c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.929573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e32be-cd46-452a-b0b6-138f046b4c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:18.931446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e32be-cd46-452a-b0b6-138f046b4c85 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:18.943229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 930/1855] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:26:18.947778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e32be-cd46-452a-b0b6-138f046b4c85 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:18.958190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e32be-cd46-452a-b0b6-138f046b4c85 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:18.960259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 926/1856] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:18.963987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26137f-6db2-436b-a07c-3186158af8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:18.964672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26137f-6db2-436b-a07c-3186158af8c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:18.964910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26137f-6db2-436b-a07c-3186158af8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:18.965189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26137f-6db2-436b-a07c-3186158af8c1 admin admin] PATH_INFO: `/v3/projects/678d8f6219004ee18adb95cf9da719a6/users/fafc2fe26b464ef8b109095f735c23ca/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:18.969374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4f748-9bdc-4825-a4c9-feb52a76c893 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:18.971271 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-8ee4f748-9bdc-4825-a4c9-feb52a76c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:18.982091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26137f-6db2-436b-a07c-3186158af8c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=678d8f6219004ee18adb95cf9da719a6, user_id=fafc2fe26b464ef8b109095f735c23ca, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:18.984765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26137f-6db2-436b-a07c-3186158af8c1 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:19.000636 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 931/1857] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:18 2022] PUT /identity/v3/projects/678d8f6219004ee18adb95cf9da719a6/users/fafc2fe26b464ef8b109095f735c23ca/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:19.012579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73756121-bc85-4e36-83e3-b2b33da5cb25 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:19.012910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73756121-bc85-4e36-83e3-b2b33da5cb25 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:19.013272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73756121-bc85-4e36-83e3-b2b33da5cb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:19.040311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4f748-9bdc-4825-a4c9-feb52a76c893 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:19.043558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-73756121-bc85-4e36-83e3-b2b33da5cb25 None None] MFA Rules not processed for user `fafc2fe26b464ef8b109095f735c23ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:19.044516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-73756121-bc85-4e36-83e3-b2b33da5cb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:19.071781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:19.095653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bfff9-fcf6-45b1-be85-491d3ff24b8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:19.096736 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bfff9-fcf6-45b1-be85-491d3ff24b8a service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:19.096736 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bfff9-fcf6-45b1-be85-491d3ff24b8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:19.096908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bfff9-fcf6-45b1-be85-491d3ff24b8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:19.124694 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 932/1858] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:19.130379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73756121-bc85-4e36-83e3-b2b33da5cb25 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:19.170429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bfff9-fcf6-45b1-be85-491d3ff24b8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:19.171931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bfff9-fcf6-45b1-be85-491d3ff24b8a service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:19.179443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:19.182360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 927/1859] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:19.198869 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73756121-bc85-4e36-83e3-b2b33da5cb25 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:19.204299 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7a479-f952-4b88-8a0e-8e9f62adaa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:19.204913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7a479-f952-4b88-8a0e-8e9f62adaa54 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:19.205319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7a479-f952-4b88-8a0e-8e9f62adaa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:19.205590 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7a479-f952-4b88-8a0e-8e9f62adaa54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:19.206213 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7a479-f952-4b88-8a0e-8e9f62adaa54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:19.208313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7a479-f952-4b88-8a0e-8e9f62adaa54 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:19.240219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 933/1860] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:19 2022] POST /identity/v3/projects => generated 355 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:19.244431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bfff9-fcf6-45b1-be85-491d3ff24b8a service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:19.256209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bfff9-fcf6-45b1-be85-491d3ff24b8a service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:19.321614 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d329844-9abf-49fb-91f4-5119494d040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:19.322323 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d329844-9abf-49fb-91f4-5119494d040a admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:19.322933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d329844-9abf-49fb-91f4-5119494d040a admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:19.323263 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d329844-9abf-49fb-91f4-5119494d040a admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:19.323990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d329844-9abf-49fb-91f4-5119494d040a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:19.326341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d329844-9abf-49fb-91f4-5119494d040a admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:19.349246 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 928/1861] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:19 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:19.354372 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7a479-f952-4b88-8a0e-8e9f62adaa54 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:19.365151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7a479-f952-4b88-8a0e-8e9f62adaa54 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:19.370115 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704dd34-8d86-44e1-8034-86965dcbb413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:19.370725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704dd34-8d86-44e1-8034-86965dcbb413 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:19.371032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704dd34-8d86-44e1-8034-86965dcbb413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:19.371292 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704dd34-8d86-44e1-8034-86965dcbb413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:19.371960 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704dd34-8d86-44e1-8034-86965dcbb413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:19.373587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704dd34-8d86-44e1-8034-86965dcbb413 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:19.384424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 934/1862] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:26:19.388529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d329844-9abf-49fb-91f4-5119494d040a admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:19.399729 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d329844-9abf-49fb-91f4-5119494d040a admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:19.404448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e38d45-f33b-43cc-982a-1ef203f8e40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:19.405179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e38d45-f33b-43cc-982a-1ef203f8e40d admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:19.405400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e38d45-f33b-43cc-982a-1ef203f8e40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:19.405676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e38d45-f33b-43cc-982a-1ef203f8e40d admin admin] PATH_INFO: `/v3/projects/76a7d02afb304aec8eb68137e8b007fb/users/d7c49251f7ff4968a1f1be444c873861/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:19.422531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e38d45-f33b-43cc-982a-1ef203f8e40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a7d02afb304aec8eb68137e8b007fb, user_id=d7c49251f7ff4968a1f1be444c873861, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:19.425379 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e38d45-f33b-43cc-982a-1ef203f8e40d admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:19.455885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704dd34-8d86-44e1-8034-86965dcbb413 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:19.458241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-4704dd34-8d86-44e1-8034-86965dcbb413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:19.460838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 929/1863] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:19 2022] PUT /identity/v3/projects/76a7d02afb304aec8eb68137e8b007fb/users/d7c49251f7ff4968a1f1be444c873861/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:19.468264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e38d45-f33b-43cc-982a-1ef203f8e40d admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:19.484321 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704dd34-8d86-44e1-8034-86965dcbb413 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:19.568893 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:19.603701 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86dd532-4c23-45f1-96e1-0787a381fe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:19.604437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dd532-4c23-45f1-96e1-0787a381fe4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:19.604926 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dd532-4c23-45f1-96e1-0787a381fe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:19.605259 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dd532-4c23-45f1-96e1-0787a381fe4b admin admin] PATH_INFO: `/v3/users/671ddb77178141c6b455f48f083e0ba4` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:19.606725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86dd532-4c23-45f1-96e1-0787a381fe4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=671ddb77178141c6b455f48f083e0ba4)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:19.615858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86dd532-4c23-45f1-96e1-0787a381fe4b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:19.656281 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e38d45-f33b-43cc-982a-1ef203f8e40d admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:19.679265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de7407-068a-4e23-a3e8-04fc43144114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:19.679955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de7407-068a-4e23-a3e8-04fc43144114 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:19.680255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de7407-068a-4e23-a3e8-04fc43144114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:19.681211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de7407-068a-4e23-a3e8-04fc43144114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:19.682320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de7407-068a-4e23-a3e8-04fc43144114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:19.684921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de7407-068a-4e23-a3e8-04fc43144114 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:19.708534 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 930/1864] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:19.708724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de7407-068a-4e23-a3e8-04fc43144114 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:19.718800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c86dd532-4c23-45f1-96e1-0787a381fe4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671ddb77178141c6b455f48f083e0ba4'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:19.722038 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de7407-068a-4e23-a3e8-04fc43144114 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:19.727729 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693bece-91af-4fe8-8db3-fd129137afca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:19.728690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693bece-91af-4fe8-8db3-fd129137afca admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:19.729222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693bece-91af-4fe8-8db3-fd129137afca admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:19.729428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693bece-91af-4fe8-8db3-fd129137afca admin admin] PATH_INFO: `/v3/projects/76a7d02afb304aec8eb68137e8b007fb/users/d7c49251f7ff4968a1f1be444c873861/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:19.731831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693bece-91af-4fe8-8db3-fd129137afca admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a7d02afb304aec8eb68137e8b007fb, user_id=d7c49251f7ff4968a1f1be444c873861, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:19.734476 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693bece-91af-4fe8-8db3-fd129137afca admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:19.746947 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 931/1865] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:19 2022] PUT /identity/v3/projects/76a7d02afb304aec8eb68137e8b007fb/users/d7c49251f7ff4968a1f1be444c873861/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:19.761839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06afa9-18a9-4f96-8e17-cd65e9935325 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:19.762221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06afa9-18a9-4f96-8e17-cd65e9935325 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:19.762498 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06afa9-18a9-4f96-8e17-cd65e9935325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:19.779210 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c86dd532-4c23-45f1-96e1-0787a381fe4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671ddb77178141c6b455f48f083e0ba4'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:19.792725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c86dd532-4c23-45f1-96e1-0787a381fe4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671ddb77178141c6b455f48f083e0ba4'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:19.793595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c86dd532-4c23-45f1-96e1-0787a381fe4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671ddb77178141c6b455f48f083e0ba4'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:19.794285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c86dd532-4c23-45f1-96e1-0787a381fe4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671ddb77178141c6b455f48f083e0ba4'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:19.824224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 935/1866] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:19 2022] DELETE /identity/v3/users/671ddb77178141c6b455f48f083e0ba4 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:19.828735 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-1d06afa9-18a9-4f96-8e17-cd65e9935325 None None] MFA Rules not processed for user `d7c49251f7ff4968a1f1be444c873861`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:19.830661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8fb9d-608a-4e45-a4bb-8f1157574a16 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:19.830984 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8fb9d-608a-4e45-a4bb-8f1157574a16 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:19.831242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8fb9d-608a-4e45-a4bb-8f1157574a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:19.832026 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-1d06afa9-18a9-4f96-8e17-cd65e9935325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:19.879641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-66a8fb9d-608a-4e45-a4bb-8f1157574a16 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:19.890247 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-66a8fb9d-608a-4e45-a4bb-8f1157574a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:19.991388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:20.069223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 932/1867] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:20.072017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06afa9-18a9-4f96-8e17-cd65e9935325 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:20.082099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-1d06afa9-18a9-4f96-8e17-cd65e9935325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:20.092149 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 936/1868] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:20.094124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8fb9d-608a-4e45-a4bb-8f1157574a16 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:20.097097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-66a8fb9d-608a-4e45-a4bb-8f1157574a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:20.117970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06afa9-18a9-4f96-8e17-cd65e9935325 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:20.123610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d242dd-ecd8-4bc5-9fa0-fd37febc3814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:20.124268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d242dd-ecd8-4bc5-9fa0-fd37febc3814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:20.124545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d242dd-ecd8-4bc5-9fa0-fd37febc3814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:20.125012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d242dd-ecd8-4bc5-9fa0-fd37febc3814 admin admin] PATH_INFO: `/v3/users/70cba32409b748a4b12f9f3b3430f277` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:20.126325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d242dd-ecd8-4bc5-9fa0-fd37febc3814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70cba32409b748a4b12f9f3b3430f277)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:20.128473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d242dd-ecd8-4bc5-9fa0-fd37febc3814 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:20.239879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8fb9d-608a-4e45-a4bb-8f1157574a16 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:20.254304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fc576-75b1-4a1d-a26f-5db769ed9f5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:20.255219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fc576-75b1-4a1d-a26f-5db769ed9f5c service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:20.255601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fc576-75b1-4a1d-a26f-5db769ed9f5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:20.255989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fc576-75b1-4a1d-a26f-5db769ed9f5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:20.268001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-44d242dd-ecd8-4bc5-9fa0-fd37febc3814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70cba32409b748a4b12f9f3b3430f277'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:20.279971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-44d242dd-ecd8-4bc5-9fa0-fd37febc3814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70cba32409b748a4b12f9f3b3430f277'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:20.281809 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-44d242dd-ecd8-4bc5-9fa0-fd37febc3814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70cba32409b748a4b12f9f3b3430f277'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:20.283205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-44d242dd-ecd8-4bc5-9fa0-fd37febc3814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70cba32409b748a4b12f9f3b3430f277'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:20.303807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fc576-75b1-4a1d-a26f-5db769ed9f5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:20.305449 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fc576-75b1-4a1d-a26f-5db769ed9f5c service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:20.321125 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-44d242dd-ecd8-4bc5-9fa0-fd37febc3814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70cba32409b748a4b12f9f3b3430f277'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:20.332875 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 937/1869] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:20.334461 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fc576-75b1-4a1d-a26f-5db769ed9f5c service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:20.342066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-981fc576-75b1-4a1d-a26f-5db769ed9f5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:20.368025 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 933/1870] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:20 2022] DELETE /identity/v3/users/70cba32409b748a4b12f9f3b3430f277 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:20.378535 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0fb4d-11c1-49f9-9c3c-10966800ffc1 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:20.381511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0fb4d-11c1-49f9-9c3c-10966800ffc1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:20.381966 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0fb4d-11c1-49f9-9c3c-10966800ffc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:20.455401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-81f0fb4d-11c1-49f9-9c3c-10966800ffc1 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:20.455811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fc576-75b1-4a1d-a26f-5db769ed9f5c service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:20.456692 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-81f0fb4d-11c1-49f9-9c3c-10966800ffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:20.526601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:20.613967 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 934/1871] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:20.619002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0fb4d-11c1-49f9-9c3c-10966800ffc1 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:20.625904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-81f0fb4d-11c1-49f9-9c3c-10966800ffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:20.629333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c830d-5533-4784-8303-ad1c6e08dfe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:20.630104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c830d-5533-4784-8303-ad1c6e08dfe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:20.630386 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c830d-5533-4784-8303-ad1c6e08dfe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:20.630720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c830d-5533-4784-8303-ad1c6e08dfe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:20.633007 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-099c830d-5533-4784-8303-ad1c6e08dfe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:20.663985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c830d-5533-4784-8303-ad1c6e08dfe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:20.665569 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c830d-5533-4784-8303-ad1c6e08dfe5 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:20.691017 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 938/1872] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:20.692076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c830d-5533-4784-8303-ad1c6e08dfe5 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:20.694579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-099c830d-5533-4784-8303-ad1c6e08dfe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:20.722612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c830d-5533-4784-8303-ad1c6e08dfe5 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:20.727064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27bee0-035a-4d9c-9912-ae34c1e9082a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:20.727686 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27bee0-035a-4d9c-9912-ae34c1e9082a service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:20.727963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27bee0-035a-4d9c-9912-ae34c1e9082a service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:20.728239 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27bee0-035a-4d9c-9912-ae34c1e9082a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:20.735359 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0fb4d-11c1-49f9-9c3c-10966800ffc1 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:20.740952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630737b-60ad-4f66-8ef9-a74c31e037e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:20.743587 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630737b-60ad-4f66-8ef9-a74c31e037e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:20.744089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630737b-60ad-4f66-8ef9-a74c31e037e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:20.746555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630737b-60ad-4f66-8ef9-a74c31e037e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:20.748777 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f630737b-60ad-4f66-8ef9-a74c31e037e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:20.755408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27bee0-035a-4d9c-9912-ae34c1e9082a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:20.757280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27bee0-035a-4d9c-9912-ae34c1e9082a service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:20.786176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 939/1873] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:20.911092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630737b-60ad-4f66-8ef9-a74c31e037e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:20.913393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630737b-60ad-4f66-8ef9-a74c31e037e2 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:20.930523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 935/1874] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:21.310694 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27bee0-035a-4d9c-9912-ae34c1e9082a service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:21.313519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-3a27bee0-035a-4d9c-9912-ae34c1e9082a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:21.374206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27bee0-035a-4d9c-9912-ae34c1e9082a service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:21.394617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:21.400656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:21.401376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:21.412259 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] PATH_INFO: `/v3/projects/86ec6211eff24bbe9098ac53babace8e` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:21.419224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ec6211eff24bbe9098ac53babace8e)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:21.426883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:21.503123 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:21.583777 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ec6211eff24bbe9098ac53babace8e', 'request_id': 'req-d288093e-f46f-4394-862c-ba0778e964a9'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:21.600957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ec6211eff24bbe9098ac53babace8e', 'request_id': 'req-d288093e-f46f-4394-862c-ba0778e964a9'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:21.607625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630737b-60ad-4f66-8ef9-a74c31e037e2 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:21.610337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f630737b-60ad-4f66-8ef9-a74c31e037e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:21.622496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ec6211eff24bbe9098ac53babace8e', 'request_id': 'req-d288093e-f46f-4394-862c-ba0778e964a9'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:21.638207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] The token cache is being invalidate because project 86ec6211eff24bbe9098ac53babace8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:21.639562 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:21.640515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:21.643598 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 940/1875] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:21 2022] DELETE /identity/v3/projects/86ec6211eff24bbe9098ac53babace8e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:21.648223 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:21.650304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:21.655984 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630737b-60ad-4f66-8ef9-a74c31e037e2 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:21.798491 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288093e-f46f-4394-862c-ba0778e964a9 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:21.808567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954590f-942b-4a08-9767-42d9ffaf950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:21.809322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954590f-942b-4a08-9767-42d9ffaf950a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:21.809579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954590f-942b-4a08-9767-42d9ffaf950a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:21.809872 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954590f-942b-4a08-9767-42d9ffaf950a admin admin] PATH_INFO: `/v3/users/14d8d586faaa4101bc2af1e59fc50060` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:21.814107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954590f-942b-4a08-9767-42d9ffaf950a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14d8d586faaa4101bc2af1e59fc50060)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:21.817305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954590f-942b-4a08-9767-42d9ffaf950a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:21.944465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:21.944465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:21.944465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:21.945162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] PATH_INFO: `/v3/projects/9895821b80e9421e825f2ef793b9a486` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:21.950723 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9895821b80e9421e825f2ef793b9a486)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:21.961518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:21.999340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9954590f-942b-4a08-9767-42d9ffaf950a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14d8d586faaa4101bc2af1e59fc50060'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.097863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9954590f-942b-4a08-9767-42d9ffaf950a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14d8d586faaa4101bc2af1e59fc50060'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.126800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9954590f-942b-4a08-9767-42d9ffaf950a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14d8d586faaa4101bc2af1e59fc50060'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.129274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9954590f-942b-4a08-9767-42d9ffaf950a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14d8d586faaa4101bc2af1e59fc50060'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.131081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9954590f-942b-4a08-9767-42d9ffaf950a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14d8d586faaa4101bc2af1e59fc50060'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.140941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:22.177250 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 941/1876] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:21 2022] DELETE /identity/v3/users/14d8d586faaa4101bc2af1e59fc50060 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:22.199067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9895821b80e9421e825f2ef793b9a486', 'request_id': 'req-c270cb09-4801-47fe-96c6-a7e292f0a424'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.214068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9895821b80e9421e825f2ef793b9a486', 'request_id': 'req-c270cb09-4801-47fe-96c6-a7e292f0a424'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.230339 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9895821b80e9421e825f2ef793b9a486', 'request_id': 'req-c270cb09-4801-47fe-96c6-a7e292f0a424'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.245715 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] The token cache is being invalidate because project 9895821b80e9421e825f2ef793b9a486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:22.246266 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.247202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.253918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 936/1877] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:21 2022] DELETE /identity/v3/projects/9895821b80e9421e825f2ef793b9a486 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:22.256252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954590f-942b-4a08-9767-42d9ffaf950a admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:22.261508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9954590f-942b-4a08-9767-42d9ffaf950a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:22.399807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:22.518670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954590f-942b-4a08-9767-42d9ffaf950a admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:22.539258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad52c35-e6cb-47c0-b929-d44eeaaaae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:22.539954 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad52c35-e6cb-47c0-b929-d44eeaaaae4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:22.540711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad52c35-e6cb-47c0-b929-d44eeaaaae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:22.540998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad52c35-e6cb-47c0-b929-d44eeaaaae4b admin admin] PATH_INFO: `/v3/users/0482d9fb2d414930b10a2d57c08f9d86` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:22.543916 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad52c35-e6cb-47c0-b929-d44eeaaaae4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0482d9fb2d414930b10a2d57c08f9d86)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:22.545944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad52c35-e6cb-47c0-b929-d44eeaaaae4b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:22.668604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6ad52c35-e6cb-47c0-b929-d44eeaaaae4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0482d9fb2d414930b10a2d57c08f9d86'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.703062 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6ad52c35-e6cb-47c0-b929-d44eeaaaae4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0482d9fb2d414930b10a2d57c08f9d86'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.767804 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6ad52c35-e6cb-47c0-b929-d44eeaaaae4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0482d9fb2d414930b10a2d57c08f9d86'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.768938 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6ad52c35-e6cb-47c0-b929-d44eeaaaae4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0482d9fb2d414930b10a2d57c08f9d86'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.770159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6ad52c35-e6cb-47c0-b929-d44eeaaaae4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0482d9fb2d414930b10a2d57c08f9d86'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:22.813176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 942/1878] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:22 2022] DELETE /identity/v3/users/0482d9fb2d414930b10a2d57c08f9d86 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:23.085487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:23.088088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:23.249643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270cb09-4801-47fe-96c6-a7e292f0a424 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:23.389898 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ba4dd-99c8-4d12-850c-931faac84e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:23.390565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ba4dd-99c8-4d12-850c-931faac84e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:23.390942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ba4dd-99c8-4d12-850c-931faac84e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:23.391634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ba4dd-99c8-4d12-850c-931faac84e6c admin admin] PATH_INFO: `/v3/users/82ca9ea2c08e47c9bc732e70b2fbf53b` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:23.393384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ba4dd-99c8-4d12-850c-931faac84e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ca9ea2c08e47c9bc732e70b2fbf53b)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:23.395938 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ba4dd-99c8-4d12-850c-931faac84e6c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:23.558770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-bc3ba4dd-99c8-4d12-850c-931faac84e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ca9ea2c08e47c9bc732e70b2fbf53b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:23.589880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-bc3ba4dd-99c8-4d12-850c-931faac84e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ca9ea2c08e47c9bc732e70b2fbf53b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:23.591417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-bc3ba4dd-99c8-4d12-850c-931faac84e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ca9ea2c08e47c9bc732e70b2fbf53b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:23.594605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-bc3ba4dd-99c8-4d12-850c-931faac84e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ca9ea2c08e47c9bc732e70b2fbf53b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:23.613032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:23.633760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-bc3ba4dd-99c8-4d12-850c-931faac84e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ca9ea2c08e47c9bc732e70b2fbf53b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:23.661639 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 937/1879] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:23 2022] DELETE /identity/v3/users/82ca9ea2c08e47c9bc732e70b2fbf53b => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:23.667219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0824f4-6c18-4f31-b11d-25fe8203cab2 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:23.668551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0824f4-6c18-4f31-b11d-25fe8203cab2 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:23.669581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0824f4-6c18-4f31-b11d-25fe8203cab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:23.693558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-3a0824f4-6c18-4f31-b11d-25fe8203cab2 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:23.695470 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-3a0824f4-6c18-4f31-b11d-25fe8203cab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:23.809647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 943/1880] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:23.824686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ba4dd-99c8-4d12-850c-931faac84e6c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:23.826352 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-bc3ba4dd-99c8-4d12-850c-931faac84e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:23.940561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ba4dd-99c8-4d12-850c-931faac84e6c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:23.952815 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756e437-7953-4107-8f8f-f1a37332e627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:23.953869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756e437-7953-4107-8f8f-f1a37332e627 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:23.954361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756e437-7953-4107-8f8f-f1a37332e627 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:23.954859 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756e437-7953-4107-8f8f-f1a37332e627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:23.972237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756e437-7953-4107-8f8f-f1a37332e627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:23.975851 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756e437-7953-4107-8f8f-f1a37332e627 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:24.031217 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 938/1881] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:24.065080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0824f4-6c18-4f31-b11d-25fe8203cab2 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:24.072204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-3a0824f4-6c18-4f31-b11d-25fe8203cab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:24.165064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0824f4-6c18-4f31-b11d-25fe8203cab2 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:24.188683 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17da6d2-c2cc-46a4-8239-80b67717ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:24.189765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17da6d2-c2cc-46a4-8239-80b67717ade7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:24.190205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17da6d2-c2cc-46a4-8239-80b67717ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:24.190482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17da6d2-c2cc-46a4-8239-80b67717ade7 admin admin] PATH_INFO: `/v3/projects/6249e47b6c924d0d9ec510ad02cf2d5b` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:24.193131 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17da6d2-c2cc-46a4-8239-80b67717ade7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6249e47b6c924d0d9ec510ad02cf2d5b)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:24.203852 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17da6d2-c2cc-46a4-8239-80b67717ade7 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:24.309685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:24.348354 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c17da6d2-c2cc-46a4-8239-80b67717ade7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6249e47b6c924d0d9ec510ad02cf2d5b', 'request_id': 'req-c17da6d2-c2cc-46a4-8239-80b67717ade7'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:24.368507 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756e437-7953-4107-8f8f-f1a37332e627 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:24.370363 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b756e437-7953-4107-8f8f-f1a37332e627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:24.375523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c17da6d2-c2cc-46a4-8239-80b67717ade7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6249e47b6c924d0d9ec510ad02cf2d5b', 'request_id': 'req-c17da6d2-c2cc-46a4-8239-80b67717ade7'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:24.394212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756e437-7953-4107-8f8f-f1a37332e627 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:24.398757 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c17da6d2-c2cc-46a4-8239-80b67717ade7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6249e47b6c924d0d9ec510ad02cf2d5b', 'request_id': 'req-c17da6d2-c2cc-46a4-8239-80b67717ade7'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:24.431190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c17da6d2-c2cc-46a4-8239-80b67717ade7 admin admin] The token cache is being invalidate because project 6249e47b6c924d0d9ec510ad02cf2d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:24.431516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c17da6d2-c2cc-46a4-8239-80b67717ade7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:24.432887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c17da6d2-c2cc-46a4-8239-80b67717ade7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:24.435795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 944/1882] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:24 2022] DELETE /identity/v3/projects/6249e47b6c924d0d9ec510ad02cf2d5b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:24.440974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52410335-44f7-4090-9acd-29a4cb30d3c1 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:24.441547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52410335-44f7-4090-9acd-29a4cb30d3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:24.442031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52410335-44f7-4090-9acd-29a4cb30d3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:24.486189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-52410335-44f7-4090-9acd-29a4cb30d3c1 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:24.488588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-52410335-44f7-4090-9acd-29a4cb30d3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:24.526945 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cd3e6-55f6-4def-8ed9-c23267371951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:24.528004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cd3e6-55f6-4def-8ed9-c23267371951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:24.528482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cd3e6-55f6-4def-8ed9-c23267371951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:24.528974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cd3e6-55f6-4def-8ed9-c23267371951 admin admin] PATH_INFO: `/v3/projects/6085a31a8df0438980cdb30dee204ad3` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:24.530660 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cd3e6-55f6-4def-8ed9-c23267371951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6085a31a8df0438980cdb30dee204ad3)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:24.535683 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cd3e6-55f6-4def-8ed9-c23267371951 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:24.643344 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-132cd3e6-55f6-4def-8ed9-c23267371951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6085a31a8df0438980cdb30dee204ad3', 'request_id': 'req-132cd3e6-55f6-4def-8ed9-c23267371951'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:24.648558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 945/1883] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:24.657830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562463b-8417-46fa-8b07-fff7c33bb742 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:24.658499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562463b-8417-46fa-8b07-fff7c33bb742 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:24.658862 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562463b-8417-46fa-8b07-fff7c33bb742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:24.680538 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-132cd3e6-55f6-4def-8ed9-c23267371951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6085a31a8df0438980cdb30dee204ad3', 'request_id': 'req-132cd3e6-55f6-4def-8ed9-c23267371951'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:24.692526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-132cd3e6-55f6-4def-8ed9-c23267371951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6085a31a8df0438980cdb30dee204ad3', 'request_id': 'req-132cd3e6-55f6-4def-8ed9-c23267371951'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:24.708320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-132cd3e6-55f6-4def-8ed9-c23267371951 admin admin] The token cache is being invalidate because project 6085a31a8df0438980cdb30dee204ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:24.708643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-132cd3e6-55f6-4def-8ed9-c23267371951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:24.709388 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-132cd3e6-55f6-4def-8ed9-c23267371951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:24.715248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 939/1884] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:24 2022] DELETE /identity/v3/projects/6085a31a8df0438980cdb30dee204ad3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:24.719882 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca200369-fe7d-4739-995b-4ae90deb29f1 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:24.720201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca200369-fe7d-4739-995b-4ae90deb29f1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:24.720423 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca200369-fe7d-4739-995b-4ae90deb29f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:24.722571 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-0562463b-8417-46fa-8b07-fff7c33bb742 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:24.725168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0562463b-8417-46fa-8b07-fff7c33bb742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:24.775430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ca200369-fe7d-4739-995b-4ae90deb29f1 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:24.777013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ca200369-fe7d-4739-995b-4ae90deb29f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:24.788126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:24.811088 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 946/1885] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:24.812720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562463b-8417-46fa-8b07-fff7c33bb742 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:24.825099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562463b-8417-46fa-8b07-fff7c33bb742 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:24.836799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a66fdd-e777-4bed-9954-c3bf83686f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:24.837438 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a66fdd-e777-4bed-9954-c3bf83686f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:24.837710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a66fdd-e777-4bed-9954-c3bf83686f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:24.838021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a66fdd-e777-4bed-9954-c3bf83686f9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:24.838732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a66fdd-e777-4bed-9954-c3bf83686f9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:24.839075 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a66fdd-e777-4bed-9954-c3bf83686f9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:24.858604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a66fdd-e777-4bed-9954-c3bf83686f9f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:24.867311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 940/1886] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:24.875893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 947/1887] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:24.879264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384fc9-b458-4441-a321-441055f379a5 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:24.879742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384fc9-b458-4441-a321-441055f379a5 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:24.880227 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384fc9-b458-4441-a321-441055f379a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:24.881603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a66fdd-e777-4bed-9954-c3bf83686f9f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:24.899284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a66fdd-e777-4bed-9954-c3bf83686f9f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:24.907352 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d526f-d789-4ed5-b664-cefb160b9608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:24.907613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-36384fc9-b458-4441-a321-441055f379a5 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:24.908522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d526f-d789-4ed5-b664-cefb160b9608 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:24.909246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d526f-d789-4ed5-b664-cefb160b9608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:24.909500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-36384fc9-b458-4441-a321-441055f379a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:24.909745 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d526f-d789-4ed5-b664-cefb160b9608 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:24.911399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d526f-d789-4ed5-b664-cefb160b9608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:24.915338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d526f-d789-4ed5-b664-cefb160b9608 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:24.923869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 941/1888] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:24.925254 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384fc9-b458-4441-a321-441055f379a5 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:24.939487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384fc9-b458-4441-a321-441055f379a5 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:24.946378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fb67b-80b6-48bb-8043-67eb84f6b3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:24.947038 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fb67b-80b6-48bb-8043-67eb84f6b3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:24.947373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fb67b-80b6-48bb-8043-67eb84f6b3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:24.947643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fb67b-80b6-48bb-8043-67eb84f6b3b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:24.948298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fb67b-80b6-48bb-8043-67eb84f6b3b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:24.948595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fb67b-80b6-48bb-8043-67eb84f6b3b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:24.950244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fb67b-80b6-48bb-8043-67eb84f6b3b9 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:24.964374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 948/1889] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:24 2022] POST /identity/v3/projects => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:24.965451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 942/1890] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:24.966357 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d526f-d789-4ed5-b664-cefb160b9608 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:24.969269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fb67b-80b6-48bb-8043-67eb84f6b3b9 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:24.980588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fb67b-80b6-48bb-8043-67eb84f6b3b9 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.029304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:25.068724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d526f-d789-4ed5-b664-cefb160b9608 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.070747 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a61d2-a87b-4c33-9302-754398ae85c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.071420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a61d2-a87b-4c33-9302-754398ae85c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.071695 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a61d2-a87b-4c33-9302-754398ae85c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.071965 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a61d2-a87b-4c33-9302-754398ae85c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.072642 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a61d2-a87b-4c33-9302-754398ae85c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.074782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a61d2-a87b-4c33-9302-754398ae85c7 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.075575 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bef40d-dac3-40b9-8df5-70dd10196340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.076396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef40d-dac3-40b9-8df5-70dd10196340 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.076780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef40d-dac3-40b9-8df5-70dd10196340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.077152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef40d-dac3-40b9-8df5-70dd10196340 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.078039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bef40d-dac3-40b9-8df5-70dd10196340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.080870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bef40d-dac3-40b9-8df5-70dd10196340 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.105076 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 943/1891] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:24 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:25.106054 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a61d2-a87b-4c33-9302-754398ae85c7 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:25.107831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e75a61d2-a87b-4c33-9302-754398ae85c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:25.114843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 949/1892] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:24 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:25.114843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bef40d-dac3-40b9-8df5-70dd10196340 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:25.127678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bef40d-dac3-40b9-8df5-70dd10196340 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.179758 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a61d2-a87b-4c33-9302-754398ae85c7 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.184491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.185169 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.185422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.185676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] PATH_INFO: `/v3/projects/acf8fcf61478446894bdee927797f811` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.186944 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf8fcf61478446894bdee927797f811)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.188780 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.192268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84500aea-43e6-4985-bd66-bbf50fc25dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.193016 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84500aea-43e6-4985-bd66-bbf50fc25dda admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.193296 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84500aea-43e6-4985-bd66-bbf50fc25dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.193547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84500aea-43e6-4985-bd66-bbf50fc25dda admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.194178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84500aea-43e6-4985-bd66-bbf50fc25dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.196155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84500aea-43e6-4985-bd66-bbf50fc25dda admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.214854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:25.222246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 950/1893] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:25 2022] POST /identity/v3/users => generated 282 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:25.223194 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84500aea-43e6-4985-bd66-bbf50fc25dda admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:25.235051 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84500aea-43e6-4985-bd66-bbf50fc25dda admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.243620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf8fcf61478446894bdee927797f811', 'request_id': 'req-2131205a-1c98-4c95-ae3c-b86e0104e314'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:25.252394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf8fcf61478446894bdee927797f811', 'request_id': 'req-2131205a-1c98-4c95-ae3c-b86e0104e314'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:25.258959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf8fcf61478446894bdee927797f811', 'request_id': 'req-2131205a-1c98-4c95-ae3c-b86e0104e314'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:25.271151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] The token cache is being invalidate because project acf8fcf61478446894bdee927797f811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:25.271608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:25.272726 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:25.275357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 944/1894] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:25 2022] DELETE /identity/v3/projects/acf8fcf61478446894bdee927797f811 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:25.276706 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:25.279363 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:25.297679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515caff-58c1-485f-b156-4b7ffde722d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.298438 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515caff-58c1-485f-b156-4b7ffde722d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.298723 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515caff-58c1-485f-b156-4b7ffde722d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.299029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515caff-58c1-485f-b156-4b7ffde722d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.299666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515caff-58c1-485f-b156-4b7ffde722d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.301335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515caff-58c1-485f-b156-4b7ffde722d1 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.311931 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 951/1895] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:25.312904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d6079-ee8c-4a94-ace9-b56c86f4adf9 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.313071 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d6079-ee8c-4a94-ace9-b56c86f4adf9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.313310 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d6079-ee8c-4a94-ace9-b56c86f4adf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.334118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-353d6079-ee8c-4a94-ace9-b56c86f4adf9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:25.335359 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-353d6079-ee8c-4a94-ace9-b56c86f4adf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:25.343170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 952/1896] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:25.343959 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d6079-ee8c-4a94-ace9-b56c86f4adf9 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:25.345175 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-353d6079-ee8c-4a94-ace9-b56c86f4adf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:25.357058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d6079-ee8c-4a94-ace9-b56c86f4adf9 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.362136 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6a64c-d2a2-4f97-befc-8e9f7b77a99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.362911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6a64c-d2a2-4f97-befc-8e9f7b77a99d admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.363186 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6a64c-d2a2-4f97-befc-8e9f7b77a99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.363452 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6a64c-d2a2-4f97-befc-8e9f7b77a99d admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.364094 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6a64c-d2a2-4f97-befc-8e9f7b77a99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.365765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6a64c-d2a2-4f97-befc-8e9f7b77a99d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.365874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131205a-1c98-4c95-ae3c-b86e0104e314 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.371832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f0cd2-ae77-4323-8091-e4a3e60c2d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.372415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f0cd2-ae77-4323-8091-e4a3e60c2d29 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.372792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f0cd2-ae77-4323-8091-e4a3e60c2d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.373063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f0cd2-ae77-4323-8091-e4a3e60c2d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.373758 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f0cd2-ae77-4323-8091-e4a3e60c2d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.375424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f0cd2-ae77-4323-8091-e4a3e60c2d29 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.376448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 953/1897] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:25.377741 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41436f-3138-4bf3-996e-fbab4a66ae32 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.378043 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41436f-3138-4bf3-996e-fbab4a66ae32 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.378367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41436f-3138-4bf3-996e-fbab4a66ae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.386947 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 945/1898] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:25.388129 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f0cd2-ae77-4323-8091-e4a3e60c2d29 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:25.398221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f0cd2-ae77-4323-8091-e4a3e60c2d29 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.406582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-0f41436f-3138-4bf3-996e-fbab4a66ae32 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:25.406582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0f41436f-3138-4bf3-996e-fbab4a66ae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:25.408259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d0a83-8cb7-43ec-848f-1826bc135500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.409179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d0a83-8cb7-43ec-848f-1826bc135500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.409321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d0a83-8cb7-43ec-848f-1826bc135500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.409699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d0a83-8cb7-43ec-848f-1826bc135500 admin admin] PATH_INFO: `/v3/projects/37b3a35d3d644d8da046a0473b25c8cc/users/8e172181255d413ebbf8929e024e0705/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.416177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 954/1899] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:25.416177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41436f-3138-4bf3-996e-fbab4a66ae32 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:25.426567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d0a83-8cb7-43ec-848f-1826bc135500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37b3a35d3d644d8da046a0473b25c8cc, user_id=8e172181255d413ebbf8929e024e0705, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.428222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41436f-3138-4bf3-996e-fbab4a66ae32 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.429259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d0a83-8cb7-43ec-848f-1826bc135500 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.433396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58740857-f253-4c57-a6f0-bf736a487e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.434024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58740857-f253-4c57-a6f0-bf736a487e28 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.434298 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58740857-f253-4c57-a6f0-bf736a487e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.434957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58740857-f253-4c57-a6f0-bf736a487e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.435417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58740857-f253-4c57-a6f0-bf736a487e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.437198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58740857-f253-4c57-a6f0-bf736a487e28 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.444519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 946/1900] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:25 2022] PUT /identity/v3/projects/37b3a35d3d644d8da046a0473b25c8cc/users/8e172181255d413ebbf8929e024e0705/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:25.445389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d0a83-8cb7-43ec-848f-1826bc135500 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:25.448762 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 955/1901] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:25.453185 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58740857-f253-4c57-a6f0-bf736a487e28 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:25.465101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58740857-f253-4c57-a6f0-bf736a487e28 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.478579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:25.518985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d0a83-8cb7-43ec-848f-1826bc135500 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.525029 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831ebee-6dbb-4e24-9293-20e00f5ec219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.525662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831ebee-6dbb-4e24-9293-20e00f5ec219 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.525944 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831ebee-6dbb-4e24-9293-20e00f5ec219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.526203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831ebee-6dbb-4e24-9293-20e00f5ec219 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.526892 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831ebee-6dbb-4e24-9293-20e00f5ec219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:25.527196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831ebee-6dbb-4e24-9293-20e00f5ec219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.528834 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831ebee-6dbb-4e24-9293-20e00f5ec219 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.532459 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ba1c2-d3b2-430f-9a9d-9890f3cd5715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.533207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ba1c2-d3b2-430f-9a9d-9890f3cd5715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.533504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ba1c2-d3b2-430f-9a9d-9890f3cd5715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.533774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ba1c2-d3b2-430f-9a9d-9890f3cd5715 admin admin] PATH_INFO: `/v3/projects/66c24a63dcf54f839754d5dc650796f2/users/565527a1ed664191bebd4e420c26f813/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.541897 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 947/1902] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:25.543237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2d7df-b29a-4e13-b3e0-80d82ae36c56 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.544042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2d7df-b29a-4e13-b3e0-80d82ae36c56 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.544317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2d7df-b29a-4e13-b3e0-80d82ae36c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.550706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ba1c2-d3b2-430f-9a9d-9890f3cd5715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c24a63dcf54f839754d5dc650796f2, user_id=565527a1ed664191bebd4e420c26f813, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.553541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ba1c2-d3b2-430f-9a9d-9890f3cd5715 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.570801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 956/1903] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:25 2022] PUT /identity/v3/projects/66c24a63dcf54f839754d5dc650796f2/users/565527a1ed664191bebd4e420c26f813/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:25.571928 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ba1c2-d3b2-430f-9a9d-9890f3cd5715 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:25.586240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-86f2d7df-b29a-4e13-b3e0-80d82ae36c56 None None] MFA Rules not processed for user `8e172181255d413ebbf8929e024e0705`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:25.588141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-86f2d7df-b29a-4e13-b3e0-80d82ae36c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:25.595544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:25.640972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ba1c2-d3b2-430f-9a9d-9890f3cd5715 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.646069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180fbcc-0f23-40f3-b710-45b11c805c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.646670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180fbcc-0f23-40f3-b710-45b11c805c54 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.647019 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180fbcc-0f23-40f3-b710-45b11c805c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.647286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180fbcc-0f23-40f3-b710-45b11c805c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.647910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180fbcc-0f23-40f3-b710-45b11c805c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.649811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180fbcc-0f23-40f3-b710-45b11c805c54 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.677985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 948/1904] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:25.677985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24b639-0ee3-451f-afd8-f2eec496bc47 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.677985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24b639-0ee3-451f-afd8-f2eec496bc47 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.679114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24b639-0ee3-451f-afd8-f2eec496bc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.708054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 957/1905] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:25 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:25.708983 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180fbcc-0f23-40f3-b710-45b11c805c54 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:25.716544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-5d24b639-0ee3-451f-afd8-f2eec496bc47 None None] MFA Rules not processed for user `565527a1ed664191bebd4e420c26f813`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:25.717857 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-5d24b639-0ee3-451f-afd8-f2eec496bc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:25.802833 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180fbcc-0f23-40f3-b710-45b11c805c54 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.817833 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35659e1a-ee86-48d5-8b1d-26d3c92bedf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.818677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35659e1a-ee86-48d5-8b1d-26d3c92bedf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.819252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35659e1a-ee86-48d5-8b1d-26d3c92bedf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.819624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35659e1a-ee86-48d5-8b1d-26d3c92bedf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.820515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35659e1a-ee86-48d5-8b1d-26d3c92bedf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.823348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35659e1a-ee86-48d5-8b1d-26d3c92bedf8 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.828495 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 949/1906] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:25.829638 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24b639-0ee3-451f-afd8-f2eec496bc47 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:25.843959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24b639-0ee3-451f-afd8-f2eec496bc47 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.857338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed2d34-bea1-4160-be01-2b1a562b1c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.858257 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed2d34-bea1-4160-be01-2b1a562b1c5c admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.858708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed2d34-bea1-4160-be01-2b1a562b1c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.859105 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed2d34-bea1-4160-be01-2b1a562b1c5c admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.860308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed2d34-bea1-4160-be01-2b1a562b1c5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.861800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed2d34-bea1-4160-be01-2b1a562b1c5c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.867818 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 958/1907] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:25 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:25.867818 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35659e1a-ee86-48d5-8b1d-26d3c92bedf8 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:25.886773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:25.898778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 950/1908] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:25 2022] POST /identity/v3/users => generated 285 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:25.898778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed2d34-bea1-4160-be01-2b1a562b1c5c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:25.911669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed2d34-bea1-4160-be01-2b1a562b1c5c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.979236 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35659e1a-ee86-48d5-8b1d-26d3c92bedf8 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:25.984425 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d743e2c-7cf2-4f96-af3f-6c90e7298525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.985133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d743e2c-7cf2-4f96-af3f-6c90e7298525 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.985477 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d743e2c-7cf2-4f96-af3f-6c90e7298525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.985919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d743e2c-7cf2-4f96-af3f-6c90e7298525 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.986041 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f5a50-fe7a-47dd-824f-b56f898b7754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:25.986656 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f5a50-fe7a-47dd-824f-b56f898b7754 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:25.986771 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d743e2c-7cf2-4f96-af3f-6c90e7298525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.986981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f5a50-fe7a-47dd-824f-b56f898b7754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:25.987449 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f5a50-fe7a-47dd-824f-b56f898b7754 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:25.987975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f5a50-fe7a-47dd-824f-b56f898b7754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:25.989032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d743e2c-7cf2-4f96-af3f-6c90e7298525 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:25.989888 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f5a50-fe7a-47dd-824f-b56f898b7754 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.019942 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 959/1909] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:25 2022] POST /identity/v3/projects => generated 363 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:26.020867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d743e2c-7cf2-4f96-af3f-6c90e7298525 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:26.026024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 951/1910] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:25 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:26.026024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f5a50-fe7a-47dd-824f-b56f898b7754 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:26.037759 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f5a50-fe7a-47dd-824f-b56f898b7754 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:26.041644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:26.098429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d743e2c-7cf2-4f96-af3f-6c90e7298525 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:26.103445 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afbdb6-76cd-44f4-841a-3748f7708081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:26.104140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afbdb6-76cd-44f4-841a-3748f7708081 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.104457 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afbdb6-76cd-44f4-841a-3748f7708081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.104863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afbdb6-76cd-44f4-841a-3748f7708081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.105040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657059eb-af90-4304-bb85-697bf455b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:26.105501 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afbdb6-76cd-44f4-841a-3748f7708081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:26.105636 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657059eb-af90-4304-bb85-697bf455b5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.106360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657059eb-af90-4304-bb85-697bf455b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.106723 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657059eb-af90-4304-bb85-697bf455b5d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.107795 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657059eb-af90-4304-bb85-697bf455b5d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:26.107906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afbdb6-76cd-44f4-841a-3748f7708081 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.111558 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657059eb-af90-4304-bb85-697bf455b5d2 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.121085 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 960/1911] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:26.124309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afbdb6-76cd-44f4-841a-3748f7708081 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:26.136438 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afbdb6-76cd-44f4-841a-3748f7708081 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:26.139253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 952/1912] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:26 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:26.140233 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657059eb-af90-4304-bb85-697bf455b5d2 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:26.142353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfc9bd-d792-49c0-94bb-c9b83d206ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:26.143009 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfc9bd-d792-49c0-94bb-c9b83d206ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.143285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfc9bd-d792-49c0-94bb-c9b83d206ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.143549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfc9bd-d792-49c0-94bb-c9b83d206ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.144273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfc9bd-d792-49c0-94bb-c9b83d206ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:26.146004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfc9bd-d792-49c0-94bb-c9b83d206ed9 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.151360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657059eb-af90-4304-bb85-697bf455b5d2 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:26.156823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0ac88-aaa3-47a1-9993-02ba030bb022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:26.157617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ac88-aaa3-47a1-9993-02ba030bb022 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.157894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ac88-aaa3-47a1-9993-02ba030bb022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.158234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ac88-aaa3-47a1-9993-02ba030bb022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.158990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0ac88-aaa3-47a1-9993-02ba030bb022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:26.160700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0ac88-aaa3-47a1-9993-02ba030bb022 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.161088 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 961/1913] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:26.162607 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfc9bd-d792-49c0-94bb-c9b83d206ed9 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:26.178774 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 953/1914] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:26.179817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0ac88-aaa3-47a1-9993-02ba030bb022 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:26.182981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfc9bd-d792-49c0-94bb-c9b83d206ed9 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:26.188282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e6e8-93cd-4bbe-9ea8-0945ab93dd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:26.189052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e6e8-93cd-4bbe-9ea8-0945ab93dd2b admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.189309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e6e8-93cd-4bbe-9ea8-0945ab93dd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.189645 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e6e8-93cd-4bbe-9ea8-0945ab93dd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.190296 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254e6e8-93cd-4bbe-9ea8-0945ab93dd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:26.191993 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254e6e8-93cd-4bbe-9ea8-0945ab93dd2b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.193673 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0ac88-aaa3-47a1-9993-02ba030bb022 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:26.199325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1c1ad-3767-4d44-a157-0479f847196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:26.200223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1c1ad-3767-4d44-a157-0479f847196c admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.200587 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1c1ad-3767-4d44-a157-0479f847196c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.200947 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1c1ad-3767-4d44-a157-0479f847196c admin admin] PATH_INFO: `/v3/projects/ebd79cc9f94b4a35acbaac018574b237/users/cb68aea888d1425f852f2c8e9bad9d3a/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.202883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 962/1915] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:26.203613 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e6e8-93cd-4bbe-9ea8-0945ab93dd2b admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:26.216936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e6e8-93cd-4bbe-9ea8-0945ab93dd2b admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:26.217272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1c1ad-3767-4d44-a157-0479f847196c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd79cc9f94b4a35acbaac018574b237, user_id=cb68aea888d1425f852f2c8e9bad9d3a, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:26.219989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1c1ad-3767-4d44-a157-0479f847196c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.221975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65efa72-06f4-453e-9226-42de5692e70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:26.223265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65efa72-06f4-453e-9226-42de5692e70a admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.223265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65efa72-06f4-453e-9226-42de5692e70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.223462 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65efa72-06f4-453e-9226-42de5692e70a admin admin] PATH_INFO: `/v3/projects/9a437eb161be410c8b3c5ef3ad4baa6f/users/131d55f0a1c9462099dd90ab6a9bd75f/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.242386 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65efa72-06f4-453e-9226-42de5692e70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a437eb161be410c8b3c5ef3ad4baa6f, user_id=131d55f0a1c9462099dd90ab6a9bd75f, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:26.243483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 954/1916] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:26 2022] PUT /identity/v3/projects/ebd79cc9f94b4a35acbaac018574b237/users/cb68aea888d1425f852f2c8e9bad9d3a/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:26.244122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1c1ad-3767-4d44-a157-0479f847196c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:26.245270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65efa72-06f4-453e-9226-42de5692e70a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.260699 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 963/1917] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:26 2022] PUT /identity/v3/projects/9a437eb161be410c8b3c5ef3ad4baa6f/users/131d55f0a1c9462099dd90ab6a9bd75f/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:26.261972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65efa72-06f4-453e-9226-42de5692e70a admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:26.320394 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:26.324831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1c1ad-3767-4d44-a157-0479f847196c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:26.338653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65efa72-06f4-453e-9226-42de5692e70a admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:26.345179 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ee566-ec40-4da3-838b-3defeacc663e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:26.345923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ee566-ec40-4da3-838b-3defeacc663e admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.346183 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ee566-ec40-4da3-838b-3defeacc663e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.346329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ee566-ec40-4da3-838b-3defeacc663e admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.347149 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ee566-ec40-4da3-838b-3defeacc663e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:26.348781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ee566-ec40-4da3-838b-3defeacc663e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.361967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 964/1918] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:26.363748 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db0b55-0b5f-46fa-897b-76f9176d46f5 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.364358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db0b55-0b5f-46fa-897b-76f9176d46f5 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.364627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db0b55-0b5f-46fa-897b-76f9176d46f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.387823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d158d-045e-4d6c-808f-bb3d5cf1007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:26.388672 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d158d-045e-4d6c-808f-bb3d5cf1007d admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.388986 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d158d-045e-4d6c-808f-bb3d5cf1007d admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.389265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d158d-045e-4d6c-808f-bb3d5cf1007d admin admin] PATH_INFO: `/v3/projects/1c1f15f80fb549b1ac295e6cf3500755/users/3b07e8e844374b869baeb9fe3bf0fc99/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.396679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-29db0b55-0b5f-46fa-897b-76f9176d46f5 None None] MFA Rules not processed for user `131d55f0a1c9462099dd90ab6a9bd75f`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:26.397911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-29db0b55-0b5f-46fa-897b-76f9176d46f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:26.402071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:26.406969 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d158d-045e-4d6c-808f-bb3d5cf1007d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1f15f80fb549b1ac295e6cf3500755, user_id=3b07e8e844374b869baeb9fe3bf0fc99, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:26.410775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d158d-045e-4d6c-808f-bb3d5cf1007d admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.426999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 955/1919] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:26 2022] PUT /identity/v3/projects/1c1f15f80fb549b1ac295e6cf3500755/users/3b07e8e844374b869baeb9fe3bf0fc99/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:26.427989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d158d-045e-4d6c-808f-bb3d5cf1007d admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:26.491837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 965/1920] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:26.493176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db0b55-0b5f-46fa-897b-76f9176d46f5 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:26.507056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db0b55-0b5f-46fa-897b-76f9176d46f5 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:26.510683 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d158d-045e-4d6c-808f-bb3d5cf1007d admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:26.511850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec419a-a105-44fd-8730-7faa7e65b2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:26.512705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec419a-a105-44fd-8730-7faa7e65b2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.512986 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec419a-a105-44fd-8730-7faa7e65b2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.513256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec419a-a105-44fd-8730-7faa7e65b2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.513906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec419a-a105-44fd-8730-7faa7e65b2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:26.515458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc540-477c-4d15-a235-f6e9e746f84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:26.515636 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec419a-a105-44fd-8730-7faa7e65b2e4 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.516122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc540-477c-4d15-a235-f6e9e746f84f admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.516397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc540-477c-4d15-a235-f6e9e746f84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.516668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc540-477c-4d15-a235-f6e9e746f84f admin admin] PATH_INFO: `/v3/projects/ebd79cc9f94b4a35acbaac018574b237/users/cb68aea888d1425f852f2c8e9bad9d3a/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.518581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fc540-477c-4d15-a235-f6e9e746f84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd79cc9f94b4a35acbaac018574b237, user_id=cb68aea888d1425f852f2c8e9bad9d3a, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:26.521287 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fc540-477c-4d15-a235-f6e9e746f84f admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.525968 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 966/1921] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:26.526999 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec419a-a105-44fd-8730-7faa7e65b2e4 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:26.528622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-05ec419a-a105-44fd-8730-7faa7e65b2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:26.534767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 956/1922] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:26 2022] PUT /identity/v3/projects/ebd79cc9f94b4a35acbaac018574b237/users/cb68aea888d1425f852f2c8e9bad9d3a/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:26.544741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc540-477c-4d15-a235-f6e9e746f84f admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:26.608128 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc540-477c-4d15-a235-f6e9e746f84f admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:26.612928 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc28c69-d599-4bb2-b469-8e989ed185fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:26.613593 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc28c69-d599-4bb2-b469-8e989ed185fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.614016 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc28c69-d599-4bb2-b469-8e989ed185fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.614274 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc28c69-d599-4bb2-b469-8e989ed185fe admin admin] PATH_INFO: `/v3/projects/1c1f15f80fb549b1ac295e6cf3500755/users/3b07e8e844374b869baeb9fe3bf0fc99/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.616404 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc28c69-d599-4bb2-b469-8e989ed185fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1f15f80fb549b1ac295e6cf3500755, user_id=3b07e8e844374b869baeb9fe3bf0fc99, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:26.618383 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec419a-a105-44fd-8730-7faa7e65b2e4 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:26.619116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc28c69-d599-4bb2-b469-8e989ed185fe admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.630750 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 957/1923] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:26 2022] PUT /identity/v3/projects/1c1f15f80fb549b1ac295e6cf3500755/users/3b07e8e844374b869baeb9fe3bf0fc99/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:26.632120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e583fb8-d713-4220-99b3-b573fc9f7d84 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.632771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e583fb8-d713-4220-99b3-b573fc9f7d84 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.632771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e583fb8-d713-4220-99b3-b573fc9f7d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.664754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-7e583fb8-d713-4220-99b3-b573fc9f7d84 None None] MFA Rules not processed for user `cb68aea888d1425f852f2c8e9bad9d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:26.666143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7e583fb8-d713-4220-99b3-b573fc9f7d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:26.670536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd7437-8a4f-49de-97c3-e80c7749ac08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7f8976306ff477592c6c5b62af60f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:26.671213 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd7437-8a4f-49de-97c3-e80c7749ac08 service glance] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.671477 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd7437-8a4f-49de-97c3-e80c7749ac08 service glance] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.671757 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd7437-8a4f-49de-97c3-e80c7749ac08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.681783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:26.736754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd7437-8a4f-49de-97c3-e80c7749ac08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:26.738304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd7437-8a4f-49de-97c3-e80c7749ac08 service glance] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.745295 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 958/1924] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:26.746690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbf58d-2e8f-4570-868b-bbc7b608cc0b None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.747034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbf58d-2e8f-4570-868b-bbc7b608cc0b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.747337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbf58d-2e8f-4570-868b-bbc7b608cc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.749373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 967/1925] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:26.755791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:26.759597 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd7437-8a4f-49de-97c3-e80c7749ac08 service glance] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:26.761078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0efd7437-8a4f-49de-97c3-e80c7749ac08 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:26.780657 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-a8fbf58d-2e8f-4570-868b-bbc7b608cc0b None None] MFA Rules not processed for user `3b07e8e844374b869baeb9fe3bf0fc99`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:26.782157 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a8fbf58d-2e8f-4570-868b-bbc7b608cc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:26.848702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd7437-8a4f-49de-97c3-e80c7749ac08 service glance] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:26.876260 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 959/1926] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:26.909525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb7cfd-c15e-42b8-b5b4-cc4cf613afa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:26.910137 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb7cfd-c15e-42b8-b5b4-cc4cf613afa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:26.910409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb7cfd-c15e-42b8-b5b4-cc4cf613afa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:26.910670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb7cfd-c15e-42b8-b5b4-cc4cf613afa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:26.921109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb7cfd-c15e-42b8-b5b4-cc4cf613afa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:26.922715 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb7cfd-c15e-42b8-b5b4-cc4cf613afa9 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:26.933113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 968/1927] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:27.108677 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbf58d-2e8f-4570-868b-bbc7b608cc0b None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:27.135158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbf58d-2e8f-4570-868b-bbc7b608cc0b None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:27.142413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2aa4d8-ff5f-4e02-8ff0-cb81eb146310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:27.143350 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa4d8-ff5f-4e02-8ff0-cb81eb146310 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:27.143886 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa4d8-ff5f-4e02-8ff0-cb81eb146310 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:27.144436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa4d8-ff5f-4e02-8ff0-cb81eb146310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:27.161732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2aa4d8-ff5f-4e02-8ff0-cb81eb146310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:27.163233 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2aa4d8-ff5f-4e02-8ff0-cb81eb146310 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:27.176214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 960/1928] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:26:27.381272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb7cfd-c15e-42b8-b5b4-cc4cf613afa9 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:27.382886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-befb7cfd-c15e-42b8-b5b4-cc4cf613afa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:27.395584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb7cfd-c15e-42b8-b5b4-cc4cf613afa9 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:27.400489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5a7b5-4c3b-478d-a36d-08bde87c7df6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:27.400489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5a7b5-4c3b-478d-a36d-08bde87c7df6 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:27.400489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5a7b5-4c3b-478d-a36d-08bde87c7df6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:27.400883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5a7b5-4c3b-478d-a36d-08bde87c7df6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:27.495375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5a7b5-4c3b-478d-a36d-08bde87c7df6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:27.496841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5a7b5-4c3b-478d-a36d-08bde87c7df6 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:27.507446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 969/1929] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:27.727976 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2aa4d8-ff5f-4e02-8ff0-cb81eb146310 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:27.742542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2aa4d8-ff5f-4e02-8ff0-cb81eb146310 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:27.747561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f9d37-c6c8-485f-a724-8c7635986809 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb68aea888d1425f852f2c8e9bad9d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd79cc9f94b4a35acbaac018574b237', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:27.748165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f9d37-c6c8-485f-a724-8c7635986809 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:27.748444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f9d37-c6c8-485f-a724-8c7635986809 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:27.748717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f9d37-c6c8-485f-a724-8c7635986809 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:27.749371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f9d37-c6c8-485f-a724-8c7635986809 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:27.749676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f9d37-c6c8-485f-a724-8c7635986809 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:27.751327 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f9d37-c6c8-485f-a724-8c7635986809 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:27.764825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 961/1930] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:27.769188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5a7b5-4c3b-478d-a36d-08bde87c7df6 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:27.780251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5a7b5-4c3b-478d-a36d-08bde87c7df6 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:27.786002 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadeff9-d5e5-4331-b2bc-b2ab713095bc tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb68aea888d1425f852f2c8e9bad9d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd79cc9f94b4a35acbaac018574b237', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:27.786615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadeff9-d5e5-4331-b2bc-b2ab713095bc tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:27.786968 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadeff9-d5e5-4331-b2bc-b2ab713095bc tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:27.787212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadeff9-d5e5-4331-b2bc-b2ab713095bc tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:27.787836 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadeff9-d5e5-4331-b2bc-b2ab713095bc tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:27.789835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadeff9-d5e5-4331-b2bc-b2ab713095bc tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:27.795059 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:27.821627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 970/1931] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:27 2022] POST /identity/v3/projects => generated 352 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:27.827634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f9d37-c6c8-485f-a724-8c7635986809 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:27.838746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f9d37-c6c8-485f-a724-8c7635986809 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:27.901696 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636ff93-c116-4ad6-bdda-7b1c8a3b51a1 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb68aea888d1425f852f2c8e9bad9d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd79cc9f94b4a35acbaac018574b237', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:27.902215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636ff93-c116-4ad6-bdda-7b1c8a3b51a1 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:27.902491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636ff93-c116-4ad6-bdda-7b1c8a3b51a1 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:27.902766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636ff93-c116-4ad6-bdda-7b1c8a3b51a1 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:27.903454 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636ff93-c116-4ad6-bdda-7b1c8a3b51a1 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:27.903756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636ff93-c116-4ad6-bdda-7b1c8a3b51a1 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:27.905362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636ff93-c116-4ad6-bdda-7b1c8a3b51a1 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:27.922462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 962/1932] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:27.970441 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadeff9-d5e5-4331-b2bc-b2ab713095bc tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:27.983232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadeff9-d5e5-4331-b2bc-b2ab713095bc tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:27.988661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76506240-935d-4dbc-9f74-d4f2f8f6f811 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb68aea888d1425f852f2c8e9bad9d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd79cc9f94b4a35acbaac018574b237', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:27.989731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506240-935d-4dbc-9f74-d4f2f8f6f811 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:27.990165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506240-935d-4dbc-9f74-d4f2f8f6f811 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:27.990590 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506240-935d-4dbc-9f74-d4f2f8f6f811 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] PATH_INFO: `/v3/projects/5da36bbcac054319a577d4b9da955716` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:27.992206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76506240-935d-4dbc-9f74-d4f2f8f6f811 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5da36bbcac054319a577d4b9da955716)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:27.994314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76506240-935d-4dbc-9f74-d4f2f8f6f811 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:28.043249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-76506240-935d-4dbc-9f74-d4f2f8f6f811 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da36bbcac054319a577d4b9da955716', 'request_id': 'req-76506240-935d-4dbc-9f74-d4f2f8f6f811'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:28.051962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-76506240-935d-4dbc-9f74-d4f2f8f6f811 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da36bbcac054319a577d4b9da955716', 'request_id': 'req-76506240-935d-4dbc-9f74-d4f2f8f6f811'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:28.060121 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-76506240-935d-4dbc-9f74-d4f2f8f6f811 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da36bbcac054319a577d4b9da955716', 'request_id': 'req-76506240-935d-4dbc-9f74-d4f2f8f6f811'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:28.070645 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-76506240-935d-4dbc-9f74-d4f2f8f6f811 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] The token cache is being invalidate because project 5da36bbcac054319a577d4b9da955716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:28.070966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-76506240-935d-4dbc-9f74-d4f2f8f6f811 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:28.071604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-76506240-935d-4dbc-9f74-d4f2f8f6f811 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:28.073120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 971/1933] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:27 2022] DELETE /identity/v3/projects/5da36bbcac054319a577d4b9da955716 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:28.374746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636ff93-c116-4ad6-bdda-7b1c8a3b51a1 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:28.377136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-0636ff93-c116-4ad6-bdda-7b1c8a3b51a1 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:28.484583 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:28.492073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636ff93-c116-4ad6-bdda-7b1c8a3b51a1 tempest-VolumeQuotaClassesTest-933583557 tempest-VolumeQuotaClassesTest-933583557-project-admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:28.561487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d84d1-d437-40ac-b0b9-5b752f053068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:28.562144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d84d1-d437-40ac-b0b9-5b752f053068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:28.562419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d84d1-d437-40ac-b0b9-5b752f053068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:28.562692 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d84d1-d437-40ac-b0b9-5b752f053068 admin admin] PATH_INFO: `/v3/users/8e172181255d413ebbf8929e024e0705` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:28.563904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d84d1-d437-40ac-b0b9-5b752f053068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e172181255d413ebbf8929e024e0705)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:28.565964 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d84d1-d437-40ac-b0b9-5b752f053068 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:28.636830 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-314d84d1-d437-40ac-b0b9-5b752f053068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e172181255d413ebbf8929e024e0705'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:28.644311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-314d84d1-d437-40ac-b0b9-5b752f053068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e172181255d413ebbf8929e024e0705'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:28.645264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-314d84d1-d437-40ac-b0b9-5b752f053068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e172181255d413ebbf8929e024e0705'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:28.645994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-314d84d1-d437-40ac-b0b9-5b752f053068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e172181255d413ebbf8929e024e0705'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:28.662459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-314d84d1-d437-40ac-b0b9-5b752f053068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e172181255d413ebbf8929e024e0705'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:28.683848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 963/1934] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:28 2022] DELETE /identity/v3/users/8e172181255d413ebbf8929e024e0705 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:28.686855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce962dab-a8be-4b87-84df-18094c196a88 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:28.687178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce962dab-a8be-4b87-84df-18094c196a88 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:28.687410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce962dab-a8be-4b87-84df-18094c196a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:28.709241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-ce962dab-a8be-4b87-84df-18094c196a88 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:28.710651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ce962dab-a8be-4b87-84df-18094c196a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:28.817459 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 972/1935] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:28.828200 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d84d1-d437-40ac-b0b9-5b752f053068 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:28.829771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-314d84d1-d437-40ac-b0b9-5b752f053068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:28.899541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d84d1-d437-40ac-b0b9-5b752f053068 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:28.903325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a75f6-b993-4bfb-ba4d-a786c40b0654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:28.904052 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a75f6-b993-4bfb-ba4d-a786c40b0654 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:28.904199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a75f6-b993-4bfb-ba4d-a786c40b0654 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:28.904487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a75f6-b993-4bfb-ba4d-a786c40b0654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:28.914202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a75f6-b993-4bfb-ba4d-a786c40b0654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:28.915657 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a75f6-b993-4bfb-ba4d-a786c40b0654 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:28.928424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 964/1936] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:26:29.386298 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dfa08-22f4-4146-bade-876d867747f1 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:29.386938 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dfa08-22f4-4146-bade-876d867747f1 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:29.386938 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dfa08-22f4-4146-bade-876d867747f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:29.440035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f21dfa08-22f4-4146-bade-876d867747f1 None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:29.440035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f21dfa08-22f4-4146-bade-876d867747f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:29.441754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a75f6-b993-4bfb-ba4d-a786c40b0654 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:29.443868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-056a75f6-b993-4bfb-ba4d-a786c40b0654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:29.460201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a75f6-b993-4bfb-ba4d-a786c40b0654 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:29.466316 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:29.467508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:29.468007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:29.468470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] PATH_INFO: `/v3/projects/37b3a35d3d644d8da046a0473b25c8cc` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:29.470012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37b3a35d3d644d8da046a0473b25c8cc)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:29.473065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:29.520244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:29.569763 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37b3a35d3d644d8da046a0473b25c8cc', 'request_id': 'req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:29.588018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37b3a35d3d644d8da046a0473b25c8cc', 'request_id': 'req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:29.612456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37b3a35d3d644d8da046a0473b25c8cc', 'request_id': 'req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:29.631985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 973/1937] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:26:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:29.646513 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] The token cache is being invalidate because project 37b3a35d3d644d8da046a0473b25c8cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:29.646785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:29.651666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:29.652873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dfa08-22f4-4146-bade-876d867747f1 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:29.660228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f21dfa08-22f4-4146-bade-876d867747f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:29.676208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 965/1938] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:29 2022] DELETE /identity/v3/projects/37b3a35d3d644d8da046a0473b25c8cc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:29.678110 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:29.682858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:29.694254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:29.813863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dfa08-22f4-4146-bade-876d867747f1 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:29.869006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90a2d8-e444-4e51-a25e-1aa1c6dcd7c4 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:29.876751 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9a16d-6bdd-4806-b4ed-4da5d2f70ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:29.877985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9a16d-6bdd-4806-b4ed-4da5d2f70ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:29.878468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9a16d-6bdd-4806-b4ed-4da5d2f70ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:29.878961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9a16d-6bdd-4806-b4ed-4da5d2f70ed6 admin admin] PATH_INFO: `/v3/users/cb68aea888d1425f852f2c8e9bad9d3a` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:29.880388 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9a16d-6bdd-4806-b4ed-4da5d2f70ed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb68aea888d1425f852f2c8e9bad9d3a)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:29.883842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9a16d-6bdd-4806-b4ed-4da5d2f70ed6 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:29.960580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05902ce-c8e4-479a-8240-e5c0f9fe0886 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:29.962784 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05902ce-c8e4-479a-8240-e5c0f9fe0886 service swift] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:29.963680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05902ce-c8e4-479a-8240-e5c0f9fe0886 service swift] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:29.964010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05902ce-c8e4-479a-8240-e5c0f9fe0886 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:29.967631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c05902ce-c8e4-479a-8240-e5c0f9fe0886 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:30.016480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-56f9a16d-6bdd-4806-b4ed-4da5d2f70ed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb68aea888d1425f852f2c8e9bad9d3a'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:30.036565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-56f9a16d-6bdd-4806-b4ed-4da5d2f70ed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb68aea888d1425f852f2c8e9bad9d3a'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:30.039096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-56f9a16d-6bdd-4806-b4ed-4da5d2f70ed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb68aea888d1425f852f2c8e9bad9d3a'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:30.041380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-56f9a16d-6bdd-4806-b4ed-4da5d2f70ed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb68aea888d1425f852f2c8e9bad9d3a'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:30.082942 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05902ce-c8e4-479a-8240-e5c0f9fe0886 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:30.085889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05902ce-c8e4-479a-8240-e5c0f9fe0886 service swift] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:30.086919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-56f9a16d-6bdd-4806-b4ed-4da5d2f70ed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb68aea888d1425f852f2c8e9bad9d3a'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:30.125741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 966/1939] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:29 2022] DELETE /identity/v3/users/cb68aea888d1425f852f2c8e9bad9d3a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:30.144626 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 974/1940] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:26:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 11:26:30.766568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9a16d-6bdd-4806-b4ed-4da5d2f70ed6 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:30.769700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-56f9a16d-6bdd-4806-b4ed-4da5d2f70ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:30.850943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:30.856634 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05902ce-c8e4-479a-8240-e5c0f9fe0886 service swift] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:30.858451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c05902ce-c8e4-479a-8240-e5c0f9fe0886 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:30.883773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05902ce-c8e4-479a-8240-e5c0f9fe0886 service swift] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:30.934244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9a16d-6bdd-4806-b4ed-4da5d2f70ed6 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:30.941356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3eaba-d3cf-4c38-b37a-60a178de724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:30.942186 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3eaba-d3cf-4c38-b37a-60a178de724d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:30.942628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3eaba-d3cf-4c38-b37a-60a178de724d admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:30.943257 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3eaba-d3cf-4c38-b37a-60a178de724d admin admin] PATH_INFO: `/v3/projects/ebd79cc9f94b4a35acbaac018574b237` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:30.945657 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3eaba-d3cf-4c38-b37a-60a178de724d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd79cc9f94b4a35acbaac018574b237)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:30.949473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3eaba-d3cf-4c38-b37a-60a178de724d admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:30.976117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:30.990679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949c0f8-3706-4da8-b032-1f7015e2e681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:30.991205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949c0f8-3706-4da8-b032-1f7015e2e681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:30.991477 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949c0f8-3706-4da8-b032-1f7015e2e681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:30.991742 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949c0f8-3706-4da8-b032-1f7015e2e681 admin admin] PATH_INFO: `/v3/users/565527a1ed664191bebd4e420c26f813` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:30.997976 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949c0f8-3706-4da8-b032-1f7015e2e681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=565527a1ed664191bebd4e420c26f813)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:31.000508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949c0f8-3706-4da8-b032-1f7015e2e681 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:31.047536 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-04d3eaba-d3cf-4c38-b37a-60a178de724d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd79cc9f94b4a35acbaac018574b237', 'request_id': 'req-04d3eaba-d3cf-4c38-b37a-60a178de724d'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:31.081201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-04d3eaba-d3cf-4c38-b37a-60a178de724d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd79cc9f94b4a35acbaac018574b237', 'request_id': 'req-04d3eaba-d3cf-4c38-b37a-60a178de724d'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:31.128166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-04d3eaba-d3cf-4c38-b37a-60a178de724d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd79cc9f94b4a35acbaac018574b237', 'request_id': 'req-04d3eaba-d3cf-4c38-b37a-60a178de724d'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:31.168493 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6949c0f8-3706-4da8-b032-1f7015e2e681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565527a1ed664191bebd4e420c26f813'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:31.189925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-04d3eaba-d3cf-4c38-b37a-60a178de724d admin admin] The token cache is being invalidate because project ebd79cc9f94b4a35acbaac018574b237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:31.194937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-04d3eaba-d3cf-4c38-b37a-60a178de724d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:31.198490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-04d3eaba-d3cf-4c38-b37a-60a178de724d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:31.200870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6949c0f8-3706-4da8-b032-1f7015e2e681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565527a1ed664191bebd4e420c26f813'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:31.208107 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 967/1941] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:30 2022] DELETE /identity/v3/projects/ebd79cc9f94b4a35acbaac018574b237 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:31.217458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f329867-2353-439b-9480-c5d698ccf318 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:31.218281 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f329867-2353-439b-9480-c5d698ccf318 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:31.219043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f329867-2353-439b-9480-c5d698ccf318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:31.223434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6949c0f8-3706-4da8-b032-1f7015e2e681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565527a1ed664191bebd4e420c26f813'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:31.225352 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6949c0f8-3706-4da8-b032-1f7015e2e681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565527a1ed664191bebd4e420c26f813'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:31.226375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6949c0f8-3706-4da8-b032-1f7015e2e681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565527a1ed664191bebd4e420c26f813'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:31.252694 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 975/1942] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:30 2022] DELETE /identity/v3/users/565527a1ed664191bebd4e420c26f813 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:31.254544 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f0fd6-ddfa-4cca-abde-f0e07d972f34 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:31.255036 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f0fd6-ddfa-4cca-abde-f0e07d972f34 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:31.255476 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f0fd6-ddfa-4cca-abde-f0e07d972f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:31.284906 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-0f329867-2353-439b-9480-c5d698ccf318 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:31.291453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-802f0fd6-ddfa-4cca-abde-f0e07d972f34 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:31.293326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-802f0fd6-ddfa-4cca-abde-f0e07d972f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:31.295102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-0f329867-2353-439b-9480-c5d698ccf318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:31.470665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 968/1943] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:31.489849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276b409-4ba9-4d4b-a407-2e0aa9a2d6b1 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:31.490114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276b409-4ba9-4d4b-a407-2e0aa9a2d6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:31.490433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276b409-4ba9-4d4b-a407-2e0aa9a2d6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:31.516617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c276b409-4ba9-4d4b-a407-2e0aa9a2d6b1 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:31.518233 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c276b409-4ba9-4d4b-a407-2e0aa9a2d6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:31.524928 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 976/1944] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:31.543533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 969/1945] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:31.549174 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f0fd6-ddfa-4cca-abde-f0e07d972f34 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:31.588823 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f0fd6-ddfa-4cca-abde-f0e07d972f34 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:31.598155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276b409-4ba9-4d4b-a407-2e0aa9a2d6b1 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:31.609612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f3b24-529e-4f01-8c99-326cd89d0bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:31.613843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3b24-529e-4f01-8c99-326cd89d0bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:31.618240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3b24-529e-4f01-8c99-326cd89d0bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:31.618719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3b24-529e-4f01-8c99-326cd89d0bfc admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:31.622120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c276b409-4ba9-4d4b-a407-2e0aa9a2d6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:31.625276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f3b24-529e-4f01-8c99-326cd89d0bfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:31.630007 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f3b24-529e-4f01-8c99-326cd89d0bfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:31.643158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f3b24-529e-4f01-8c99-326cd89d0bfc admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:31.727166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276b409-4ba9-4d4b-a407-2e0aa9a2d6b1 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:31.731068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 977/1946] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:31.734505 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f3b24-529e-4f01-8c99-326cd89d0bfc admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:31.737017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf43703-8689-442a-8c53-23f5e8f15518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:31.737774 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf43703-8689-442a-8c53-23f5e8f15518 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:31.739989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf43703-8689-442a-8c53-23f5e8f15518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:31.740294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf43703-8689-442a-8c53-23f5e8f15518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:31.756898 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:31.763807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf43703-8689-442a-8c53-23f5e8f15518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:31.764837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf43703-8689-442a-8c53-23f5e8f15518 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:31.786173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f3b24-529e-4f01-8c99-326cd89d0bfc admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:31.793803 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 970/1947] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:31.809635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e9465-4d4f-415c-9abe-8ac8d4a48307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:31.810279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e9465-4d4f-415c-9abe-8ac8d4a48307 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:31.810552 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e9465-4d4f-415c-9abe-8ac8d4a48307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:31.810902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e9465-4d4f-415c-9abe-8ac8d4a48307 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:31.811533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e9465-4d4f-415c-9abe-8ac8d4a48307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:31.821012 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e9465-4d4f-415c-9abe-8ac8d4a48307 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:31.928335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 978/1948] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:31 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:31.932770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf43703-8689-442a-8c53-23f5e8f15518 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:31.956909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf43703-8689-442a-8c53-23f5e8f15518 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:32.098691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427fc63-d032-476c-a021-a1f709ce3c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:32.098691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427fc63-d032-476c-a021-a1f709ce3c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:32.098691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427fc63-d032-476c-a021-a1f709ce3c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:32.098691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427fc63-d032-476c-a021-a1f709ce3c4d admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:32.099741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427fc63-d032-476c-a021-a1f709ce3c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:32.101584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427fc63-d032-476c-a021-a1f709ce3c4d admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:32.130889 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 971/1949] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:31 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:32.135236 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e9465-4d4f-415c-9abe-8ac8d4a48307 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:32.145947 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e9465-4d4f-415c-9abe-8ac8d4a48307 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:32.151278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1af1d-1792-4015-a0c2-860ac0d56c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:32.151889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1af1d-1792-4015-a0c2-860ac0d56c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:32.152162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1af1d-1792-4015-a0c2-860ac0d56c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:32.152447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1af1d-1792-4015-a0c2-860ac0d56c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:32.153075 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1af1d-1792-4015-a0c2-860ac0d56c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:32.154710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1af1d-1792-4015-a0c2-860ac0d56c95 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:32.165482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 979/1950] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:32.169413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427fc63-d032-476c-a021-a1f709ce3c4d admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:32.180022 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427fc63-d032-476c-a021-a1f709ce3c4d admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:32.185216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e376d-c330-4fb5-9ab8-04530090d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:32.185871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e376d-c330-4fb5-9ab8-04530090d800 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:32.186144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e376d-c330-4fb5-9ab8-04530090d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:32.186408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e376d-c330-4fb5-9ab8-04530090d800 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:32.187081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e376d-c330-4fb5-9ab8-04530090d800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:32.188679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e376d-c330-4fb5-9ab8-04530090d800 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:32.206842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 972/1951] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:32.208066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1af1d-1792-4015-a0c2-860ac0d56c95 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:32.218943 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1af1d-1792-4015-a0c2-860ac0d56c95 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:32.226410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b24b85-a6d1-4e6f-b21e-94a292411750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:32.227166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b24b85-a6d1-4e6f-b21e-94a292411750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:32.227426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b24b85-a6d1-4e6f-b21e-94a292411750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:32.227834 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b24b85-a6d1-4e6f-b21e-94a292411750 admin admin] PATH_INFO: `/v3/projects/33c9e08f191f44d2af544e61e7f6a509/users/297997d912a94a349c7cede3a0bb6d64/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:32.248114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b24b85-a6d1-4e6f-b21e-94a292411750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c9e08f191f44d2af544e61e7f6a509, user_id=297997d912a94a349c7cede3a0bb6d64, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:32.250868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b24b85-a6d1-4e6f-b21e-94a292411750 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:32.267223 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 980/1952] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:32 2022] PUT /identity/v3/projects/33c9e08f191f44d2af544e61e7f6a509/users/297997d912a94a349c7cede3a0bb6d64/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:32.271980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e376d-c330-4fb5-9ab8-04530090d800 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:32.274074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-0c4e376d-c330-4fb5-9ab8-04530090d800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:32.277944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb1af4-3408-4419-99d3-4b9a5dcf1af9 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:32.278688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb1af4-3408-4419-99d3-4b9a5dcf1af9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:32.279212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb1af4-3408-4419-99d3-4b9a5dcf1af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:32.287980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e376d-c330-4fb5-9ab8-04530090d800 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:32.293069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:32.327349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-ebcb1af4-3408-4419-99d3-4b9a5dcf1af9 None None] MFA Rules not processed for user `297997d912a94a349c7cede3a0bb6d64`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:32.328554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ebcb1af4-3408-4419-99d3-4b9a5dcf1af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:32.352853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:32.353504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:32.353773 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:32.354067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] PATH_INFO: `/v3/projects/66c24a63dcf54f839754d5dc650796f2` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:32.355229 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c24a63dcf54f839754d5dc650796f2)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:32.360960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:32.407033 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 981/1953] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:32.408951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb1af4-3408-4419-99d3-4b9a5dcf1af9 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:32.420451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c24a63dcf54f839754d5dc650796f2', 'request_id': 'req-2918bdc2-ffb2-46ab-912a-3307357730b0'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:32.422299 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb1af4-3408-4419-99d3-4b9a5dcf1af9 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:32.429373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c24a63dcf54f839754d5dc650796f2', 'request_id': 'req-2918bdc2-ffb2-46ab-912a-3307357730b0'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:32.438163 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c24a63dcf54f839754d5dc650796f2', 'request_id': 'req-2918bdc2-ffb2-46ab-912a-3307357730b0'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:32.450777 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] The token cache is being invalidate because project 66c24a63dcf54f839754d5dc650796f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:32.451098 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:32.451815 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:32.453652 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 973/1954] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:32 2022] DELETE /identity/v3/projects/66c24a63dcf54f839754d5dc650796f2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:32.457824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:32.459469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:32.466388 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:32.500004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac41ba2-3f98-40cd-8452-710f362b53c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:32.500624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41ba2-3f98-40cd-8452-710f362b53c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:32.500899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41ba2-3f98-40cd-8452-710f362b53c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:32.501172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41ba2-3f98-40cd-8452-710f362b53c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:32.501807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac41ba2-3f98-40cd-8452-710f362b53c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:32.503952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac41ba2-3f98-40cd-8452-710f362b53c5 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:32.538025 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918bdc2-ffb2-46ab-912a-3307357730b0 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:32.541377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 982/1955] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:32 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:32.542797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f56f9b-2d4e-4232-a26b-da05092e0909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:32.543475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f56f9b-2d4e-4232-a26b-da05092e0909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:32.543746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f56f9b-2d4e-4232-a26b-da05092e0909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:32.544017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f56f9b-2d4e-4232-a26b-da05092e0909 admin admin] PATH_INFO: `/v3/users/3b07e8e844374b869baeb9fe3bf0fc99` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:32.545191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f56f9b-2d4e-4232-a26b-da05092e0909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b07e8e844374b869baeb9fe3bf0fc99)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:32.546007 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac41ba2-3f98-40cd-8452-710f362b53c5 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:32.547188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f56f9b-2d4e-4232-a26b-da05092e0909 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:32.547650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-8ac41ba2-3f98-40cd-8452-710f362b53c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:32.598703 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-b5f56f9b-2d4e-4232-a26b-da05092e0909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b07e8e844374b869baeb9fe3bf0fc99'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:32.607775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-b5f56f9b-2d4e-4232-a26b-da05092e0909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b07e8e844374b869baeb9fe3bf0fc99'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:32.608541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-b5f56f9b-2d4e-4232-a26b-da05092e0909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b07e8e844374b869baeb9fe3bf0fc99'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:32.609183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-b5f56f9b-2d4e-4232-a26b-da05092e0909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b07e8e844374b869baeb9fe3bf0fc99'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:32.622378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-b5f56f9b-2d4e-4232-a26b-da05092e0909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b07e8e844374b869baeb9fe3bf0fc99'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:32.625756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac41ba2-3f98-40cd-8452-710f362b53c5 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:32.630791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03ee3b-b2d5-482e-955d-65e964c5aee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:32.631503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03ee3b-b2d5-482e-955d-65e964c5aee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:32.631782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03ee3b-b2d5-482e-955d-65e964c5aee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:32.632053 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03ee3b-b2d5-482e-955d-65e964c5aee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:32.632684 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03ee3b-b2d5-482e-955d-65e964c5aee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:32.634621 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03ee3b-b2d5-482e-955d-65e964c5aee8 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:32.634960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 974/1956] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:32 2022] DELETE /identity/v3/users/3b07e8e844374b869baeb9fe3bf0fc99 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:32.665066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 983/1957] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:32 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:32.669226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f56f9b-2d4e-4232-a26b-da05092e0909 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:32.670754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b5f56f9b-2d4e-4232-a26b-da05092e0909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:32.760208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f56f9b-2d4e-4232-a26b-da05092e0909 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:32.767154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42628af7-95bc-4334-99f5-94ea3eeeee10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:32.767776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42628af7-95bc-4334-99f5-94ea3eeeee10 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:32.768049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42628af7-95bc-4334-99f5-94ea3eeeee10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:32.768335 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42628af7-95bc-4334-99f5-94ea3eeeee10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:32.769267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42628af7-95bc-4334-99f5-94ea3eeeee10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:32.770762 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42628af7-95bc-4334-99f5-94ea3eeeee10 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:32.782375 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 975/1958] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:26:32.786888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03ee3b-b2d5-482e-955d-65e964c5aee8 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:32.798097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03ee3b-b2d5-482e-955d-65e964c5aee8 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:32.804578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d418550-6079-4fe8-8358-b98219a8ba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:32.805364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418550-6079-4fe8-8358-b98219a8ba26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:32.805721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418550-6079-4fe8-8358-b98219a8ba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:32.806044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418550-6079-4fe8-8358-b98219a8ba26 admin admin] PATH_INFO: `/v3/projects/8e835e44cc3e41cca4d9cbc58da0b6f7/users/97a7138936a24c0ea7fbfe020d33a0b5/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:32.817002 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:32.832690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d418550-6079-4fe8-8358-b98219a8ba26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e835e44cc3e41cca4d9cbc58da0b6f7, user_id=97a7138936a24c0ea7fbfe020d33a0b5, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:32.833632 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d418550-6079-4fe8-8358-b98219a8ba26 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:32.859160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 984/1959] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:32 2022] PUT /identity/v3/projects/8e835e44cc3e41cca4d9cbc58da0b6f7/users/97a7138936a24c0ea7fbfe020d33a0b5/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:32.861231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42628af7-95bc-4334-99f5-94ea3eeeee10 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:32.883528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42628af7-95bc-4334-99f5-94ea3eeeee10 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:32.919611 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:33.008408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b8564-f157-42b6-8f49-de4b8a2a5d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:33.009223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b8564-f157-42b6-8f49-de4b8a2a5d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:33.009503 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b8564-f157-42b6-8f49-de4b8a2a5d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:33.009820 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b8564-f157-42b6-8f49-de4b8a2a5d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:33.010513 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b8564-f157-42b6-8f49-de4b8a2a5d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:33.013214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b8564-f157-42b6-8f49-de4b8a2a5d49 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:33.024282 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 976/1960] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:33.028647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d418550-6079-4fe8-8358-b98219a8ba26 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:33.039632 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d418550-6079-4fe8-8358-b98219a8ba26 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:33.044824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de7b75-9c56-4e81-9b10-9eae2fb2178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:33.045583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de7b75-9c56-4e81-9b10-9eae2fb2178c admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:33.045855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de7b75-9c56-4e81-9b10-9eae2fb2178c admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:33.046116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de7b75-9c56-4e81-9b10-9eae2fb2178c admin admin] PATH_INFO: `/v3/projects/8e835e44cc3e41cca4d9cbc58da0b6f7/users/97a7138936a24c0ea7fbfe020d33a0b5/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:33.048022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de7b75-9c56-4e81-9b10-9eae2fb2178c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e835e44cc3e41cca4d9cbc58da0b6f7, user_id=97a7138936a24c0ea7fbfe020d33a0b5, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:33.050987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de7b75-9c56-4e81-9b10-9eae2fb2178c admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:33.069623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 985/1961] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:33 2022] PUT /identity/v3/projects/8e835e44cc3e41cca4d9cbc58da0b6f7/users/97a7138936a24c0ea7fbfe020d33a0b5/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:33.073444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82a5b0-83ef-44db-8718-ff6b3235878d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:33.073932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82a5b0-83ef-44db-8718-ff6b3235878d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:33.074205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82a5b0-83ef-44db-8718-ff6b3235878d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:33.105036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-8e82a5b0-83ef-44db-8718-ff6b3235878d None None] MFA Rules not processed for user `97a7138936a24c0ea7fbfe020d33a0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:33.106863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-8e82a5b0-83ef-44db-8718-ff6b3235878d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:33.205311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 977/1962] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:33.229947 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de7b75-9c56-4e81-9b10-9eae2fb2178c admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:33.231774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b9de7b75-9c56-4e81-9b10-9eae2fb2178c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:33.241429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82a5b0-83ef-44db-8718-ff6b3235878d None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:33.248305 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-8e82a5b0-83ef-44db-8718-ff6b3235878d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:33.325257 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82a5b0-83ef-44db-8718-ff6b3235878d None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:33.330063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2709c69-8aa7-4eba-9209-d80bb0a8b5fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:33.330537 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de7b75-9c56-4e81-9b10-9eae2fb2178c admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:33.330876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2709c69-8aa7-4eba-9209-d80bb0a8b5fc service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:33.331236 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2709c69-8aa7-4eba-9209-d80bb0a8b5fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:33.331687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2709c69-8aa7-4eba-9209-d80bb0a8b5fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:33.336071 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:33.336801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:33.337146 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:33.337525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] PATH_INFO: `/v3/projects/1c1f15f80fb549b1ac295e6cf3500755` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:33.338871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1f15f80fb549b1ac295e6cf3500755)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:33.341026 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:33.342551 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2709c69-8aa7-4eba-9209-d80bb0a8b5fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:33.344601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2709c69-8aa7-4eba-9209-d80bb0a8b5fc service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:33.359971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 978/1963] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:33.406854 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1f15f80fb549b1ac295e6cf3500755', 'request_id': 'req-d9309e46-806d-40c4-bd42-afdbf9802d71'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:33.423518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1f15f80fb549b1ac295e6cf3500755', 'request_id': 'req-d9309e46-806d-40c4-bd42-afdbf9802d71'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:33.432591 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1f15f80fb549b1ac295e6cf3500755', 'request_id': 'req-d9309e46-806d-40c4-bd42-afdbf9802d71'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:33.444437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] The token cache is being invalidate because project 1c1f15f80fb549b1ac295e6cf3500755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:33.444922 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:33.445748 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:33.447224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 986/1964] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:33 2022] DELETE /identity/v3/projects/1c1f15f80fb549b1ac295e6cf3500755 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:33.452178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511d4c2-a8b5-4f9e-b4ec-d47ab6cf92a1 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:33.452465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511d4c2-a8b5-4f9e-b4ec-d47ab6cf92a1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:33.452741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511d4c2-a8b5-4f9e-b4ec-d47ab6cf92a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:33.470092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:33.481606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:33.486232 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c511d4c2-a8b5-4f9e-b4ec-d47ab6cf92a1 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:33.487438 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c511d4c2-a8b5-4f9e-b4ec-d47ab6cf92a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:33.537761 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:33.558007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 979/1965] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:33.558302 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9309e46-806d-40c4-bd42-afdbf9802d71 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:33.565016 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f9eeb-32d0-4461-9a3c-03d93cbc7abd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:33.565740 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f9eeb-32d0-4461-9a3c-03d93cbc7abd service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:33.566015 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f9eeb-32d0-4461-9a3c-03d93cbc7abd service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:33.566280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f9eeb-32d0-4461-9a3c-03d93cbc7abd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:33.567127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea960e15-92c8-4892-986f-d64bff6abc62 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:33.567413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea960e15-92c8-4892-986f-d64bff6abc62 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:33.567685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea960e15-92c8-4892-986f-d64bff6abc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:33.568028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-4c8f9eeb-32d0-4461-9a3c-03d93cbc7abd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:33.586945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:33.587426 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ea960e15-92c8-4892-986f-d64bff6abc62 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:33.588649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ea960e15-92c8-4892-986f-d64bff6abc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:33.597425 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 980/1966] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:33.602575 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea960e15-92c8-4892-986f-d64bff6abc62 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:33.612849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea960e15-92c8-4892-986f-d64bff6abc62 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:33.617855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cf8ee-ecad-4bfd-9eaa-04b832da1413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:33.618475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cf8ee-ecad-4bfd-9eaa-04b832da1413 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:33.618859 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cf8ee-ecad-4bfd-9eaa-04b832da1413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:33.619220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cf8ee-ecad-4bfd-9eaa-04b832da1413 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:33.619724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cf8ee-ecad-4bfd-9eaa-04b832da1413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:33.620196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cf8ee-ecad-4bfd-9eaa-04b832da1413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:33.621628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cf8ee-ecad-4bfd-9eaa-04b832da1413 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:33.634421 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 981/1967] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:33.638853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cf8ee-ecad-4bfd-9eaa-04b832da1413 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:33.643707 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f9eeb-32d0-4461-9a3c-03d93cbc7abd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:33.645536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f9eeb-32d0-4461-9a3c-03d93cbc7abd service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:33.651286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cf8ee-ecad-4bfd-9eaa-04b832da1413 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:33.660123 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703479ab-c3c1-4381-b701-e1aa0adca2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:33.661064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703479ab-c3c1-4381-b701-e1aa0adca2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:33.661464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 987/1968] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:26:33.663142 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703479ab-c3c1-4381-b701-e1aa0adca2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:33.663603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703479ab-c3c1-4381-b701-e1aa0adca2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:33.664269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703479ab-c3c1-4381-b701-e1aa0adca2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:33.666263 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703479ab-c3c1-4381-b701-e1aa0adca2e4 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:33.714382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 982/1969] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:33 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:33.726580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f9eeb-32d0-4461-9a3c-03d93cbc7abd service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:33.739884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f9eeb-32d0-4461-9a3c-03d93cbc7abd service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:33.801054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dac00-d715-4e96-9991-e54f9ca0a90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:33.801710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dac00-d715-4e96-9991-e54f9ca0a90b admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:33.801979 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dac00-d715-4e96-9991-e54f9ca0a90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:33.802246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dac00-d715-4e96-9991-e54f9ca0a90b admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:33.802950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649dac00-d715-4e96-9991-e54f9ca0a90b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:33.804908 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649dac00-d715-4e96-9991-e54f9ca0a90b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:33.830531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 988/1970] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:33 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:33.835467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703479ab-c3c1-4381-b701-e1aa0adca2e4 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:33.847939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703479ab-c3c1-4381-b701-e1aa0adca2e4 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:33.854459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbeee2d-f9cf-4644-a03e-753968b9fc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:33.855102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeee2d-f9cf-4644-a03e-753968b9fc9d admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:33.855392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeee2d-f9cf-4644-a03e-753968b9fc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:33.855733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeee2d-f9cf-4644-a03e-753968b9fc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:33.856423 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbeee2d-f9cf-4644-a03e-753968b9fc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:33.858103 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbeee2d-f9cf-4644-a03e-753968b9fc9d admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:33.877411 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 983/1971] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:33.882240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dac00-d715-4e96-9991-e54f9ca0a90b admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:33.899436 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dac00-d715-4e96-9991-e54f9ca0a90b admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:33.906589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb1aaa-5c2a-4453-8279-31517afe5bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:33.907737 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1aaa-5c2a-4453-8279-31517afe5bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:33.907915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1aaa-5c2a-4453-8279-31517afe5bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:33.908226 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1aaa-5c2a-4453-8279-31517afe5bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:33.909155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb1aaa-5c2a-4453-8279-31517afe5bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:33.911243 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb1aaa-5c2a-4453-8279-31517afe5bb8 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:33.927174 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 989/1972] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:33.934157 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbeee2d-f9cf-4644-a03e-753968b9fc9d admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:33.945091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbeee2d-f9cf-4644-a03e-753968b9fc9d admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:33.950319 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c662c-d8ff-4547-8a5e-7e9562f89491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:33.951342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c662c-d8ff-4547-8a5e-7e9562f89491 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:33.951698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c662c-d8ff-4547-8a5e-7e9562f89491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:33.952097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c662c-d8ff-4547-8a5e-7e9562f89491 admin admin] PATH_INFO: `/v3/projects/63b2a638da1148cd85397077090cf8ef/users/a746bc2ea0184588bc0c161ca4043732/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:33.970973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c662c-d8ff-4547-8a5e-7e9562f89491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b2a638da1148cd85397077090cf8ef, user_id=a746bc2ea0184588bc0c161ca4043732, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:33.973799 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c662c-d8ff-4547-8a5e-7e9562f89491 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:33.989519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 984/1973] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:33 2022] PUT /identity/v3/projects/63b2a638da1148cd85397077090cf8ef/users/a746bc2ea0184588bc0c161ca4043732/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:34.001135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7925be-6252-41be-8d13-2d804e4a21c5 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:34.001687 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7925be-6252-41be-8d13-2d804e4a21c5 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:34.002298 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7925be-6252-41be-8d13-2d804e4a21c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:34.054732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-1d7925be-6252-41be-8d13-2d804e4a21c5 None None] MFA Rules not processed for user `a746bc2ea0184588bc0c161ca4043732`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:34.056349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1d7925be-6252-41be-8d13-2d804e4a21c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:34.191293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 990/1974] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:34.195972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c662c-d8ff-4547-8a5e-7e9562f89491 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:34.279249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c662c-d8ff-4547-8a5e-7e9562f89491 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:34.286876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a97f2-61b7-41b1-9950-208ed8e7e4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:34.288270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a97f2-61b7-41b1-9950-208ed8e7e4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:34.289149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a97f2-61b7-41b1-9950-208ed8e7e4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:34.290011 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a97f2-61b7-41b1-9950-208ed8e7e4d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:34.291635 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a97f2-61b7-41b1-9950-208ed8e7e4d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:34.296136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a97f2-61b7-41b1-9950-208ed8e7e4d7 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:34.343077 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 985/1975] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:34 2022] POST /identity/v3/projects => generated 393 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:34.348731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7925be-6252-41be-8d13-2d804e4a21c5 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:34.362266 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7925be-6252-41be-8d13-2d804e4a21c5 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:34.402195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:34.447245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abfcd3-7875-4800-8191-2c29be4c42a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:34.448262 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abfcd3-7875-4800-8191-2c29be4c42a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:34.448497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abfcd3-7875-4800-8191-2c29be4c42a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:34.448598 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abfcd3-7875-4800-8191-2c29be4c42a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:34.449209 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abfcd3-7875-4800-8191-2c29be4c42a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:34.451532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abfcd3-7875-4800-8191-2c29be4c42a3 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:34.475716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 991/1976] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:34 2022] POST /identity/v3/users => generated 303 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:34.487369 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a97f2-61b7-41b1-9950-208ed8e7e4d7 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:34.507148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a97f2-61b7-41b1-9950-208ed8e7e4d7 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:34.514200 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54674ba6-a527-43f9-a389-e1789f666b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:34.514866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54674ba6-a527-43f9-a389-e1789f666b88 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:34.515141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54674ba6-a527-43f9-a389-e1789f666b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:34.515412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54674ba6-a527-43f9-a389-e1789f666b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:34.516072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54674ba6-a527-43f9-a389-e1789f666b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:34.518030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54674ba6-a527-43f9-a389-e1789f666b88 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:34.534864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 986/1977] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:34.538159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abfcd3-7875-4800-8191-2c29be4c42a3 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:34.549562 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abfcd3-7875-4800-8191-2c29be4c42a3 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:34.555339 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95391463-ea4d-4fe3-8020-0f59d5f37a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:34.556064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95391463-ea4d-4fe3-8020-0f59d5f37a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:34.556334 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95391463-ea4d-4fe3-8020-0f59d5f37a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:34.556764 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95391463-ea4d-4fe3-8020-0f59d5f37a9b admin admin] PATH_INFO: `/v3/projects/6320b8ae91104493a8b494732c1f03e1/users/fd01833cf0d540fb8592d186505c9d3c/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:34.582475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95391463-ea4d-4fe3-8020-0f59d5f37a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6320b8ae91104493a8b494732c1f03e1, user_id=fd01833cf0d540fb8592d186505c9d3c, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:34.585219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95391463-ea4d-4fe3-8020-0f59d5f37a9b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:34.602176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 992/1978] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:34 2022] PUT /identity/v3/projects/6320b8ae91104493a8b494732c1f03e1/users/fd01833cf0d540fb8592d186505c9d3c/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:34.606515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54674ba6-a527-43f9-a389-e1789f666b88 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:34.624206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54674ba6-a527-43f9-a389-e1789f666b88 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:34.677565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:34.699376 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da8831-0cc3-41ea-850a-1ef0467e9882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:34.700127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da8831-0cc3-41ea-850a-1ef0467e9882 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:34.700477 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da8831-0cc3-41ea-850a-1ef0467e9882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:34.700937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da8831-0cc3-41ea-850a-1ef0467e9882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:34.701486 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da8831-0cc3-41ea-850a-1ef0467e9882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:34.703327 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da8831-0cc3-41ea-850a-1ef0467e9882 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:34.714757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 987/1979] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:34.719752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95391463-ea4d-4fe3-8020-0f59d5f37a9b admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:34.732822 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95391463-ea4d-4fe3-8020-0f59d5f37a9b admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:34.741393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee567b1-87e7-4835-8dc4-1c227a227fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:34.742498 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee567b1-87e7-4835-8dc4-1c227a227fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:34.743014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee567b1-87e7-4835-8dc4-1c227a227fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:34.743472 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee567b1-87e7-4835-8dc4-1c227a227fcf admin admin] PATH_INFO: `/v3/projects/6320b8ae91104493a8b494732c1f03e1/users/fd01833cf0d540fb8592d186505c9d3c/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:34.746133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee567b1-87e7-4835-8dc4-1c227a227fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6320b8ae91104493a8b494732c1f03e1, user_id=fd01833cf0d540fb8592d186505c9d3c, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:34.749345 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee567b1-87e7-4835-8dc4-1c227a227fcf admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:34.763228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 993/1980] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:34 2022] PUT /identity/v3/projects/6320b8ae91104493a8b494732c1f03e1/users/fd01833cf0d540fb8592d186505c9d3c/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:34.777307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c231fb-b20b-4ddf-92c5-07496a02d7b4 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:34.777819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c231fb-b20b-4ddf-92c5-07496a02d7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:34.778247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c231fb-b20b-4ddf-92c5-07496a02d7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:34.823037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-09c231fb-b20b-4ddf-92c5-07496a02d7b4 None None] MFA Rules not processed for user `fd01833cf0d540fb8592d186505c9d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:34.824334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-09c231fb-b20b-4ddf-92c5-07496a02d7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:34.909301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 988/1981] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:34.921877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee567b1-87e7-4835-8dc4-1c227a227fcf admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:34.925583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-aee567b1-87e7-4835-8dc4-1c227a227fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:35.021286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee567b1-87e7-4835-8dc4-1c227a227fcf admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:35.025598 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801d6c2-8bae-498a-a349-483bf63911b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:35.026222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801d6c2-8bae-498a-a349-483bf63911b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:35.026488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801d6c2-8bae-498a-a349-483bf63911b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:35.026755 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801d6c2-8bae-498a-a349-483bf63911b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:35.038344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801d6c2-8bae-498a-a349-483bf63911b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:35.040367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801d6c2-8bae-498a-a349-483bf63911b0 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:35.051995 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 994/1982] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:35.107711 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c231fb-b20b-4ddf-92c5-07496a02d7b4 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:35.123397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c231fb-b20b-4ddf-92c5-07496a02d7b4 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:35.128475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ba5a3-17fe-4fb7-ad4e-ff4366062456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:35.129880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ba5a3-17fe-4fb7-ad4e-ff4366062456 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:35.130346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ba5a3-17fe-4fb7-ad4e-ff4366062456 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:35.130798 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ba5a3-17fe-4fb7-ad4e-ff4366062456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:35.221152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ba5a3-17fe-4fb7-ad4e-ff4366062456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:35.222630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ba5a3-17fe-4fb7-ad4e-ff4366062456 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:35.234671 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 989/1983] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:41.904556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801d6c2-8bae-498a-a349-483bf63911b0 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:41.906010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5801d6c2-8bae-498a-a349-483bf63911b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:42.022391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801d6c2-8bae-498a-a349-483bf63911b0 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:42.034935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8eb9c-98a0-4182-b51a-723ed3920ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:42.036019 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8eb9c-98a0-4182-b51a-723ed3920ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:42.036721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8eb9c-98a0-4182-b51a-723ed3920ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:42.037413 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8eb9c-98a0-4182-b51a-723ed3920ddb admin admin] PATH_INFO: `/v3/users/297997d912a94a349c7cede3a0bb6d64` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:42.039828 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8eb9c-98a0-4182-b51a-723ed3920ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=297997d912a94a349c7cede3a0bb6d64)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:42.043235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8eb9c-98a0-4182-b51a-723ed3920ddb admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:42.088848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:42.144296 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-56d8eb9c-98a0-4182-b51a-723ed3920ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297997d912a94a349c7cede3a0bb6d64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:42.159837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-56d8eb9c-98a0-4182-b51a-723ed3920ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297997d912a94a349c7cede3a0bb6d64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:42.174863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-56d8eb9c-98a0-4182-b51a-723ed3920ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297997d912a94a349c7cede3a0bb6d64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:42.176956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-56d8eb9c-98a0-4182-b51a-723ed3920ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297997d912a94a349c7cede3a0bb6d64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:42.176956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-56d8eb9c-98a0-4182-b51a-723ed3920ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297997d912a94a349c7cede3a0bb6d64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:42.190868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 995/1984] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:41 2022] DELETE /identity/v3/users/297997d912a94a349c7cede3a0bb6d64 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:42.201000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75296eec-a7e4-4fcd-954b-091e6e788ce4 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:42.201922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75296eec-a7e4-4fcd-954b-091e6e788ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:42.201922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75296eec-a7e4-4fcd-954b-091e6e788ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:42.224365 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-75296eec-a7e4-4fcd-954b-091e6e788ce4 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:42.225283 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-75296eec-a7e4-4fcd-954b-091e6e788ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:42.315617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 990/1985] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:42.335363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8eb9c-98a0-4182-b51a-723ed3920ddb admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:42.338495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-56d8eb9c-98a0-4182-b51a-723ed3920ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:42.435387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8eb9c-98a0-4182-b51a-723ed3920ddb admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:42.444661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1aa2f7-ddbc-45d0-b674-84f7526161c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:42.445646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aa2f7-ddbc-45d0-b674-84f7526161c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:42.446083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aa2f7-ddbc-45d0-b674-84f7526161c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:42.446521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aa2f7-ddbc-45d0-b674-84f7526161c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:42.466684 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1aa2f7-ddbc-45d0-b674-84f7526161c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:42.469112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1aa2f7-ddbc-45d0-b674-84f7526161c4 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:42.499568 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 996/1986] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:26:42.955255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75296eec-a7e4-4fcd-954b-091e6e788ce4 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:42.958353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-75296eec-a7e4-4fcd-954b-091e6e788ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:42.974208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:42.981853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75296eec-a7e4-4fcd-954b-091e6e788ce4 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:42.989938 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:42.990605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:42.990909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:42.991350 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] PATH_INFO: `/v3/projects/33c9e08f191f44d2af544e61e7f6a509` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:42.992613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] RBAC: Authorizing `identity:delete_project(project_id=33c9e08f191f44d2af544e61e7f6a509)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:42.996054 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:43.082621 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c9e08f191f44d2af544e61e7f6a509', 'request_id': 'req-d9275e60-e47c-480f-b04c-4ce50f25134b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.093867 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c9e08f191f44d2af544e61e7f6a509', 'request_id': 'req-d9275e60-e47c-480f-b04c-4ce50f25134b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.105568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c9e08f191f44d2af544e61e7f6a509', 'request_id': 'req-d9275e60-e47c-480f-b04c-4ce50f25134b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.120047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] The token cache is being invalidate because project 33c9e08f191f44d2af544e61e7f6a509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:43.120408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.121656 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.124274 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 991/1987] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:42 2022] DELETE /identity/v3/projects/33c9e08f191f44d2af544e61e7f6a509 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:43.128348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1aa2f7-ddbc-45d0-b674-84f7526161c4 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:43.146153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1aa2f7-ddbc-45d0-b674-84f7526161c4 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:43.220347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb6b55-16a9-4103-90a0-6b9ce62c7a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:43.221004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb6b55-16a9-4103-90a0-6b9ce62c7a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:43.221284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb6b55-16a9-4103-90a0-6b9ce62c7a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:43.221709 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb6b55-16a9-4103-90a0-6b9ce62c7a17 admin admin] PATH_INFO: `/v3/users/97a7138936a24c0ea7fbfe020d33a0b5` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:43.222967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb6b55-16a9-4103-90a0-6b9ce62c7a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a7138936a24c0ea7fbfe020d33a0b5)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:43.225352 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb6b55-16a9-4103-90a0-6b9ce62c7a17 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:43.285244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:43.288344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c1cb6b55-16a9-4103-90a0-6b9ce62c7a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a7138936a24c0ea7fbfe020d33a0b5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.305726 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c1cb6b55-16a9-4103-90a0-6b9ce62c7a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a7138936a24c0ea7fbfe020d33a0b5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.314048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c1cb6b55-16a9-4103-90a0-6b9ce62c7a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a7138936a24c0ea7fbfe020d33a0b5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.315073 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c1cb6b55-16a9-4103-90a0-6b9ce62c7a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a7138936a24c0ea7fbfe020d33a0b5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.315912 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c1cb6b55-16a9-4103-90a0-6b9ce62c7a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a7138936a24c0ea7fbfe020d33a0b5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.334503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 997/1988] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:43 2022] DELETE /identity/v3/users/97a7138936a24c0ea7fbfe020d33a0b5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:43.388133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:43.390749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:43.418452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9275e60-e47c-480f-b04c-4ce50f25134b admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:43.499308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8e564-1c03-4f7a-ba66-2d89d16398e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:43.500112 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8e564-1c03-4f7a-ba66-2d89d16398e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:43.500500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8e564-1c03-4f7a-ba66-2d89d16398e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:43.500884 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8e564-1c03-4f7a-ba66-2d89d16398e1 admin admin] PATH_INFO: `/v3/users/a746bc2ea0184588bc0c161ca4043732` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:43.503005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8e564-1c03-4f7a-ba66-2d89d16398e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a746bc2ea0184588bc0c161ca4043732)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:43.505437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8e564-1c03-4f7a-ba66-2d89d16398e1 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:43.570030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fcd8e564-1c03-4f7a-ba66-2d89d16398e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a746bc2ea0184588bc0c161ca4043732'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.582719 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fcd8e564-1c03-4f7a-ba66-2d89d16398e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a746bc2ea0184588bc0c161ca4043732'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.583659 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fcd8e564-1c03-4f7a-ba66-2d89d16398e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a746bc2ea0184588bc0c161ca4043732'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.584738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fcd8e564-1c03-4f7a-ba66-2d89d16398e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a746bc2ea0184588bc0c161ca4043732'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.604524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fcd8e564-1c03-4f7a-ba66-2d89d16398e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a746bc2ea0184588bc0c161ca4043732'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:43.638133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 992/1989] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:43 2022] DELETE /identity/v3/users/a746bc2ea0184588bc0c161ca4043732 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:43.640695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8445c49-60fc-41c6-99c2-2472bc12f399 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:43.641264 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8445c49-60fc-41c6-99c2-2472bc12f399 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:43.642035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8445c49-60fc-41c6-99c2-2472bc12f399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:43.673949 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-e8445c49-60fc-41c6-99c2-2472bc12f399 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:43.675048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e8445c49-60fc-41c6-99c2-2472bc12f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:43.707041 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8e564-1c03-4f7a-ba66-2d89d16398e1 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:43.709627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-fcd8e564-1c03-4f7a-ba66-2d89d16398e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:43.721402 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:43.768511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 998/1990] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:43.781206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8445c49-60fc-41c6-99c2-2472bc12f399 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:43.784100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e8445c49-60fc-41c6-99c2-2472bc12f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:43.856354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8e564-1c03-4f7a-ba66-2d89d16398e1 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:43.862101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8445c49-60fc-41c6-99c2-2472bc12f399 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:43.864908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:43.866297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55c21a-9c53-4231-ab85-8b9a2845b9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:43.866393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:43.866796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:43.867201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55c21a-9c53-4231-ab85-8b9a2845b9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:43.867303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] PATH_INFO: `/v3/projects/8e835e44cc3e41cca4d9cbc58da0b6f7` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:43.867577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55c21a-9c53-4231-ab85-8b9a2845b9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:43.867874 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55c21a-9c53-4231-ab85-8b9a2845b9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:43.869180 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e835e44cc3e41cca4d9cbc58da0b6f7)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:43.874012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:43.879023 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55c21a-9c53-4231-ab85-8b9a2845b9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:43.893218 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55c21a-9c53-4231-ab85-8b9a2845b9e0 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:43.915936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 999/1991] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:43.986896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e835e44cc3e41cca4d9cbc58da0b6f7', 'request_id': 'req-041218ba-8095-4c6c-a48d-68dde9e87c9f'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.014902 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e835e44cc3e41cca4d9cbc58da0b6f7', 'request_id': 'req-041218ba-8095-4c6c-a48d-68dde9e87c9f'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.026546 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e835e44cc3e41cca4d9cbc58da0b6f7', 'request_id': 'req-041218ba-8095-4c6c-a48d-68dde9e87c9f'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.057069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] The token cache is being invalidate because project 8e835e44cc3e41cca4d9cbc58da0b6f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:44.058007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.059317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.064066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 993/1992] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:43 2022] DELETE /identity/v3/projects/8e835e44cc3e41cca4d9cbc58da0b6f7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:44.070850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee05a2-5405-467d-8709-544ba529d51a None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:44.071644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee05a2-5405-467d-8709-544ba529d51a None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:44.072016 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee05a2-5405-467d-8709-544ba529d51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:44.110357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:44.115262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:44.133742 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f9ee05a2-5405-467d-8709-544ba529d51a None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:44.137127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f9ee05a2-5405-467d-8709-544ba529d51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:44.269872 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1000/1993] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:44.281720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae37c0-f84b-4286-9c25-1f5b800fc97d None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:44.282915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae37c0-f84b-4286-9c25-1f5b800fc97d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:44.283634 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae37c0-f84b-4286-9c25-1f5b800fc97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:44.322765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:44.330655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041218ba-8095-4c6c-a48d-68dde9e87c9f admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:44.340013 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f8ae37c0-f84b-4286-9c25-1f5b800fc97d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:44.343276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd8e3e-1597-4479-9bb0-4b5343b732d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:44.343691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd8e3e-1597-4479-9bb0-4b5343b732d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:44.344378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd8e3e-1597-4479-9bb0-4b5343b732d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:44.344378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd8e3e-1597-4479-9bb0-4b5343b732d9 admin admin] PATH_INFO: `/v3/users/4033d20d359a47b79aa727fd660139e1` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:44.344629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f8ae37c0-f84b-4286-9c25-1f5b800fc97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:44.350194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd8e3e-1597-4479-9bb0-4b5343b732d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4033d20d359a47b79aa727fd660139e1)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:44.355687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd8e3e-1597-4479-9bb0-4b5343b732d9 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:44.364393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1001/1994] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:44.370930 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae37c0-f84b-4286-9c25-1f5b800fc97d None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:44.395961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae37c0-f84b-4286-9c25-1f5b800fc97d None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:44.408202 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04500c84-bcf4-417b-8044-89142237f814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:44.409069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04500c84-bcf4-417b-8044-89142237f814 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:44.410567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04500c84-bcf4-417b-8044-89142237f814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:44.410987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04500c84-bcf4-417b-8044-89142237f814 admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:44.412650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04500c84-bcf4-417b-8044-89142237f814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:44.413576 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04500c84-bcf4-417b-8044-89142237f814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:44.418287 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04500c84-bcf4-417b-8044-89142237f814 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:44.434977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:44.449971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1002/1995] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:44.452727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04500c84-bcf4-417b-8044-89142237f814 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:44.459221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c2fd8e3e-1597-4479-9bb0-4b5343b732d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4033d20d359a47b79aa727fd660139e1'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.470077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04500c84-bcf4-417b-8044-89142237f814 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:44.474717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c2fd8e3e-1597-4479-9bb0-4b5343b732d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4033d20d359a47b79aa727fd660139e1'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.475923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c2fd8e3e-1597-4479-9bb0-4b5343b732d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4033d20d359a47b79aa727fd660139e1'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.477563 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c2fd8e3e-1597-4479-9bb0-4b5343b732d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4033d20d359a47b79aa727fd660139e1'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.496902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83088990-a62f-4a26-8c8f-c996ec799e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:44.497596 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83088990-a62f-4a26-8c8f-c996ec799e6e admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:44.497871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83088990-a62f-4a26-8c8f-c996ec799e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:44.498188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83088990-a62f-4a26-8c8f-c996ec799e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:44.498770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83088990-a62f-4a26-8c8f-c996ec799e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:44.500400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c2fd8e3e-1597-4479-9bb0-4b5343b732d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4033d20d359a47b79aa727fd660139e1'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.501198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83088990-a62f-4a26-8c8f-c996ec799e6e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:44.520546 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 994/1996] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:44 2022] DELETE /identity/v3/users/4033d20d359a47b79aa727fd660139e1 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:44.522515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f36a3-e96e-4aa8-a520-8df3294943a0 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:44.522804 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f36a3-e96e-4aa8-a520-8df3294943a0 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:44.523299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f36a3-e96e-4aa8-a520-8df3294943a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:44.550863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-d07f36a3-e96e-4aa8-a520-8df3294943a0 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:44.552334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d07f36a3-e96e-4aa8-a520-8df3294943a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:44.571489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1003/1997] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:44 2022] POST /identity/v3/projects => generated 407 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:44.571489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83088990-a62f-4a26-8c8f-c996ec799e6e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:44.573383 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-83088990-a62f-4a26-8c8f-c996ec799e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:44.645217 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 995/1998] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:44.646099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f36a3-e96e-4aa8-a520-8df3294943a0 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:44.650118 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d07f36a3-e96e-4aa8-a520-8df3294943a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:44.665205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83088990-a62f-4a26-8c8f-c996ec799e6e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:44.667737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f36a3-e96e-4aa8-a520-8df3294943a0 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:44.671227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:44.671942 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:44.672365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:44.672771 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] PATH_INFO: `/v3/projects/63b2a638da1148cd85397077090cf8ef` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:44.674116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b2a638da1148cd85397077090cf8ef)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:44.675601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acfd86-cb7e-4fdb-97a0-f840c085c4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:44.676256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:44.676592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acfd86-cb7e-4fdb-97a0-f840c085c4ba admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:44.676942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acfd86-cb7e-4fdb-97a0-f840c085c4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:44.678578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acfd86-cb7e-4fdb-97a0-f840c085c4ba admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:44.685901 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acfd86-cb7e-4fdb-97a0-f840c085c4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:44.688819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acfd86-cb7e-4fdb-97a0-f840c085c4ba admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:44.725014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 996/1999] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:44 2022] POST /identity/v3/users => generated 304 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:44.727861 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acfd86-cb7e-4fdb-97a0-f840c085c4ba admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:44.729707 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d0acfd86-cb7e-4fdb-97a0-f840c085c4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:44.748086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b2a638da1148cd85397077090cf8ef', 'request_id': 'req-01747d44-abb1-4294-9b93-13edc55149ce'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.755645 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b2a638da1148cd85397077090cf8ef', 'request_id': 'req-01747d44-abb1-4294-9b93-13edc55149ce'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.763933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b2a638da1148cd85397077090cf8ef', 'request_id': 'req-01747d44-abb1-4294-9b93-13edc55149ce'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.775131 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] The token cache is being invalidate because project 63b2a638da1148cd85397077090cf8ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:44.775418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.776253 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.777954 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1004/2000] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:44 2022] DELETE /identity/v3/projects/63b2a638da1148cd85397077090cf8ef => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:44.778762 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:44.780751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:44.789430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acfd86-cb7e-4fdb-97a0-f840c085c4ba admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:44.839245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525f543-e6a9-418c-ada6-04d077955bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:44.839920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525f543-e6a9-418c-ada6-04d077955bdc service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:44.840229 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525f543-e6a9-418c-ada6-04d077955bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:44.840504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525f543-e6a9-418c-ada6-04d077955bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:44.842505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-5525f543-e6a9-418c-ada6-04d077955bdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:44.848569 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:44.851083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:44.857582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01747d44-abb1-4294-9b93-13edc55149ce admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:44.864412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143d9fe-ab4d-4dc8-83cc-77bbeeabe3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:44.865046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143d9fe-ab4d-4dc8-83cc-77bbeeabe3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:44.865722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143d9fe-ab4d-4dc8-83cc-77bbeeabe3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:44.866005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143d9fe-ab4d-4dc8-83cc-77bbeeabe3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:44.866660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143d9fe-ab4d-4dc8-83cc-77bbeeabe3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:44.868671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143d9fe-ab4d-4dc8-83cc-77bbeeabe3b0 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:44.879416 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1005/2001] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:44.880317 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143d9fe-ab4d-4dc8-83cc-77bbeeabe3b0 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:44.881968 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a143d9fe-ab4d-4dc8-83cc-77bbeeabe3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:44.894428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143d9fe-ab4d-4dc8-83cc-77bbeeabe3b0 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:44.899122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d02ca-ca39-4b5e-b992-d939af56bc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:44.899736 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d02ca-ca39-4b5e-b992-d939af56bc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:44.900024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d02ca-ca39-4b5e-b992-d939af56bc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:44.900274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d02ca-ca39-4b5e-b992-d939af56bc18 admin admin] PATH_INFO: `/v3/users/fd01833cf0d540fb8592d186505c9d3c` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:44.901378 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d02ca-ca39-4b5e-b992-d939af56bc18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd01833cf0d540fb8592d186505c9d3c)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:44.903320 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d02ca-ca39-4b5e-b992-d939af56bc18 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:44.911258 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525f543-e6a9-418c-ada6-04d077955bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:44.912722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525f543-e6a9-418c-ada6-04d077955bdc service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:44.922404 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 997/2002] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:44.923084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525f543-e6a9-418c-ada6-04d077955bdc service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:44.933413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525f543-e6a9-418c-ada6-04d077955bdc service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:44.939122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647fbdd-52d4-4cf0-b6b4-a9e2d3945d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:44.939730 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647fbdd-52d4-4cf0-b6b4-a9e2d3945d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:44.940007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647fbdd-52d4-4cf0-b6b4-a9e2d3945d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:44.940263 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647fbdd-52d4-4cf0-b6b4-a9e2d3945d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:44.941003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647fbdd-52d4-4cf0-b6b4-a9e2d3945d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:44.942779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647fbdd-52d4-4cf0-b6b4-a9e2d3945d16 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:44.957444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 998/2003] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:44.958859 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647fbdd-52d4-4cf0-b6b4-a9e2d3945d16 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:44.965315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-771d02ca-ca39-4b5e-b992-d939af56bc18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd01833cf0d540fb8592d186505c9d3c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.969951 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647fbdd-52d4-4cf0-b6b4-a9e2d3945d16 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:44.975966 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd989e-1cae-4a12-8e31-b7fc6b2861c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:44.976629 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd989e-1cae-4a12-8e31-b7fc6b2861c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:44.976898 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd989e-1cae-4a12-8e31-b7fc6b2861c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:44.977202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd989e-1cae-4a12-8e31-b7fc6b2861c2 admin admin] PATH_INFO: `/v3/projects/d940675752e240c2b24cc7969ef034e6/users/f1cb021d6f664a8c989889a4bef8ea2b/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:44.979300 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-771d02ca-ca39-4b5e-b992-d939af56bc18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd01833cf0d540fb8592d186505c9d3c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.990894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-771d02ca-ca39-4b5e-b992-d939af56bc18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd01833cf0d540fb8592d186505c9d3c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.991620 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-771d02ca-ca39-4b5e-b992-d939af56bc18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd01833cf0d540fb8592d186505c9d3c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.992464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-771d02ca-ca39-4b5e-b992-d939af56bc18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd01833cf0d540fb8592d186505c9d3c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:44.996127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd989e-1cae-4a12-8e31-b7fc6b2861c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d940675752e240c2b24cc7969ef034e6, user_id=f1cb021d6f664a8c989889a4bef8ea2b, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:44.999999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd989e-1cae-4a12-8e31-b7fc6b2861c2 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:45.011697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1006/2004] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:44 2022] DELETE /identity/v3/users/fd01833cf0d540fb8592d186505c9d3c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:45.024375 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 999/2005] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:44 2022] PUT /identity/v3/projects/d940675752e240c2b24cc7969ef034e6/users/f1cb021d6f664a8c989889a4bef8ea2b/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:45.036431 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f94e4d-5793-475d-854e-5f79a98ab499 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:45.037004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f94e4d-5793-475d-854e-5f79a98ab499 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:45.037443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f94e4d-5793-475d-854e-5f79a98ab499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:45.075921 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-57f94e4d-5793-475d-854e-5f79a98ab499 None None] MFA Rules not processed for user `f1cb021d6f664a8c989889a4bef8ea2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:45.077297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-57f94e4d-5793-475d-854e-5f79a98ab499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:45.172231 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1007/2006] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:45 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:45.177409 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd989e-1cae-4a12-8e31-b7fc6b2861c2 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:45.180504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b0dd989e-1cae-4a12-8e31-b7fc6b2861c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:45.277396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd989e-1cae-4a12-8e31-b7fc6b2861c2 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:45.334751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f94e4d-5793-475d-854e-5f79a98ab499 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:45.336320 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-57f94e4d-5793-475d-854e-5f79a98ab499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:45.375446 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7977b-6df4-4cf5-a4c0-43bc3aa8662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:45.376197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7977b-6df4-4cf5-a4c0-43bc3aa8662f admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:45.376380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7977b-6df4-4cf5-a4c0-43bc3aa8662f admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:45.377087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7977b-6df4-4cf5-a4c0-43bc3aa8662f admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:45.377319 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7977b-6df4-4cf5-a4c0-43bc3aa8662f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:45.379422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7977b-6df4-4cf5-a4c0-43bc3aa8662f admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:45.414664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:45.428814 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1000/2007] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:45 2022] POST /identity/v3/projects => generated 407 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:45.435915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7977b-6df4-4cf5-a4c0-43bc3aa8662f admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:45.456346 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:45.499576 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f94e4d-5793-475d-854e-5f79a98ab499 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:45.642244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:45.642499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:45.646775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:45.647198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] PATH_INFO: `/v3/projects/19ea1099679243278b07ab1a1c54d504` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:45.652660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ea1099679243278b07ab1a1c54d504)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:45.655687 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:45.659527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7977b-6df4-4cf5-a4c0-43bc3aa8662f admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:45.670547 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a473f-0fb2-4eb2-bdb5-b2ec73184bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:45.671252 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a473f-0fb2-4eb2-bdb5-b2ec73184bfe admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:45.671535 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a473f-0fb2-4eb2-bdb5-b2ec73184bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:45.671795 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a473f-0fb2-4eb2-bdb5-b2ec73184bfe admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:45.672441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a473f-0fb2-4eb2-bdb5-b2ec73184bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:45.676721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a473f-0fb2-4eb2-bdb5-b2ec73184bfe admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:45.720923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1001/2008] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:45 2022] POST /identity/v3/users => generated 310 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:45.725111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a473f-0fb2-4eb2-bdb5-b2ec73184bfe admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:45.761946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ea1099679243278b07ab1a1c54d504', 'request_id': 'req-a5b9c718-07f3-4624-adee-59ea9ed57ab3'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:45.776101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ea1099679243278b07ab1a1c54d504', 'request_id': 'req-a5b9c718-07f3-4624-adee-59ea9ed57ab3'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:45.789995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a473f-0fb2-4eb2-bdb5-b2ec73184bfe admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:45.792752 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ea1099679243278b07ab1a1c54d504', 'request_id': 'req-a5b9c718-07f3-4624-adee-59ea9ed57ab3'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:45.814573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] The token cache is being invalidate because project 19ea1099679243278b07ab1a1c54d504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:45.816771 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:45.817760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:45.820516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1008/2009] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:45 2022] DELETE /identity/v3/projects/19ea1099679243278b07ab1a1c54d504 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:45.822997 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:45.826993 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:45.926952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08efa6-a719-4fab-8aee-f39b2e24c309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:45.928962 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08efa6-a719-4fab-8aee-f39b2e24c309 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:45.930642 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08efa6-a719-4fab-8aee-f39b2e24c309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:45.931028 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08efa6-a719-4fab-8aee-f39b2e24c309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:45.932862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08efa6-a719-4fab-8aee-f39b2e24c309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:45.937547 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08efa6-a719-4fab-8aee-f39b2e24c309 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:45.954700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1002/2010] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:45.956516 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08efa6-a719-4fab-8aee-f39b2e24c309 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:45.959076 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-3c08efa6-a719-4fab-8aee-f39b2e24c309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:45.977237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08efa6-a719-4fab-8aee-f39b2e24c309 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:45.985088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d48b3-424b-484f-a76f-3217c4bcdbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:45.986003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d48b3-424b-484f-a76f-3217c4bcdbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:45.986510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d48b3-424b-484f-a76f-3217c4bcdbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:45.987105 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d48b3-424b-484f-a76f-3217c4bcdbb4 admin admin] PATH_INFO: `/v3/users/74551a0095d142338e83fa6078853ede` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:45.987211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9c718-07f3-4624-adee-59ea9ed57ab3 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:45.990497 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d48b3-424b-484f-a76f-3217c4bcdbb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74551a0095d142338e83fa6078853ede)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:45.992807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d48b3-424b-484f-a76f-3217c4bcdbb4 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:45.998345 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:46.001337 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:46.001704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:46.001977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e admin admin] PATH_INFO: `/v3/projects/6320b8ae91104493a8b494732c1f03e1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:46.010243 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6320b8ae91104493a8b494732c1f03e1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:46.015224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:46.082651 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-450d48b3-424b-484f-a76f-3217c4bcdbb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74551a0095d142338e83fa6078853ede'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.093536 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-450d48b3-424b-484f-a76f-3217c4bcdbb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74551a0095d142338e83fa6078853ede'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.094339 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-450d48b3-424b-484f-a76f-3217c4bcdbb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74551a0095d142338e83fa6078853ede'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.095199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-450d48b3-424b-484f-a76f-3217c4bcdbb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74551a0095d142338e83fa6078853ede'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.113205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-450d48b3-424b-484f-a76f-3217c4bcdbb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74551a0095d142338e83fa6078853ede'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.126211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:46.133309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:46.146897 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1003/2011] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:45 2022] DELETE /identity/v3/users/74551a0095d142338e83fa6078853ede => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:46.149351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d48b3-424b-484f-a76f-3217c4bcdbb4 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:46.158697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-450d48b3-424b-484f-a76f-3217c4bcdbb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:46.176507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6320b8ae91104493a8b494732c1f03e1', 'request_id': 'req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.188708 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6320b8ae91104493a8b494732c1f03e1', 'request_id': 'req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.208987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6320b8ae91104493a8b494732c1f03e1', 'request_id': 'req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.224117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e admin admin] The token cache is being invalidate because project 6320b8ae91104493a8b494732c1f03e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:46.228335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.231014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a2dcb47c-155d-452a-a70e-d389cd7bdd4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.237030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1009/2012] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:45 2022] DELETE /identity/v3/projects/6320b8ae91104493a8b494732c1f03e1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:46.245111 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3093b-a072-4b96-a874-a126a5e76d9d None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:46.245656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3093b-a072-4b96-a874-a126a5e76d9d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:46.246921 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3093b-a072-4b96-a874-a126a5e76d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:46.297413 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-9fe3093b-a072-4b96-a874-a126a5e76d9d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:46.299202 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9fe3093b-a072-4b96-a874-a126a5e76d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:46.316523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d48b3-424b-484f-a76f-3217c4bcdbb4 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:46.326949 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1010/2013] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:46.335862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e8b2-1664-4aac-8585-36afd858206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:46.336735 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e8b2-1664-4aac-8585-36afd858206c admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:46.337127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e8b2-1664-4aac-8585-36afd858206c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:46.337606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e8b2-1664-4aac-8585-36afd858206c admin admin] PATH_INFO: `/v3/projects/ea85f258def3407fa68227a5cafe8cfc/users/a1b03a18759641b2b6c2e8446cdf9724/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:46.338343 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72674554-ef40-4591-bb9b-272ecb07700d None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:46.339025 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72674554-ef40-4591-bb9b-272ecb07700d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:46.339592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72674554-ef40-4591-bb9b-272ecb07700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:46.361388 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311e8b2-1664-4aac-8585-36afd858206c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea85f258def3407fa68227a5cafe8cfc, user_id=a1b03a18759641b2b6c2e8446cdf9724, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:46.366180 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311e8b2-1664-4aac-8585-36afd858206c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:46.377735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-72674554-ef40-4591-bb9b-272ecb07700d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:46.379824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-72674554-ef40-4591-bb9b-272ecb07700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:46.386756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1004/2014] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:46 2022] PUT /identity/v3/projects/ea85f258def3407fa68227a5cafe8cfc/users/a1b03a18759641b2b6c2e8446cdf9724/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:46.390618 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e8b2-1664-4aac-8585-36afd858206c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:46.392418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4311e8b2-1664-4aac-8585-36afd858206c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:46.486300 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1011/2015] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:46.490911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72674554-ef40-4591-bb9b-272ecb07700d None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:46.502322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e8b2-1664-4aac-8585-36afd858206c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:46.503758 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72674554-ef40-4591-bb9b-272ecb07700d None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:46.507591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f909e-cd3f-49c6-8ce3-2fbebb57dce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:46.508290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f909e-cd3f-49c6-8ce3-2fbebb57dce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:46.508564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f909e-cd3f-49c6-8ce3-2fbebb57dce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:46.508831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f909e-cd3f-49c6-8ce3-2fbebb57dce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:46.509124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63d067-11fc-49df-99b6-bc6b689564b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:46.509609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f909e-cd3f-49c6-8ce3-2fbebb57dce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:46.509794 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63d067-11fc-49df-99b6-bc6b689564b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:46.510644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63d067-11fc-49df-99b6-bc6b689564b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:46.511001 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63d067-11fc-49df-99b6-bc6b689564b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:46.511547 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f909e-cd3f-49c6-8ce3-2fbebb57dce9 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:46.511811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63d067-11fc-49df-99b6-bc6b689564b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:46.512123 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63d067-11fc-49df-99b6-bc6b689564b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:46.514353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63d067-11fc-49df-99b6-bc6b689564b6 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:46.527057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1005/2016] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:26:46.528798 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f909e-cd3f-49c6-8ce3-2fbebb57dce9 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:46.540700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f909e-cd3f-49c6-8ce3-2fbebb57dce9 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:46.546000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1012/2017] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:26:46.552094 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63d067-11fc-49df-99b6-bc6b689564b6 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:46.561337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31964465-dcb7-4fba-b643-d7482bfbc198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:46.562280 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31964465-dcb7-4fba-b643-d7482bfbc198 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:46.562743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31964465-dcb7-4fba-b643-d7482bfbc198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:46.563420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31964465-dcb7-4fba-b643-d7482bfbc198 admin admin] PATH_INFO: `/v3/projects/ea85f258def3407fa68227a5cafe8cfc/users/a1b03a18759641b2b6c2e8446cdf9724/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:46.565942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31964465-dcb7-4fba-b643-d7482bfbc198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea85f258def3407fa68227a5cafe8cfc, user_id=a1b03a18759641b2b6c2e8446cdf9724, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:46.570834 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31964465-dcb7-4fba-b643-d7482bfbc198 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:46.574464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63d067-11fc-49df-99b6-bc6b689564b6 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:46.580245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0ef86-7e38-4769-b989-67a032d76d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:46.580573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0ef86-7e38-4769-b989-67a032d76d0f admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:46.580824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0ef86-7e38-4769-b989-67a032d76d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:46.581090 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0ef86-7e38-4769-b989-67a032d76d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:46.581720 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0ef86-7e38-4769-b989-67a032d76d0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:46.584101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0ef86-7e38-4769-b989-67a032d76d0f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:46.591976 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1006/2018] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:46 2022] PUT /identity/v3/projects/ea85f258def3407fa68227a5cafe8cfc/users/a1b03a18759641b2b6c2e8446cdf9724/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:46.593425 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3dce-e8da-465a-8803-ffd884f9c574 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:46.593711 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3dce-e8da-465a-8803-ffd884f9c574 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:46.593978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3dce-e8da-465a-8803-ffd884f9c574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:46.622065 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1013/2019] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:46 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:46.626092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0ef86-7e38-4769-b989-67a032d76d0f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:46.646711 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-d17b3dce-e8da-465a-8803-ffd884f9c574 None None] MFA Rules not processed for user `a1b03a18759641b2b6c2e8446cdf9724`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:46.653069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d17b3dce-e8da-465a-8803-ffd884f9c574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:46.716624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:46.751509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1007/2020] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:46 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:46.752309 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b3dce-e8da-465a-8803-ffd884f9c574 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:46.754129 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d17b3dce-e8da-465a-8803-ffd884f9c574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:46.764402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0ef86-7e38-4769-b989-67a032d76d0f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:46.770112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc90a6d-309b-453b-9a1f-22db0303b963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:46.770996 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90a6d-309b-453b-9a1f-22db0303b963 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:46.771280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90a6d-309b-453b-9a1f-22db0303b963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:46.771527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90a6d-309b-453b-9a1f-22db0303b963 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:46.772172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc90a6d-309b-453b-9a1f-22db0303b963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:46.772348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b3dce-e8da-465a-8803-ffd884f9c574 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:46.774102 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc90a6d-309b-453b-9a1f-22db0303b963 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:46.777076 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:46.777724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:46.777998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:46.778286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] PATH_INFO: `/v3/projects/9db421ef423e463bb8ef79e5c8ea9b63` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:46.779451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db421ef423e463bb8ef79e5c8ea9b63)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:46.781405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:46.802480 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1014/2021] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:46 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:46.802480 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc90a6d-309b-453b-9a1f-22db0303b963 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:46.806517 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9fc90a6d-309b-453b-9a1f-22db0303b963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:46.818354 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:46.847513 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db421ef423e463bb8ef79e5c8ea9b63', 'request_id': 'req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.857866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db421ef423e463bb8ef79e5c8ea9b63', 'request_id': 'req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.866099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db421ef423e463bb8ef79e5c8ea9b63', 'request_id': 'req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.874633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc90a6d-309b-453b-9a1f-22db0303b963 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:46.879912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] The token cache is being invalidate because project 9db421ef423e463bb8ef79e5c8ea9b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:46.880086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.881031 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:46.883195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1008/2022] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:46 2022] DELETE /identity/v3/projects/9db421ef423e463bb8ef79e5c8ea9b63 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:46.883820 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:46.885121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:46.933494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341039f7-57e5-40b6-b3b5-94269cc79da8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:46.934217 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341039f7-57e5-40b6-b3b5-94269cc79da8 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:46.934551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341039f7-57e5-40b6-b3b5-94269cc79da8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:46.934918 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341039f7-57e5-40b6-b3b5-94269cc79da8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:46.936907 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-341039f7-57e5-40b6-b3b5-94269cc79da8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:46.978391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c5163-1eaa-4f02-a6fe-1593ce08b265 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:46.985242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3382f-4ba2-47ed-a743-6528c02c6298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:46.985580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3382f-4ba2-47ed-a743-6528c02c6298 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:46.985846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3382f-4ba2-47ed-a743-6528c02c6298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:46.986107 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3382f-4ba2-47ed-a743-6528c02c6298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:46.986792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3382f-4ba2-47ed-a743-6528c02c6298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:46.988932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3382f-4ba2-47ed-a743-6528c02c6298 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.012830 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1009/2023] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:47.015858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e941b-8be3-4896-bde1-93dd7e847b89 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.016183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e941b-8be3-4896-bde1-93dd7e847b89 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.016459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e941b-8be3-4896-bde1-93dd7e847b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.031430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341039f7-57e5-40b6-b3b5-94269cc79da8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:47.033137 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341039f7-57e5-40b6-b3b5-94269cc79da8 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.046000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1015/2024] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:46 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:47.046870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341039f7-57e5-40b6-b3b5-94269cc79da8 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:47.049107 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-e92e941b-8be3-4896-bde1-93dd7e847b89 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:47.050958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e92e941b-8be3-4896-bde1-93dd7e847b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:47.058748 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341039f7-57e5-40b6-b3b5-94269cc79da8 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:47.061420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1010/2025] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:47.069768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12580c03-9338-4373-91a2-9b1e74511226 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.070187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12580c03-9338-4373-91a2-9b1e74511226 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.070461 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12580c03-9338-4373-91a2-9b1e74511226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.071781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832ff4f-939e-4aff-9685-a7cca9885a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:47.072411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ff4f-939e-4aff-9685-a7cca9885a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.072782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ff4f-939e-4aff-9685-a7cca9885a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.073274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ff4f-939e-4aff-9685-a7cca9885a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.073935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832ff4f-939e-4aff-9685-a7cca9885a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:47.077476 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832ff4f-939e-4aff-9685-a7cca9885a51 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.090866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1016/2026] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:47.093259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-12580c03-9338-4373-91a2-9b1e74511226 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:47.094452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-12580c03-9338-4373-91a2-9b1e74511226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:47.094724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832ff4f-939e-4aff-9685-a7cca9885a51 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:47.106666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1011/2027] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:47.107651 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12580c03-9338-4373-91a2-9b1e74511226 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:47.114970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832ff4f-939e-4aff-9685-a7cca9885a51 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:47.121166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12580c03-9338-4373-91a2-9b1e74511226 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:47.121899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ab961-37b8-494c-b0d2-a7b1ebc618fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:47.122664 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ab961-37b8-494c-b0d2-a7b1ebc618fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.122977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ab961-37b8-494c-b0d2-a7b1ebc618fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.123308 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ab961-37b8-494c-b0d2-a7b1ebc618fc admin admin] PATH_INFO: `/v3/projects/546f215d0925459292ff847fbf37382c/users/f266e728a1ea421abc67af65e8fc0e40/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.130787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e73b0-a078-460c-8e27-85f53e615f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:47.131578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e73b0-a078-460c-8e27-85f53e615f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.132267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e73b0-a078-460c-8e27-85f53e615f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.133328 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e73b0-a078-460c-8e27-85f53e615f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.134057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e73b0-a078-460c-8e27-85f53e615f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:47.134457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e73b0-a078-460c-8e27-85f53e615f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:47.136954 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e73b0-a078-460c-8e27-85f53e615f34 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.148870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ab961-37b8-494c-b0d2-a7b1ebc618fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=546f215d0925459292ff847fbf37382c, user_id=f266e728a1ea421abc67af65e8fc0e40, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:47.152695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ab961-37b8-494c-b0d2-a7b1ebc618fc admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.155013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1012/2028] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:26:47.163370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e73b0-a078-460c-8e27-85f53e615f34 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:47.180216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e73b0-a078-460c-8e27-85f53e615f34 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:47.184596 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1017/2029] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:47 2022] PUT /identity/v3/projects/546f215d0925459292ff847fbf37382c/users/f266e728a1ea421abc67af65e8fc0e40/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:47.197131 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e3272-738a-49eb-a142-86339ae470a2 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.197630 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e3272-738a-49eb-a142-86339ae470a2 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.197899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e3272-738a-49eb-a142-86339ae470a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.233893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c21e3272-738a-49eb-a142-86339ae470a2 None None] MFA Rules not processed for user `f266e728a1ea421abc67af65e8fc0e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:47.235163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c21e3272-738a-49eb-a142-86339ae470a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:47.268493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:47.279173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:47.295879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a07a7-d348-47e3-b7d1-fddbe763ca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:47.297400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a07a7-d348-47e3-b7d1-fddbe763ca68 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.298073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a07a7-d348-47e3-b7d1-fddbe763ca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.298533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a07a7-d348-47e3-b7d1-fddbe763ca68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.299707 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a07a7-d348-47e3-b7d1-fddbe763ca68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:47.302875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a07a7-d348-47e3-b7d1-fddbe763ca68 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.346786 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1018/2030] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:47.348172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e3272-738a-49eb-a142-86339ae470a2 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:47.350044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c21e3272-738a-49eb-a142-86339ae470a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:47.353297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1013/2031] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:47 2022] POST /identity/v3/projects => generated 367 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:47.355919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b9e90-abf7-4d1b-a3c2-f6e069e25075 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.356205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b9e90-abf7-4d1b-a3c2-f6e069e25075 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.356545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b9e90-abf7-4d1b-a3c2-f6e069e25075 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.359932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1014/2032] 10.222.0.59 () {54 vars in 921 bytes} [Tue Aug 9 11:26:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:26:47.360559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b9e90-abf7-4d1b-a3c2-f6e069e25075 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:47.453143 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e3272-738a-49eb-a142-86339ae470a2 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:47.498279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b9e90-abf7-4d1b-a3c2-f6e069e25075 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:47.505167 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812046ab-231c-4267-a849-4bd829d1183a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:47.505908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812046ab-231c-4267-a849-4bd829d1183a admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.506312 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812046ab-231c-4267-a849-4bd829d1183a admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.506648 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812046ab-231c-4267-a849-4bd829d1183a admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.507717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812046ab-231c-4267-a849-4bd829d1183a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:47.509750 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812046ab-231c-4267-a849-4bd829d1183a admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.534138 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1015/2033] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:47 2022] POST /identity/v3/users => generated 284 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:47.536077 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812046ab-231c-4267-a849-4bd829d1183a admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:47.539358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502d825-4205-4ea5-becc-d23b85592655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:47.539984 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502d825-4205-4ea5-becc-d23b85592655 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.540143 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502d825-4205-4ea5-becc-d23b85592655 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.540414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502d825-4205-4ea5-becc-d23b85592655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.542224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-8502d825-4205-4ea5-becc-d23b85592655 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:47.551591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812046ab-231c-4267-a849-4bd829d1183a admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:47.559322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb54db-77e6-403a-961f-08ee69647edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:47.560543 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb54db-77e6-403a-961f-08ee69647edf admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.560960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb54db-77e6-403a-961f-08ee69647edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.561404 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb54db-77e6-403a-961f-08ee69647edf admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.562230 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb54db-77e6-403a-961f-08ee69647edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:47.571786 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb54db-77e6-403a-961f-08ee69647edf admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.615836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1016/2034] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:47 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:47.615836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be44b65-7319-41c3-a407-459f96cc3dbf None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.615836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be44b65-7319-41c3-a407-459f96cc3dbf None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.615836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be44b65-7319-41c3-a407-459f96cc3dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.636138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502d825-4205-4ea5-becc-d23b85592655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:47.637051 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502d825-4205-4ea5-becc-d23b85592655 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.639577 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-4be44b65-7319-41c3-a407-459f96cc3dbf None None] MFA Rules not processed for user `2136cf1160a64951ad780424cb28403b`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:47.640920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4be44b65-7319-41c3-a407-459f96cc3dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:47.651378 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1019/2035] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:47 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:47.653018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502d825-4205-4ea5-becc-d23b85592655 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:47.664840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502d825-4205-4ea5-becc-d23b85592655 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:47.716395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:47.735403 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1017/2036] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Aug 9 11:26:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:47.736691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be44b65-7319-41c3-a407-459f96cc3dbf None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:47.744451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e61ff-1b49-4b5d-b8bd-60a08da8612e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:47.752147 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e61ff-1b49-4b5d-b8bd-60a08da8612e admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.752871 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e61ff-1b49-4b5d-b8bd-60a08da8612e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.753483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e61ff-1b49-4b5d-b8bd-60a08da8612e admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.756047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be44b65-7319-41c3-a407-459f96cc3dbf None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:47.756169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e61ff-1b49-4b5d-b8bd-60a08da8612e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:47.759537 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e61ff-1b49-4b5d-b8bd-60a08da8612e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.759658 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae37cd9-8b10-469a-9b5f-e286072e9e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:47.760784 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae37cd9-8b10-469a-9b5f-e286072e9e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.761068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae37cd9-8b10-469a-9b5f-e286072e9e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.761545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae37cd9-8b10-469a-9b5f-e286072e9e9b admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.762183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae37cd9-8b10-469a-9b5f-e286072e9e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:47.765006 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae37cd9-8b10-469a-9b5f-e286072e9e9b admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.772202 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1020/2037] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:47.777376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e61ff-1b49-4b5d-b8bd-60a08da8612e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:47.791991 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e61ff-1b49-4b5d-b8bd-60a08da8612e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:47.798139 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f267aaa-38ae-4724-a2a8-49ace7c7d58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:47.798862 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f267aaa-38ae-4724-a2a8-49ace7c7d58d admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.799650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f267aaa-38ae-4724-a2a8-49ace7c7d58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.799650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f267aaa-38ae-4724-a2a8-49ace7c7d58d admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.800291 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f267aaa-38ae-4724-a2a8-49ace7c7d58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:47.802127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f267aaa-38ae-4724-a2a8-49ace7c7d58d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.805796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1018/2038] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:47 2022] POST /identity/v3/users => generated 298 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:47.807183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae37cd9-8b10-469a-9b5f-e286072e9e9b admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:47.818173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1021/2039] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:26:47.823124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f267aaa-38ae-4724-a2a8-49ace7c7d58d admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:47.829315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae37cd9-8b10-469a-9b5f-e286072e9e9b admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:47.837576 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5bebd-732e-4ddf-9a72-97d0f7f5695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:47.838467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5bebd-732e-4ddf-9a72-97d0f7f5695f admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.838848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5bebd-732e-4ddf-9a72-97d0f7f5695f admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.839010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5bebd-732e-4ddf-9a72-97d0f7f5695f admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.839598 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5bebd-732e-4ddf-9a72-97d0f7f5695f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:47.841320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5bebd-732e-4ddf-9a72-97d0f7f5695f admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.845518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:47.853693 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f267aaa-38ae-4724-a2a8-49ace7c7d58d admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:47.862301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1019/2040] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:47.867954 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5bebd-732e-4ddf-9a72-97d0f7f5695f admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:47.894603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63299a-15e1-4e1a-ae5e-3ecfa0975175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:47.895155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63299a-15e1-4e1a-ae5e-3ecfa0975175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.895524 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63299a-15e1-4e1a-ae5e-3ecfa0975175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.895815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63299a-15e1-4e1a-ae5e-3ecfa0975175 admin admin] PATH_INFO: `/v3/projects/15ad8680b0e0496480a4a5bf376b0fc5/users/86d071be98e64d3aac81aab18025039f/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.904930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5bebd-732e-4ddf-9a72-97d0f7f5695f admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:47.910216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb5d0-7358-4473-803e-08fe5ff8b971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:47.910933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb5d0-7358-4473-803e-08fe5ff8b971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:47.911206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb5d0-7358-4473-803e-08fe5ff8b971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:47.911472 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb5d0-7358-4473-803e-08fe5ff8b971 admin admin] PATH_INFO: `/v3/projects/991f33c2512d473db2edd52e43674be6/users/ea2ba7bc60c44c4fbdd080e3737f8fc2/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:47.932491 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63299a-15e1-4e1a-ae5e-3ecfa0975175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ad8680b0e0496480a4a5bf376b0fc5, user_id=86d071be98e64d3aac81aab18025039f, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:47.935313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63299a-15e1-4e1a-ae5e-3ecfa0975175 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.937643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cb5d0-7358-4473-803e-08fe5ff8b971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991f33c2512d473db2edd52e43674be6, user_id=ea2ba7bc60c44c4fbdd080e3737f8fc2, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:47.943264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cb5d0-7358-4473-803e-08fe5ff8b971 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:47.968386 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1020/2041] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:47 2022] PUT /identity/v3/projects/991f33c2512d473db2edd52e43674be6/users/ea2ba7bc60c44c4fbdd080e3737f8fc2/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:47.969515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb5d0-7358-4473-803e-08fe5ff8b971 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:47.971468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b57cb5d0-7358-4473-803e-08fe5ff8b971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:47.984093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1022/2042] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:47 2022] PUT /identity/v3/projects/15ad8680b0e0496480a4a5bf376b0fc5/users/86d071be98e64d3aac81aab18025039f/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:47.984093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63299a-15e1-4e1a-ae5e-3ecfa0975175 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:48.158285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb5d0-7358-4473-803e-08fe5ff8b971 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:48.163834 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63299a-15e1-4e1a-ae5e-3ecfa0975175 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:48.172810 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2431ad-0f0d-4700-a2bf-fa7b89b4741b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:48.174136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2431ad-0f0d-4700-a2bf-fa7b89b4741b service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:48.174459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2431ad-0f0d-4700-a2bf-fa7b89b4741b service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:48.175050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2431ad-0f0d-4700-a2bf-fa7b89b4741b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:48.188589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2431ad-0f0d-4700-a2bf-fa7b89b4741b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:48.191884 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2431ad-0f0d-4700-a2bf-fa7b89b4741b service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:48.207430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1021/2043] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:48.209331 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42331580-fe1f-4771-9d8a-ad7f9f0a804a None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:48.210097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42331580-fe1f-4771-9d8a-ad7f9f0a804a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:48.210765 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42331580-fe1f-4771-9d8a-ad7f9f0a804a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:48.254959 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb65597-1eed-49cc-bcd1-bacc0bf5ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:48.259759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb65597-1eed-49cc-bcd1-bacc0bf5ec39 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:48.260246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb65597-1eed-49cc-bcd1-bacc0bf5ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:48.260695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb65597-1eed-49cc-bcd1-bacc0bf5ec39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:48.262287 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb65597-1eed-49cc-bcd1-bacc0bf5ec39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:48.264505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-42331580-fe1f-4771-9d8a-ad7f9f0a804a None None] MFA Rules not processed for user `86d071be98e64d3aac81aab18025039f`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:48.265161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb65597-1eed-49cc-bcd1-bacc0bf5ec39 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:48.265876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-42331580-fe1f-4771-9d8a-ad7f9f0a804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:48.283184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1023/2044] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:48.285733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb65597-1eed-49cc-bcd1-bacc0bf5ec39 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:48.298904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb65597-1eed-49cc-bcd1-bacc0bf5ec39 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:48.307886 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06966256-fca3-41c2-a43c-8f1a8879ed1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:48.309267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06966256-fca3-41c2-a43c-8f1a8879ed1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:48.309847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06966256-fca3-41c2-a43c-8f1a8879ed1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:48.310251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06966256-fca3-41c2-a43c-8f1a8879ed1e admin admin] PATH_INFO: `/v3/projects/991f33c2512d473db2edd52e43674be6/users/ea2ba7bc60c44c4fbdd080e3737f8fc2/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:48.318093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06966256-fca3-41c2-a43c-8f1a8879ed1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=991f33c2512d473db2edd52e43674be6, user_id=ea2ba7bc60c44c4fbdd080e3737f8fc2, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:48.331996 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06966256-fca3-41c2-a43c-8f1a8879ed1e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:48.346406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1024/2045] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:48 2022] PUT /identity/v3/projects/991f33c2512d473db2edd52e43674be6/users/ea2ba7bc60c44c4fbdd080e3737f8fc2/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:48.358623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6ac89-7f23-4f66-ac8f-113a1a2335b8 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:48.358945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6ac89-7f23-4f66-ac8f-113a1a2335b8 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:48.359224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6ac89-7f23-4f66-ac8f-113a1a2335b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:48.379559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1022/2046] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:48.384756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42331580-fe1f-4771-9d8a-ad7f9f0a804a None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:48.392556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b0e6ac89-7f23-4f66-ac8f-113a1a2335b8 None None] MFA Rules not processed for user `ea2ba7bc60c44c4fbdd080e3737f8fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:48.393837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b0e6ac89-7f23-4f66-ac8f-113a1a2335b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:48.395678 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42331580-fe1f-4771-9d8a-ad7f9f0a804a None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:48.421623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:48.449349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:48.464170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6517d3-2c61-4419-8b44-5516cfa3acc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:48.464975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6517d3-2c61-4419-8b44-5516cfa3acc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:48.465255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6517d3-2c61-4419-8b44-5516cfa3acc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:48.465537 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6517d3-2c61-4419-8b44-5516cfa3acc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:48.466181 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6517d3-2c61-4419-8b44-5516cfa3acc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:48.468203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6517d3-2c61-4419-8b44-5516cfa3acc3 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:48.487945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1025/2047] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:48.496591 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6ac89-7f23-4f66-ac8f-113a1a2335b8 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:48.497993 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b0e6ac89-7f23-4f66-ac8f-113a1a2335b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:48.503463 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1023/2048] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:48 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:48.504779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6517d3-2c61-4419-8b44-5516cfa3acc3 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:48.560660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6ac89-7f23-4f66-ac8f-113a1a2335b8 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:48.568705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6517d3-2c61-4419-8b44-5516cfa3acc3 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:48.573608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a9a07-b981-4e52-819e-dbc314a21353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:48.574227 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a9a07-b981-4e52-819e-dbc314a21353 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:48.574490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a9a07-b981-4e52-819e-dbc314a21353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:48.574760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a9a07-b981-4e52-819e-dbc314a21353 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:48.575435 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a9a07-b981-4e52-819e-dbc314a21353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:48.577354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a9a07-b981-4e52-819e-dbc314a21353 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:48.603070 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1024/2049] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:48 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:48.612184 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a9a07-b981-4e52-819e-dbc314a21353 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:48.623997 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a9a07-b981-4e52-819e-dbc314a21353 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:48.631528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732fe9f-7764-4303-94a6-b79537630a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:48.632612 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732fe9f-7764-4303-94a6-b79537630a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:48.632927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732fe9f-7764-4303-94a6-b79537630a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:48.633201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732fe9f-7764-4303-94a6-b79537630a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:48.633839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732fe9f-7764-4303-94a6-b79537630a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:48.635497 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732fe9f-7764-4303-94a6-b79537630a03 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:48.636696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de468be3-2423-480d-bbda-003b3711bd6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:48.637320 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de468be3-2423-480d-bbda-003b3711bd6b service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:48.637594 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de468be3-2423-480d-bbda-003b3711bd6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:48.637861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de468be3-2423-480d-bbda-003b3711bd6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:48.646865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1025/2050] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:48.651262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732fe9f-7764-4303-94a6-b79537630a03 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:48.662456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732fe9f-7764-4303-94a6-b79537630a03 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:48.668193 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddf5d8-49c2-4780-99db-2499fef18c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:48.668951 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddf5d8-49c2-4780-99db-2499fef18c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:48.669299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddf5d8-49c2-4780-99db-2499fef18c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:48.669585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddf5d8-49c2-4780-99db-2499fef18c3a admin admin] PATH_INFO: `/v3/projects/c067326f7e0f45bc96c8746464138b92/users/5c7904ca140e4e20aab377c363d6f54b/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:48.686157 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddf5d8-49c2-4780-99db-2499fef18c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c067326f7e0f45bc96c8746464138b92, user_id=5c7904ca140e4e20aab377c363d6f54b, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:48.689070 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddf5d8-49c2-4780-99db-2499fef18c3a admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:48.701963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de468be3-2423-480d-bbda-003b3711bd6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:48.703619 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de468be3-2423-480d-bbda-003b3711bd6b service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:48.707551 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1026/2051] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:48 2022] PUT /identity/v3/projects/c067326f7e0f45bc96c8746464138b92/users/5c7904ca140e4e20aab377c363d6f54b/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:48.711993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddf5d8-49c2-4780-99db-2499fef18c3a admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:48.727801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1026/2052] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:48.828808 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddf5d8-49c2-4780-99db-2499fef18c3a admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:48.834970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590f8cc-bfbe-4e29-8d94-ae00d31770a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:48.836382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590f8cc-bfbe-4e29-8d94-ae00d31770a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:48.836514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590f8cc-bfbe-4e29-8d94-ae00d31770a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:48.836776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590f8cc-bfbe-4e29-8d94-ae00d31770a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:48.837455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590f8cc-bfbe-4e29-8d94-ae00d31770a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:48.839155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590f8cc-bfbe-4e29-8d94-ae00d31770a1 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:48.854866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1027/2053] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:26:48.859001 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de468be3-2423-480d-bbda-003b3711bd6b service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:48.872845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de468be3-2423-480d-bbda-003b3711bd6b service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:48.881208 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafa6cd-1b56-46c4-a3a2-8df35a1048fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:48.882198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafa6cd-1b56-46c4-a3a2-8df35a1048fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:48.882436 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafa6cd-1b56-46c4-a3a2-8df35a1048fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:48.882899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafa6cd-1b56-46c4-a3a2-8df35a1048fa admin admin] PATH_INFO: `/v3/projects/c067326f7e0f45bc96c8746464138b92/users/5c7904ca140e4e20aab377c363d6f54b/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:48.888756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafa6cd-1b56-46c4-a3a2-8df35a1048fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c067326f7e0f45bc96c8746464138b92, user_id=5c7904ca140e4e20aab377c363d6f54b, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:48.892658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafa6cd-1b56-46c4-a3a2-8df35a1048fa admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:48.907695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1027/2054] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:48 2022] PUT /identity/v3/projects/c067326f7e0f45bc96c8746464138b92/users/5c7904ca140e4e20aab377c363d6f54b/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:48.921105 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12137ce3-648a-41a4-92bf-ca010a99616d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:48.921646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12137ce3-648a-41a4-92bf-ca010a99616d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:48.922110 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12137ce3-648a-41a4-92bf-ca010a99616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:48.979092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-12137ce3-648a-41a4-92bf-ca010a99616d None None] MFA Rules not processed for user `5c7904ca140e4e20aab377c363d6f54b`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:48.981249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-12137ce3-648a-41a4-92bf-ca010a99616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:48.998035 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:49.091050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1028/2055] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:49.108063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafa6cd-1b56-46c4-a3a2-8df35a1048fa admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:49.132765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:49.224498 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafa6cd-1b56-46c4-a3a2-8df35a1048fa admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:49.229531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebec80-3218-43b6-b524-ccc5882ec845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:49.230163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebec80-3218-43b6-b524-ccc5882ec845 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:49.230438 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebec80-3218-43b6-b524-ccc5882ec845 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:49.230712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebec80-3218-43b6-b524-ccc5882ec845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:49.245024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebec80-3218-43b6-b524-ccc5882ec845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:49.245024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebec80-3218-43b6-b524-ccc5882ec845 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:49.264445 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1028/2056] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:26:49.584852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12137ce3-648a-41a4-92bf-ca010a99616d None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:49.601462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12137ce3-648a-41a4-92bf-ca010a99616d None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:49.607339 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa57c7-912d-4d48-af13-5da8e1e42b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:49.608111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa57c7-912d-4d48-af13-5da8e1e42b06 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:49.608383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa57c7-912d-4d48-af13-5da8e1e42b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:49.608649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa57c7-912d-4d48-af13-5da8e1e42b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:49.719162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa57c7-912d-4d48-af13-5da8e1e42b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:49.720749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa57c7-912d-4d48-af13-5da8e1e42b06 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:49.730866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1029/2057] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:53.424640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebec80-3218-43b6-b524-ccc5882ec845 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:53.499370 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebec80-3218-43b6-b524-ccc5882ec845 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:53.505891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e224931-baae-4a71-9f07-84aff34b2bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:53.506938 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e224931-baae-4a71-9f07-84aff34b2bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:53.507220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e224931-baae-4a71-9f07-84aff34b2bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:53.507338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e224931-baae-4a71-9f07-84aff34b2bab admin admin] PATH_INFO: `/v3/users/86d071be98e64d3aac81aab18025039f` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:53.508662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e224931-baae-4a71-9f07-84aff34b2bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d071be98e64d3aac81aab18025039f)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:53.510611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e224931-baae-4a71-9f07-84aff34b2bab admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:53.566299 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9e224931-baae-4a71-9f07-84aff34b2bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d071be98e64d3aac81aab18025039f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:53.581370 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9e224931-baae-4a71-9f07-84aff34b2bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d071be98e64d3aac81aab18025039f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:53.590835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9e224931-baae-4a71-9f07-84aff34b2bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d071be98e64d3aac81aab18025039f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:53.591606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9e224931-baae-4a71-9f07-84aff34b2bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d071be98e64d3aac81aab18025039f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:53.592543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9e224931-baae-4a71-9f07-84aff34b2bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d071be98e64d3aac81aab18025039f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:53.616160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1029/2058] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:53 2022] DELETE /identity/v3/users/86d071be98e64d3aac81aab18025039f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:53.621044 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf980a-481d-44cc-9f24-036730267884 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:53.621528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf980a-481d-44cc-9f24-036730267884 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:53.621617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf980a-481d-44cc-9f24-036730267884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:53.641570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-bfdf980a-481d-44cc-9f24-036730267884 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:53.642743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-bfdf980a-481d-44cc-9f24-036730267884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:53.706624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1030/2059] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:53.717071 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e224931-baae-4a71-9f07-84aff34b2bab admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:53.718603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9e224931-baae-4a71-9f07-84aff34b2bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:53.774407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:53.799940 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e224931-baae-4a71-9f07-84aff34b2bab admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:53.812564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e906d9f-6327-436b-9712-4e6035b42b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:53.813059 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e906d9f-6327-436b-9712-4e6035b42b18 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:53.813326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e906d9f-6327-436b-9712-4e6035b42b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:53.813591 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e906d9f-6327-436b-9712-4e6035b42b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:53.823443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e906d9f-6327-436b-9712-4e6035b42b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:53.824922 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e906d9f-6327-436b-9712-4e6035b42b18 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:53.835838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1030/2060] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:54.167233 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf980a-481d-44cc-9f24-036730267884 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:54.169362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-bfdf980a-481d-44cc-9f24-036730267884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:54.201267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf980a-481d-44cc-9f24-036730267884 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:54.207502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:54.208180 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:54.208451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:54.208724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] PATH_INFO: `/v3/projects/15ad8680b0e0496480a4a5bf376b0fc5` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:54.210532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15ad8680b0e0496480a4a5bf376b0fc5)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:54.213152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:54.272848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:54.278005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ad8680b0e0496480a4a5bf376b0fc5', 'request_id': 'req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:54.290932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ad8680b0e0496480a4a5bf376b0fc5', 'request_id': 'req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:54.301418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ad8680b0e0496480a4a5bf376b0fc5', 'request_id': 'req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:54.316744 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] The token cache is being invalidate because project 15ad8680b0e0496480a4a5bf376b0fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:54.317250 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:54.318189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:54.319927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1031/2061] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:54 2022] DELETE /identity/v3/projects/15ad8680b0e0496480a4a5bf376b0fc5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:54.324383 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e906d9f-6327-436b-9712-4e6035b42b18 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:54.337805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e906d9f-6327-436b-9712-4e6035b42b18 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:54.443354 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4025c-f4f7-4ffe-a448-9edf54097ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:54.444123 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4025c-f4f7-4ffe-a448-9edf54097ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:54.444497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4025c-f4f7-4ffe-a448-9edf54097ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:54.445233 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4025c-f4f7-4ffe-a448-9edf54097ceb admin admin] PATH_INFO: `/v3/users/5c7904ca140e4e20aab377c363d6f54b` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:54.450640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4025c-f4f7-4ffe-a448-9edf54097ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7904ca140e4e20aab377c363d6f54b)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:54.453611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4025c-f4f7-4ffe-a448-9edf54097ceb admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:54.536855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d5e4025c-f4f7-4ffe-a448-9edf54097ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7904ca140e4e20aab377c363d6f54b'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:54.551908 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d5e4025c-f4f7-4ffe-a448-9edf54097ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7904ca140e4e20aab377c363d6f54b'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:54.560097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d5e4025c-f4f7-4ffe-a448-9edf54097ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7904ca140e4e20aab377c363d6f54b'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:54.561851 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d5e4025c-f4f7-4ffe-a448-9edf54097ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7904ca140e4e20aab377c363d6f54b'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:54.562536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d5e4025c-f4f7-4ffe-a448-9edf54097ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7904ca140e4e20aab377c363d6f54b'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:54.583597 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1031/2062] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:54 2022] DELETE /identity/v3/users/5c7904ca140e4e20aab377c363d6f54b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:55.235752 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:55.238929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:55.286710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47aa55-dcb6-4cb3-ad82-147ec07256e4 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:55.415027 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9479c-8e72-4f87-9e9e-814d78f552ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:55.415725 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9479c-8e72-4f87-9e9e-814d78f552ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:55.415998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9479c-8e72-4f87-9e9e-814d78f552ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:55.416876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9479c-8e72-4f87-9e9e-814d78f552ef admin admin] PATH_INFO: `/v3/projects/c067326f7e0f45bc96c8746464138b92` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:55.420213 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9479c-8e72-4f87-9e9e-814d78f552ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c067326f7e0f45bc96c8746464138b92)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:55.422009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9479c-8e72-4f87-9e9e-814d78f552ef admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:55.560492 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0ef9479c-8e72-4f87-9e9e-814d78f552ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c067326f7e0f45bc96c8746464138b92', 'request_id': 'req-0ef9479c-8e72-4f87-9e9e-814d78f552ef'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:55.579019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0ef9479c-8e72-4f87-9e9e-814d78f552ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c067326f7e0f45bc96c8746464138b92', 'request_id': 'req-0ef9479c-8e72-4f87-9e9e-814d78f552ef'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:55.624719 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0ef9479c-8e72-4f87-9e9e-814d78f552ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c067326f7e0f45bc96c8746464138b92', 'request_id': 'req-0ef9479c-8e72-4f87-9e9e-814d78f552ef'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:55.647908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0ef9479c-8e72-4f87-9e9e-814d78f552ef admin admin] The token cache is being invalidate because project c067326f7e0f45bc96c8746464138b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:55.648433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0ef9479c-8e72-4f87-9e9e-814d78f552ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:55.651313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0ef9479c-8e72-4f87-9e9e-814d78f552ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:55.658833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1032/2063] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:55 2022] DELETE /identity/v3/projects/c067326f7e0f45bc96c8746464138b92 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:55.660901 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb0ba7-501c-4a4a-8806-6c8f22b93485 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:55.661344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb0ba7-501c-4a4a-8806-6c8f22b93485 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:55.661730 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb0ba7-501c-4a4a-8806-6c8f22b93485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:55.709950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-49bb0ba7-501c-4a4a-8806-6c8f22b93485 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:55.711519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-49bb0ba7-501c-4a4a-8806-6c8f22b93485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:55.837223 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:55.871887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1032/2064] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:55.880823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ccf3b-8e4a-4dfb-ab47-fad4a4415478 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:55.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ccf3b-8e4a-4dfb-ab47-fad4a4415478 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:55.882725 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ccf3b-8e4a-4dfb-ab47-fad4a4415478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:55.953422 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-060ccf3b-8e4a-4dfb-ab47-fad4a4415478 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:55.957577 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-060ccf3b-8e4a-4dfb-ab47-fad4a4415478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:55.974135 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1033/2065] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:55.978629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb0ba7-501c-4a4a-8806-6c8f22b93485 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:55.994479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb0ba7-501c-4a4a-8806-6c8f22b93485 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:56.001253 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef01d3-09a8-4fb3-8743-50f3a097584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:56.001972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef01d3-09a8-4fb3-8743-50f3a097584d admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:56.002499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef01d3-09a8-4fb3-8743-50f3a097584d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:56.002880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef01d3-09a8-4fb3-8743-50f3a097584d admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:56.003940 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef01d3-09a8-4fb3-8743-50f3a097584d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:56.004342 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef01d3-09a8-4fb3-8743-50f3a097584d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:56.006406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef01d3-09a8-4fb3-8743-50f3a097584d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:56.029942 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1033/2066] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:56.041742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ccf3b-8e4a-4dfb-ab47-fad4a4415478 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:56.047350 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ccf3b-8e4a-4dfb-ab47-fad4a4415478 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:56.057194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbb26d-e323-43e8-93ce-5248a14be174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:56.057786 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbb26d-e323-43e8-93ce-5248a14be174 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:56.058058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbb26d-e323-43e8-93ce-5248a14be174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:56.058341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbb26d-e323-43e8-93ce-5248a14be174 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:56.059098 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbb26d-e323-43e8-93ce-5248a14be174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:56.063672 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbb26d-e323-43e8-93ce-5248a14be174 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:56.123405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1034/2067] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:56 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:56.125120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef01d3-09a8-4fb3-8743-50f3a097584d admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:56.145390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef01d3-09a8-4fb3-8743-50f3a097584d admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:56.228485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba6f3b-1c57-49af-aa52-0ac8e5bfa9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:56.229132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba6f3b-1c57-49af-aa52-0ac8e5bfa9cd admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:56.229408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba6f3b-1c57-49af-aa52-0ac8e5bfa9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:56.229674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba6f3b-1c57-49af-aa52-0ac8e5bfa9cd admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:56.230426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba6f3b-1c57-49af-aa52-0ac8e5bfa9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:56.232565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba6f3b-1c57-49af-aa52-0ac8e5bfa9cd admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:56.270550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1034/2068] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:56 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:56.275170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbb26d-e323-43e8-93ce-5248a14be174 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:56.286664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbb26d-e323-43e8-93ce-5248a14be174 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:56.291806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b1cb8-45ac-4a54-97a2-9c81272592f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:56.292780 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b1cb8-45ac-4a54-97a2-9c81272592f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:56.293056 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b1cb8-45ac-4a54-97a2-9c81272592f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:56.293327 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b1cb8-45ac-4a54-97a2-9c81272592f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:56.294012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b1cb8-45ac-4a54-97a2-9c81272592f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:56.295667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b1cb8-45ac-4a54-97a2-9c81272592f1 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:56.307007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1035/2069] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:26:56.311934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba6f3b-1c57-49af-aa52-0ac8e5bfa9cd admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:56.322866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba6f3b-1c57-49af-aa52-0ac8e5bfa9cd admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:56.331021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fafa9-98b8-4ccf-98a5-dddfb97595fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:56.331842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fafa9-98b8-4ccf-98a5-dddfb97595fc admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:56.332129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fafa9-98b8-4ccf-98a5-dddfb97595fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:56.332402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fafa9-98b8-4ccf-98a5-dddfb97595fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:56.333072 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fafa9-98b8-4ccf-98a5-dddfb97595fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:56.333241 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b1cb8-45ac-4a54-97a2-9c81272592f1 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:56.334712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fafa9-98b8-4ccf-98a5-dddfb97595fc admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:56.339463 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7c8b1cb8-45ac-4a54-97a2-9c81272592f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:56.351404 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1035/2070] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:56.354956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b1cb8-45ac-4a54-97a2-9c81272592f1 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:56.358733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fafa9-98b8-4ccf-98a5-dddfb97595fc admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:56.359987 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6367c2-88c9-40fc-8d14-79eb0b41be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:56.360641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6367c2-88c9-40fc-8d14-79eb0b41be1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:56.360921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6367c2-88c9-40fc-8d14-79eb0b41be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:56.361191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6367c2-88c9-40fc-8d14-79eb0b41be1d admin admin] PATH_INFO: `/v3/users/fafc2fe26b464ef8b109095f735c23ca` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:56.362537 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6367c2-88c9-40fc-8d14-79eb0b41be1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fafc2fe26b464ef8b109095f735c23ca)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:56.364502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6367c2-88c9-40fc-8d14-79eb0b41be1d admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:56.372381 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fafa9-98b8-4ccf-98a5-dddfb97595fc admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:56.377570 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883d903-aa6c-47e4-a667-2aafe4c55f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:56.378234 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883d903-aa6c-47e4-a667-2aafe4c55f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:56.378511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883d903-aa6c-47e4-a667-2aafe4c55f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:56.378785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883d903-aa6c-47e4-a667-2aafe4c55f3b admin admin] PATH_INFO: `/v3/projects/1abe75e4370c45b6b802165e7c559252/users/bfa60d9bb5474f5baf0ed87f1438813e/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:56.382786 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:56.401179 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883d903-aa6c-47e4-a667-2aafe4c55f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1abe75e4370c45b6b802165e7c559252, user_id=bfa60d9bb5474f5baf0ed87f1438813e, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:56.404488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883d903-aa6c-47e4-a667-2aafe4c55f3b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:56.425639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1036/2071] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:56 2022] PUT /identity/v3/projects/1abe75e4370c45b6b802165e7c559252/users/bfa60d9bb5474f5baf0ed87f1438813e/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:56.428731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-9f6367c2-88c9-40fc-8d14-79eb0b41be1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fafc2fe26b464ef8b109095f735c23ca'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:56.440792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-9f6367c2-88c9-40fc-8d14-79eb0b41be1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fafc2fe26b464ef8b109095f735c23ca'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:56.443056 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-9f6367c2-88c9-40fc-8d14-79eb0b41be1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fafc2fe26b464ef8b109095f735c23ca'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:56.444329 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-9f6367c2-88c9-40fc-8d14-79eb0b41be1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fafc2fe26b464ef8b109095f735c23ca'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:56.445551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe99f-cb76-4013-8ba7-fe0e1d4b0f38 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:56.446007 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe99f-cb76-4013-8ba7-fe0e1d4b0f38 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:56.446454 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe99f-cb76-4013-8ba7-fe0e1d4b0f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:56.469563 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-9f6367c2-88c9-40fc-8d14-79eb0b41be1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fafc2fe26b464ef8b109095f735c23ca'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:56.491388 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1036/2072] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:56 2022] DELETE /identity/v3/users/fafc2fe26b464ef8b109095f735c23ca => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:56.492353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-9dafe99f-cb76-4013-8ba7-fe0e1d4b0f38 None None] MFA Rules not processed for user `bfa60d9bb5474f5baf0ed87f1438813e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:56.493659 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9dafe99f-cb76-4013-8ba7-fe0e1d4b0f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:56.495845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715778f-1b2c-45b5-abf3-419d90743b73 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:56.496124 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715778f-1b2c-45b5-abf3-419d90743b73 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:56.496399 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715778f-1b2c-45b5-abf3-419d90743b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:56.518555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-e715778f-1b2c-45b5-abf3-419d90743b73 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:56.520141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e715778f-1b2c-45b5-abf3-419d90743b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:56.560177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1037/2073] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:56.564950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafe99f-cb76-4013-8ba7-fe0e1d4b0f38 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:56.566395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9dafe99f-cb76-4013-8ba7-fe0e1d4b0f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:56.580716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1037/2074] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:56.590938 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715778f-1b2c-45b5-abf3-419d90743b73 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:56.592669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e715778f-1b2c-45b5-abf3-419d90743b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:56.604946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:56.639757 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafe99f-cb76-4013-8ba7-fe0e1d4b0f38 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:56.646082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2bc5d-8615-459b-92b7-23e8a33bdafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:56.646775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2bc5d-8615-459b-92b7-23e8a33bdafb admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:56.647090 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2bc5d-8615-459b-92b7-23e8a33bdafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:56.647355 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2bc5d-8615-459b-92b7-23e8a33bdafb admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:56.647985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2bc5d-8615-459b-92b7-23e8a33bdafb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:56.649934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2bc5d-8615-459b-92b7-23e8a33bdafb admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:56.655474 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715778f-1b2c-45b5-abf3-419d90743b73 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:56.661504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa8488-961c-41df-baef-3c74c6b1e139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:56.662205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa8488-961c-41df-baef-3c74c6b1e139 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:56.662542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa8488-961c-41df-baef-3c74c6b1e139 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:56.662883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa8488-961c-41df-baef-3c74c6b1e139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:56.675040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa8488-961c-41df-baef-3c74c6b1e139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:56.679159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa8488-961c-41df-baef-3c74c6b1e139 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:56.690157 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1038/2075] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:56 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:26:56.695522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2bc5d-8615-459b-92b7-23e8a33bdafb admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:56.699768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1038/2076] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:56.810930 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2bc5d-8615-459b-92b7-23e8a33bdafb admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:56.817004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d25c2f-d6fc-4e19-b833-a9e9f8125ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:56.817945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d25c2f-d6fc-4e19-b833-a9e9f8125ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:56.818224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d25c2f-d6fc-4e19-b833-a9e9f8125ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:56.818614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d25c2f-d6fc-4e19-b833-a9e9f8125ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:56.819717 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d25c2f-d6fc-4e19-b833-a9e9f8125ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:56.821800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d25c2f-d6fc-4e19-b833-a9e9f8125ea8 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:56.875246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1039/2077] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:56 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:56.879102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa8488-961c-41df-baef-3c74c6b1e139 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:56.889199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa8488-961c-41df-baef-3c74c6b1e139 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:56.894144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c31b1-7873-4d05-80e2-a4d3918a20c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:56.895173 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c31b1-7873-4d05-80e2-a4d3918a20c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:56.895173 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c31b1-7873-4d05-80e2-a4d3918a20c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:56.895384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c31b1-7873-4d05-80e2-a4d3918a20c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:56.895962 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c31b1-7873-4d05-80e2-a4d3918a20c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:56.897600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c31b1-7873-4d05-80e2-a4d3918a20c3 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:56.916462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1039/2078] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:56.921263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d25c2f-d6fc-4e19-b833-a9e9f8125ea8 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:56.934247 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d25c2f-d6fc-4e19-b833-a9e9f8125ea8 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:56.939870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167fb4c-ee03-4c31-b594-2a38430ac224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:56.940567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167fb4c-ee03-4c31-b594-2a38430ac224 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:56.940874 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167fb4c-ee03-4c31-b594-2a38430ac224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:56.941117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167fb4c-ee03-4c31-b594-2a38430ac224 admin admin] PATH_INFO: `/v3/projects/9a392beab4e04cf2abe8dfef9bf0e052/users/2de413aa0a6145859e9094bfcd473459/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:56.961758 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167fb4c-ee03-4c31-b594-2a38430ac224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a392beab4e04cf2abe8dfef9bf0e052, user_id=2de413aa0a6145859e9094bfcd473459, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:56.966522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167fb4c-ee03-4c31-b594-2a38430ac224 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:56.985191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1040/2079] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:56 2022] PUT /identity/v3/projects/9a392beab4e04cf2abe8dfef9bf0e052/users/2de413aa0a6145859e9094bfcd473459/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:56.990931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c31b1-7873-4d05-80e2-a4d3918a20c3 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:57.018230 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c31b1-7873-4d05-80e2-a4d3918a20c3 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:57.082242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:57.093549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167fb4c-ee03-4c31-b594-2a38430ac224 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:57.096080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a167fb4c-ee03-4c31-b594-2a38430ac224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:57.149633 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8eb71-2f91-45c7-940e-ee722585b1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:57.150288 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8eb71-2f91-45c7-940e-ee722585b1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:57.150563 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8eb71-2f91-45c7-940e-ee722585b1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:57.150878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8eb71-2f91-45c7-940e-ee722585b1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:57.151548 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8eb71-2f91-45c7-940e-ee722585b1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:57.153312 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8eb71-2f91-45c7-940e-ee722585b1c8 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:57.183204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1040/2080] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:57.183204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8eb71-2f91-45c7-940e-ee722585b1c8 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:57.183204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c3e8eb71-2f91-45c7-940e-ee722585b1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:57.197718 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8eb71-2f91-45c7-940e-ee722585b1c8 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:57.208076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167fb4c-ee03-4c31-b594-2a38430ac224 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:57.209512 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:57.210175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:57.210458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:57.210889 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] PATH_INFO: `/v3/projects/678d8f6219004ee18adb95cf9da719a6` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:57.213589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb8052-e581-4636-bd5c-42d34131a0e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:57.213992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb8052-e581-4636-bd5c-42d34131a0e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:57.214324 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb8052-e581-4636-bd5c-42d34131a0e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:57.214549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=678d8f6219004ee18adb95cf9da719a6)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:57.214786 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb8052-e581-4636-bd5c-42d34131a0e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:57.216732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-40eb8052-e581-4636-bd5c-42d34131a0e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:57.218678 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:57.272509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:57.304094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '678d8f6219004ee18adb95cf9da719a6', 'request_id': 'req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:57.318580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb8052-e581-4636-bd5c-42d34131a0e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:57.318580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb8052-e581-4636-bd5c-42d34131a0e1 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:57.318777 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '678d8f6219004ee18adb95cf9da719a6', 'request_id': 'req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:57.323775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1041/2081] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:57.328359 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '678d8f6219004ee18adb95cf9da719a6', 'request_id': 'req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:57.334483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb8052-e581-4636-bd5c-42d34131a0e1 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:57.343530 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] The token cache is being invalidate because project 678d8f6219004ee18adb95cf9da719a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:57.343817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:57.345231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:57.347640 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1041/2082] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:57 2022] DELETE /identity/v3/projects/678d8f6219004ee18adb95cf9da719a6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:57.350767 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb8052-e581-4636-bd5c-42d34131a0e1 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:57.352401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:57.353820 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:57.451697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b7cc7-eb78-4883-bd62-4da0199025d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:57.452550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b7cc7-eb78-4883-bd62-4da0199025d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:57.452958 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b7cc7-eb78-4883-bd62-4da0199025d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:57.453395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b7cc7-eb78-4883-bd62-4da0199025d5 admin admin] PATH_INFO: `/v3/projects/9a392beab4e04cf2abe8dfef9bf0e052/users/2de413aa0a6145859e9094bfcd473459/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:57.455448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b7cc7-eb78-4883-bd62-4da0199025d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a392beab4e04cf2abe8dfef9bf0e052, user_id=2de413aa0a6145859e9094bfcd473459, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:57.458349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b7cc7-eb78-4883-bd62-4da0199025d5 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:57.458934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a87ef7-f1ee-4d23-8b80-2a05a510ff30 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:57.469824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be91649-ae5f-476f-8d37-c513b11a55eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:57.469824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be91649-ae5f-476f-8d37-c513b11a55eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:57.469824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be91649-ae5f-476f-8d37-c513b11a55eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:57.469824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be91649-ae5f-476f-8d37-c513b11a55eb admin admin] PATH_INFO: `/v3/users/d7c49251f7ff4968a1f1be444c873861` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:57.470522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be91649-ae5f-476f-8d37-c513b11a55eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c49251f7ff4968a1f1be444c873861)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:57.470946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be91649-ae5f-476f-8d37-c513b11a55eb admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:57.477717 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1042/2083] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:26:57 2022] PUT /identity/v3/projects/9a392beab4e04cf2abe8dfef9bf0e052/users/2de413aa0a6145859e9094bfcd473459/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:57.490050 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eac346-e95b-4dc6-a569-c660652227c1 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:57.490331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eac346-e95b-4dc6-a569-c660652227c1 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:57.490589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eac346-e95b-4dc6-a569-c660652227c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:57.524749 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-78eac346-e95b-4dc6-a569-c660652227c1 None None] MFA Rules not processed for user `2de413aa0a6145859e9094bfcd473459`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:57.526394 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-78eac346-e95b-4dc6-a569-c660652227c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:57.547269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-6be91649-ae5f-476f-8d37-c513b11a55eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c49251f7ff4968a1f1be444c873861'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:57.550179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:57.561319 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-6be91649-ae5f-476f-8d37-c513b11a55eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c49251f7ff4968a1f1be444c873861'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:57.562439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-6be91649-ae5f-476f-8d37-c513b11a55eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c49251f7ff4968a1f1be444c873861'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:57.563350 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-6be91649-ae5f-476f-8d37-c513b11a55eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c49251f7ff4968a1f1be444c873861'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:57.583561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-6be91649-ae5f-476f-8d37-c513b11a55eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c49251f7ff4968a1f1be444c873861'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:57.602542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1042/2084] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:57 2022] DELETE /identity/v3/users/d7c49251f7ff4968a1f1be444c873861 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:57.616757 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1043/2085] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:26:57.630781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be91649-ae5f-476f-8d37-c513b11a55eb admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:57.632486 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6be91649-ae5f-476f-8d37-c513b11a55eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:57.796444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be91649-ae5f-476f-8d37-c513b11a55eb admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:57.802955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c800b-a7e8-4e9b-9852-caf711dda8c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:57.804640 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c800b-a7e8-4e9b-9852-caf711dda8c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:57.804640 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c800b-a7e8-4e9b-9852-caf711dda8c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:57.804927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c800b-a7e8-4e9b-9852-caf711dda8c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:57.998175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c800b-a7e8-4e9b-9852-caf711dda8c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:58.000490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c800b-a7e8-4e9b-9852-caf711dda8c3 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:58.018702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1043/2086] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:58.062878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eac346-e95b-4dc6-a569-c660652227c1 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:58.070600 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-78eac346-e95b-4dc6-a569-c660652227c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:58.091203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c800b-a7e8-4e9b-9852-caf711dda8c3 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:58.093413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-1f8c800b-a7e8-4e9b-9852-caf711dda8c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:58.242702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:58.310133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eac346-e95b-4dc6-a569-c660652227c1 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:58.430457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c800b-a7e8-4e9b-9852-caf711dda8c3 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:58.465602 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:58.465881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:58.471304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:58.471673 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] PATH_INFO: `/v3/projects/76a7d02afb304aec8eb68137e8b007fb` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:58.486111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a7d02afb304aec8eb68137e8b007fb)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:58.486355 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba524e4-70d7-43af-a5f3-0f6b9413f2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:58.488586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba524e4-70d7-43af-a5f3-0f6b9413f2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:58.493008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:58.493584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba524e4-70d7-43af-a5f3-0f6b9413f2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:58.494297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba524e4-70d7-43af-a5f3-0f6b9413f2aa admin admin] PATH_INFO: `/v3/users/bfa60d9bb5474f5baf0ed87f1438813e` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:58.495898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba524e4-70d7-43af-a5f3-0f6b9413f2aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa60d9bb5474f5baf0ed87f1438813e)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:58.503369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba524e4-70d7-43af-a5f3-0f6b9413f2aa admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:58.571988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:58.633270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a7d02afb304aec8eb68137e8b007fb', 'request_id': 'req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:58.645647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a7d02afb304aec8eb68137e8b007fb', 'request_id': 'req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:58.655705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a7d02afb304aec8eb68137e8b007fb', 'request_id': 'req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:58.683226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] The token cache is being invalidate because project 76a7d02afb304aec8eb68137e8b007fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:58.684129 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:58.685525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:58.697460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1044/2087] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:58 2022] DELETE /identity/v3/projects/76a7d02afb304aec8eb68137e8b007fb => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:58.697991 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-8ba524e4-70d7-43af-a5f3-0f6b9413f2aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa60d9bb5474f5baf0ed87f1438813e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:58.698530 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:58.700614 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:58.720777 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-8ba524e4-70d7-43af-a5f3-0f6b9413f2aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa60d9bb5474f5baf0ed87f1438813e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:58.736033 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-8ba524e4-70d7-43af-a5f3-0f6b9413f2aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa60d9bb5474f5baf0ed87f1438813e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:58.737174 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-8ba524e4-70d7-43af-a5f3-0f6b9413f2aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa60d9bb5474f5baf0ed87f1438813e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:58.738274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-8ba524e4-70d7-43af-a5f3-0f6b9413f2aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa60d9bb5474f5baf0ed87f1438813e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:58.760508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1044/2088] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:58 2022] DELETE /identity/v3/users/bfa60d9bb5474f5baf0ed87f1438813e => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:26:58.761985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34766b5b-7ea0-470c-80f2-364aa77456bd None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:58.762359 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34766b5b-7ea0-470c-80f2-364aa77456bd None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:58.762778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34766b5b-7ea0-470c-80f2-364aa77456bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:58.788348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-34766b5b-7ea0-470c-80f2-364aa77456bd None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:58.790178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-34766b5b-7ea0-470c-80f2-364aa77456bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:58.889173 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ce1fb-f5bb-47d1-a3d8-6cd54b6d85b9 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:58.963504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1045/2089] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:58.974678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b359c-da31-417f-8268-9c072e06b94f None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:58.975155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b359c-da31-417f-8268-9c072e06b94f None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:58.975519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b359c-da31-417f-8268-9c072e06b94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:59.010700 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b68b359c-da31-417f-8268-9c072e06b94f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:59.018075 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b68b359c-da31-417f-8268-9c072e06b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:59.040858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1046/2090] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:59.042125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca956b-9e22-4eb9-b06e-5859f87cac41 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:59.042445 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca956b-9e22-4eb9-b06e-5859f87cac41 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:59.043942 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca956b-9e22-4eb9-b06e-5859f87cac41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:59.082295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-34ca956b-9e22-4eb9-b06e-5859f87cac41 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:59.083798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-34ca956b-9e22-4eb9-b06e-5859f87cac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:59.093564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1047/2091] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:59.098593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca956b-9e22-4eb9-b06e-5859f87cac41 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:59.100122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-34ca956b-9e22-4eb9-b06e-5859f87cac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:59.107108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:59.109927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdac019-92b5-4d88-9264-6b64a6c78445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:59.111430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdac019-92b5-4d88-9264-6b64a6c78445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:59.113400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdac019-92b5-4d88-9264-6b64a6c78445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:59.113960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdac019-92b5-4d88-9264-6b64a6c78445 admin admin] PATH_INFO: `/v3/users/f1cb021d6f664a8c989889a4bef8ea2b` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:59.116970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdac019-92b5-4d88-9264-6b64a6c78445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1cb021d6f664a8c989889a4bef8ea2b)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:59.119474 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdac019-92b5-4d88-9264-6b64a6c78445 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:59.217929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4fdac019-92b5-4d88-9264-6b64a6c78445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1cb021d6f664a8c989889a4bef8ea2b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:59.231302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4fdac019-92b5-4d88-9264-6b64a6c78445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1cb021d6f664a8c989889a4bef8ea2b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:59.232534 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4fdac019-92b5-4d88-9264-6b64a6c78445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1cb021d6f664a8c989889a4bef8ea2b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:59.235460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4fdac019-92b5-4d88-9264-6b64a6c78445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1cb021d6f664a8c989889a4bef8ea2b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:59.237891 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:59.245858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca956b-9e22-4eb9-b06e-5859f87cac41 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:59.251586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0de762-311e-4bd2-a57a-77a11eb38018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:59.252309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de762-311e-4bd2-a57a-77a11eb38018 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:59.253523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de762-311e-4bd2-a57a-77a11eb38018 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:59.253800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de762-311e-4bd2-a57a-77a11eb38018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:59.256938 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-4d0de762-311e-4bd2-a57a-77a11eb38018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:59.275891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0de762-311e-4bd2-a57a-77a11eb38018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:59.279191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0de762-311e-4bd2-a57a-77a11eb38018 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:59.292467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4fdac019-92b5-4d88-9264-6b64a6c78445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1cb021d6f664a8c989889a4bef8ea2b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:59.309393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1048/2092] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:59.310707 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0de762-311e-4bd2-a57a-77a11eb38018 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:59.313457 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-4d0de762-311e-4bd2-a57a-77a11eb38018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:59.331735 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1045/2093] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:26:58 2022] DELETE /identity/v3/users/f1cb021d6f664a8c989889a4bef8ea2b => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:26:59.337724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc3046-19b0-47e1-a139-3c5f3a44f98b None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:59.338013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc3046-19b0-47e1-a139-3c5f3a44f98b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:59.338620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc3046-19b0-47e1-a139-3c5f3a44f98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:59.359685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0de762-311e-4bd2-a57a-77a11eb38018 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:59.391974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-b6bc3046-19b0-47e1-a139-3c5f3a44f98b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:59.392613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b6bc3046-19b0-47e1-a139-3c5f3a44f98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:59.509956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1046/2094] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:59.513738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ad398-b644-43c1-8f0d-fa3a13887973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:59.517191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ad398-b644-43c1-8f0d-fa3a13887973 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:59.517705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ad398-b644-43c1-8f0d-fa3a13887973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:59.518901 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ad398-b644-43c1-8f0d-fa3a13887973 admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:59.522443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ad398-b644-43c1-8f0d-fa3a13887973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:26:59.523299 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ad398-b644-43c1-8f0d-fa3a13887973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:59.526807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc3046-19b0-47e1-a139-3c5f3a44f98b None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:59.527845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ad398-b644-43c1-8f0d-fa3a13887973 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:59.528984 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b6bc3046-19b0-47e1-a139-3c5f3a44f98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:59.563008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1049/2095] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:26:59.568331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ad398-b644-43c1-8f0d-fa3a13887973 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:59.592851 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ad398-b644-43c1-8f0d-fa3a13887973 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:59.598730 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cb189-39d0-4af5-b810-77e37baa6e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:59.599563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb189-39d0-4af5-b810-77e37baa6e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:59.599985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb189-39d0-4af5-b810-77e37baa6e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:59.600352 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb189-39d0-4af5-b810-77e37baa6e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:59.601120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cb189-39d0-4af5-b810-77e37baa6e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:59.603243 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cb189-39d0-4af5-b810-77e37baa6e95 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:59.619322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc3046-19b0-47e1-a139-3c5f3a44f98b None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:59.624078 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480ac47-e0d9-4c4f-9c64-fe13e882159d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:59.624726 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480ac47-e0d9-4c4f-9c64-fe13e882159d service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:59.625029 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480ac47-e0d9-4c4f-9c64-fe13e882159d service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:59.625275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480ac47-e0d9-4c4f-9c64-fe13e882159d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:59.637873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480ac47-e0d9-4c4f-9c64-fe13e882159d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:59.639547 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480ac47-e0d9-4c4f-9c64-fe13e882159d service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:59.654805 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1047/2096] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:26:59.663712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1050/2097] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:26:59 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:59.665140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480ac47-e0d9-4c4f-9c64-fe13e882159d service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:59.681598 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480ac47-e0d9-4c4f-9c64-fe13e882159d service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:59.776586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cb189-39d0-4af5-b810-77e37baa6e95 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:59.779280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6d8cb189-39d0-4af5-b810-77e37baa6e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:59.785065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da1f62-003f-4e86-9e16-efd1dbe49d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:59.786928 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da1f62-003f-4e86-9e16-efd1dbe49d4f admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:59.787344 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da1f62-003f-4e86-9e16-efd1dbe49d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:59.787686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da1f62-003f-4e86-9e16-efd1dbe49d4f admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:59.788605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da1f62-003f-4e86-9e16-efd1dbe49d4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:59.791412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da1f62-003f-4e86-9e16-efd1dbe49d4f admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:59.797826 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cb189-39d0-4af5-b810-77e37baa6e95 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:59.807403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:59.808597 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:59.809907 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:59.810478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] PATH_INFO: `/v3/projects/1abe75e4370c45b6b802165e7c559252` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:59.812261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1abe75e4370c45b6b802165e7c559252)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:59.815783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:59.835883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1048/2098] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:26:59 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:26:59.839956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da1f62-003f-4e86-9e16-efd1dbe49d4f admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:59.847670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:59.853554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da1f62-003f-4e86-9e16-efd1dbe49d4f admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:59.871663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773ac05-9557-4197-98fa-c196b63ba45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:59.872710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773ac05-9557-4197-98fa-c196b63ba45a admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:59.873185 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773ac05-9557-4197-98fa-c196b63ba45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:59.873336 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773ac05-9557-4197-98fa-c196b63ba45a admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:59.875000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773ac05-9557-4197-98fa-c196b63ba45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:59.884102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773ac05-9557-4197-98fa-c196b63ba45a admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:59.907067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1049/2099] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:26:59.913166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773ac05-9557-4197-98fa-c196b63ba45a admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:59.921078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1abe75e4370c45b6b802165e7c559252', 'request_id': 'req-5bc8abf9-1b06-4323-b2ee-ef3735af4872'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:59.930078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1abe75e4370c45b6b802165e7c559252', 'request_id': 'req-5bc8abf9-1b06-4323-b2ee-ef3735af4872'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:59.936374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773ac05-9557-4197-98fa-c196b63ba45a admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:59.950272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1abe75e4370c45b6b802165e7c559252', 'request_id': 'req-5bc8abf9-1b06-4323-b2ee-ef3735af4872'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:26:59.976128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:59.991389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] The token cache is being invalidate because project 1abe75e4370c45b6b802165e7c559252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:26:59.995761 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.000631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.002682 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1051/2100] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:26:59 2022] DELETE /identity/v3/projects/1abe75e4370c45b6b802165e7c559252 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:00.007058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:00.009739 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:00.050675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde69fb1-28dc-4086-b924-573fd80127a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:00.051348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde69fb1-28dc-4086-b924-573fd80127a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:00.051634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde69fb1-28dc-4086-b924-573fd80127a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:00.051906 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde69fb1-28dc-4086-b924-573fd80127a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:00.052656 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde69fb1-28dc-4086-b924-573fd80127a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:00.054617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde69fb1-28dc-4086-b924-573fd80127a5 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:00.075621 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1050/2101] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:00.078067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde69fb1-28dc-4086-b924-573fd80127a5 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:00.080508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-fde69fb1-28dc-4086-b924-573fd80127a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:00.116365 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde69fb1-28dc-4086-b924-573fd80127a5 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:00.123875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049999a-b35f-4919-8f32-97fc7caedbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:00.125067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049999a-b35f-4919-8f32-97fc7caedbdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:00.125641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049999a-b35f-4919-8f32-97fc7caedbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:00.126107 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049999a-b35f-4919-8f32-97fc7caedbdb admin admin] PATH_INFO: `/v3/projects/907bcdf49e274ef3b4557361817bafff/users/b8ce0177300b4e7f8fc2014ede35e8ff/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:00.152598 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8abf9-1b06-4323-b2ee-ef3735af4872 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:00.158115 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049999a-b35f-4919-8f32-97fc7caedbdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=907bcdf49e274ef3b4557361817bafff, user_id=b8ce0177300b4e7f8fc2014ede35e8ff, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:00.161331 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049999a-b35f-4919-8f32-97fc7caedbdb admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:00.161451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca44bb7-f076-4f4d-8aed-7f86d5206be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:00.163192 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca44bb7-f076-4f4d-8aed-7f86d5206be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:00.165877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca44bb7-f076-4f4d-8aed-7f86d5206be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:00.166289 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca44bb7-f076-4f4d-8aed-7f86d5206be3 admin admin] PATH_INFO: `/v3/users/2de413aa0a6145859e9094bfcd473459` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:00.168039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca44bb7-f076-4f4d-8aed-7f86d5206be3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de413aa0a6145859e9094bfcd473459)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:00.170643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca44bb7-f076-4f4d-8aed-7f86d5206be3 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:00.189113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1051/2102] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:00 2022] PUT /identity/v3/projects/907bcdf49e274ef3b4557361817bafff/users/b8ce0177300b4e7f8fc2014ede35e8ff/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:00.203008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557f17f-2137-42dc-91d0-943f421ef7eb None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:00.203302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557f17f-2137-42dc-91d0-943f421ef7eb None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:00.203554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557f17f-2137-42dc-91d0-943f421ef7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:00.259504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9ca44bb7-f076-4f4d-8aed-7f86d5206be3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de413aa0a6145859e9094bfcd473459'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.318129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9ca44bb7-f076-4f4d-8aed-7f86d5206be3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de413aa0a6145859e9094bfcd473459'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.324442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-8557f17f-2137-42dc-91d0-943f421ef7eb None None] MFA Rules not processed for user `b8ce0177300b4e7f8fc2014ede35e8ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:00.327848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-8557f17f-2137-42dc-91d0-943f421ef7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:00.331164 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9ca44bb7-f076-4f4d-8aed-7f86d5206be3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de413aa0a6145859e9094bfcd473459'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.333035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9ca44bb7-f076-4f4d-8aed-7f86d5206be3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de413aa0a6145859e9094bfcd473459'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.335097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-9ca44bb7-f076-4f4d-8aed-7f86d5206be3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de413aa0a6145859e9094bfcd473459'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.361813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1052/2103] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:00 2022] DELETE /identity/v3/users/2de413aa0a6145859e9094bfcd473459 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:00.362475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca44bb7-f076-4f4d-8aed-7f86d5206be3 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:00.363974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9ca44bb7-f076-4f4d-8aed-7f86d5206be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:00.425393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1052/2104] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:27:00.441933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557f17f-2137-42dc-91d0-943f421ef7eb None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:00.446206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-8557f17f-2137-42dc-91d0-943f421ef7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:00.494170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca44bb7-f076-4f4d-8aed-7f86d5206be3 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:00.500237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:00.500947 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:00.501223 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:00.501496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] PATH_INFO: `/v3/projects/d940675752e240c2b24cc7969ef034e6` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:00.502933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d940675752e240c2b24cc7969ef034e6)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:00.504977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:00.542553 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:00.545316 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557f17f-2137-42dc-91d0-943f421ef7eb None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:00.556315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:00.635543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd940675752e240c2b24cc7969ef034e6', 'request_id': 'req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.646361 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd940675752e240c2b24cc7969ef034e6', 'request_id': 'req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.665435 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee9a2d-774a-452d-b8b7-cc18756d5905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:00.666548 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee9a2d-774a-452d-b8b7-cc18756d5905 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:00.667044 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee9a2d-774a-452d-b8b7-cc18756d5905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:00.668387 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee9a2d-774a-452d-b8b7-cc18756d5905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:00.673225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd940675752e240c2b24cc7969ef034e6', 'request_id': 'req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.715170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] The token cache is being invalidate because project d940675752e240c2b24cc7969ef034e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:00.715496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.717939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.721109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1053/2105] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:00 2022] DELETE /identity/v3/projects/d940675752e240c2b24cc7969ef034e6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:00.725635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:00.728348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:00.827998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee9a2d-774a-452d-b8b7-cc18756d5905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:00.830075 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee9a2d-774a-452d-b8b7-cc18756d5905 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:00.843200 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1053/2106] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:00.844096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee9a2d-774a-452d-b8b7-cc18756d5905 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:00.846143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6eee9a2d-774a-452d-b8b7-cc18756d5905 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:00.858856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bc7e0-4bfc-46a0-8b51-7bfde60d2f34 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:00.861767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee9a2d-774a-452d-b8b7-cc18756d5905 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:00.868036 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d2186-c022-453e-9ff2-4d246192dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:00.869163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d2186-c022-453e-9ff2-4d246192dc1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:00.869589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:00.869705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d2186-c022-453e-9ff2-4d246192dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:00.870111 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d2186-c022-453e-9ff2-4d246192dc1b admin admin] PATH_INFO: `/v3/users/a1b03a18759641b2b6c2e8446cdf9724` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:00.870249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:00.870515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:00.870788 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] PATH_INFO: `/v3/projects/9a392beab4e04cf2abe8dfef9bf0e052` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:00.872049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a392beab4e04cf2abe8dfef9bf0e052)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:00.872437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d2186-c022-453e-9ff2-4d246192dc1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b03a18759641b2b6c2e8446cdf9724)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:00.874436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:00.876380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d2186-c022-453e-9ff2-4d246192dc1b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:00.932507 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a392beab4e04cf2abe8dfef9bf0e052', 'request_id': 'req-53f8c09a-e06a-4b2b-acae-e9f72961838c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.939324 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-155d2186-c022-453e-9ff2-4d246192dc1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b03a18759641b2b6c2e8446cdf9724'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.942537 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a392beab4e04cf2abe8dfef9bf0e052', 'request_id': 'req-53f8c09a-e06a-4b2b-acae-e9f72961838c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.949933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a392beab4e04cf2abe8dfef9bf0e052', 'request_id': 'req-53f8c09a-e06a-4b2b-acae-e9f72961838c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.957592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-155d2186-c022-453e-9ff2-4d246192dc1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b03a18759641b2b6c2e8446cdf9724'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.964828 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] The token cache is being invalidate because project 9a392beab4e04cf2abe8dfef9bf0e052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:00.965266 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.965920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.967468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-155d2186-c022-453e-9ff2-4d246192dc1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b03a18759641b2b6c2e8446cdf9724'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.968326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-155d2186-c022-453e-9ff2-4d246192dc1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b03a18759641b2b6c2e8446cdf9724'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.969165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-155d2186-c022-453e-9ff2-4d246192dc1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b03a18759641b2b6c2e8446cdf9724'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:00.969284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1054/2107] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:00 2022] DELETE /identity/v3/projects/9a392beab4e04cf2abe8dfef9bf0e052 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:00.971082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:00.974627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:00.984580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1054/2108] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:00 2022] DELETE /identity/v3/users/a1b03a18759641b2b6c2e8446cdf9724 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:27:00.985919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df5c9f-5233-4c6f-9125-dcc859a56566 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:00.986250 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df5c9f-5233-4c6f-9125-dcc859a56566 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:00.986499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df5c9f-5233-4c6f-9125-dcc859a56566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:01.015229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b0df5c9f-5233-4c6f-9125-dcc859a56566 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:01.017455 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b0df5c9f-5233-4c6f-9125-dcc859a56566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:01.056190 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:01.065736 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:01.093984 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8c09a-e06a-4b2b-acae-e9f72961838c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:01.166329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1055/2109] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:01.177579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5ed2a-42ba-412c-92ed-0d0c531564c4 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:01.177952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5ed2a-42ba-412c-92ed-0d0c531564c4 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:01.178429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5ed2a-42ba-412c-92ed-0d0c531564c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:01.207302 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-9cd5ed2a-42ba-412c-92ed-0d0c531564c4 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:01.209073 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9cd5ed2a-42ba-412c-92ed-0d0c531564c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:01.209562 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94508c78-ca66-40e0-a8f2-570ff627aba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:01.210346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94508c78-ca66-40e0-a8f2-570ff627aba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:01.210750 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94508c78-ca66-40e0-a8f2-570ff627aba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:01.211180 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94508c78-ca66-40e0-a8f2-570ff627aba8 admin admin] PATH_INFO: `/v3/users/b8ce0177300b4e7f8fc2014ede35e8ff` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:01.212987 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94508c78-ca66-40e0-a8f2-570ff627aba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ce0177300b4e7f8fc2014ede35e8ff)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:01.215073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94508c78-ca66-40e0-a8f2-570ff627aba8 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:01.223848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1056/2110] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:01.228545 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5ed2a-42ba-412c-92ed-0d0c531564c4 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:01.246695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5ed2a-42ba-412c-92ed-0d0c531564c4 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:01.256915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464853d8-c5df-43a3-8997-865f6641e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:01.257416 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464853d8-c5df-43a3-8997-865f6641e429 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:01.257701 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464853d8-c5df-43a3-8997-865f6641e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:01.257973 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464853d8-c5df-43a3-8997-865f6641e429 admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:01.258991 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464853d8-c5df-43a3-8997-865f6641e429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:27:01.259298 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464853d8-c5df-43a3-8997-865f6641e429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:01.264233 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464853d8-c5df-43a3-8997-865f6641e429 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:01.299466 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1057/2111] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:27:01.300759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464853d8-c5df-43a3-8997-865f6641e429 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:01.315393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464853d8-c5df-43a3-8997-865f6641e429 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:01.315630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-94508c78-ca66-40e0-a8f2-570ff627aba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ce0177300b4e7f8fc2014ede35e8ff'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:01.326707 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e9077-3951-4b19-b216-1735a22bad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:01.327688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e9077-3951-4b19-b216-1735a22bad39 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:01.328111 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e9077-3951-4b19-b216-1735a22bad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:01.328517 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e9077-3951-4b19-b216-1735a22bad39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:01.329737 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e9077-3951-4b19-b216-1735a22bad39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:01.334094 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e9077-3951-4b19-b216-1735a22bad39 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:01.342395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-94508c78-ca66-40e0-a8f2-570ff627aba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ce0177300b4e7f8fc2014ede35e8ff'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:01.343573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-94508c78-ca66-40e0-a8f2-570ff627aba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ce0177300b4e7f8fc2014ede35e8ff'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:01.344271 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-94508c78-ca66-40e0-a8f2-570ff627aba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ce0177300b4e7f8fc2014ede35e8ff'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:01.372664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-94508c78-ca66-40e0-a8f2-570ff627aba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ce0177300b4e7f8fc2014ede35e8ff'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:01.390250 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1055/2112] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:00 2022] DELETE /identity/v3/users/b8ce0177300b4e7f8fc2014ede35e8ff => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:01.394359 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1058/2113] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:27:01 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:01.399728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4259c-04dc-49ed-987b-4e91e62ade36 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:01.400048 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4259c-04dc-49ed-987b-4e91e62ade36 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:01.400315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4259c-04dc-49ed-987b-4e91e62ade36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:01.410318 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e9077-3951-4b19-b216-1735a22bad39 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:01.421505 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-236e9077-3951-4b19-b216-1735a22bad39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:01.456801 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-f3b4259c-04dc-49ed-987b-4e91e62ade36 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:01.458630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f3b4259c-04dc-49ed-987b-4e91e62ade36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:01.683098 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1056/2114] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:01.684125 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4259c-04dc-49ed-987b-4e91e62ade36 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:01.686442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f3b4259c-04dc-49ed-987b-4e91e62ade36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:01.689369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e9077-3951-4b19-b216-1735a22bad39 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:01.695145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1c642-25cc-4a11-afb5-4fee40393c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:01.695829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1c642-25cc-4a11-afb5-4fee40393c8f admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:01.696114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1c642-25cc-4a11-afb5-4fee40393c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:01.696379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1c642-25cc-4a11-afb5-4fee40393c8f admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:01.697943 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1c642-25cc-4a11-afb5-4fee40393c8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:01.700277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1c642-25cc-4a11-afb5-4fee40393c8f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:01.703637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4259c-04dc-49ed-987b-4e91e62ade36 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:01.710342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:01.712042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:01.713081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:01.713370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] PATH_INFO: `/v3/projects/ea85f258def3407fa68227a5cafe8cfc` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:01.715821 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea85f258def3407fa68227a5cafe8cfc)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:01.718176 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:01.738985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1059/2115] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:27:01 2022] POST /identity/v3/users => generated 287 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:01.740883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1c642-25cc-4a11-afb5-4fee40393c8f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:01.742458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:01.743463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-dfa1c642-25cc-4a11-afb5-4fee40393c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:01.814022 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea85f258def3407fa68227a5cafe8cfc', 'request_id': 'req-538430df-4859-4fc1-a68d-52c63bc4ddf1'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:01.826008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea85f258def3407fa68227a5cafe8cfc', 'request_id': 'req-538430df-4859-4fc1-a68d-52c63bc4ddf1'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:01.835703 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea85f258def3407fa68227a5cafe8cfc', 'request_id': 'req-538430df-4859-4fc1-a68d-52c63bc4ddf1'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:01.847474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1c642-25cc-4a11-afb5-4fee40393c8f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:01.855581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] The token cache is being invalidate because project ea85f258def3407fa68227a5cafe8cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:01.855902 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:01.856790 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:01.858600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1057/2116] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:01 2022] DELETE /identity/v3/projects/ea85f258def3407fa68227a5cafe8cfc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:01.863537 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:01.865096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:01.904564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:01.948615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e7bc9-808c-4528-ba7b-246d1d2a1fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:01.950756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e7bc9-808c-4528-ba7b-246d1d2a1fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:01.951175 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e7bc9-808c-4528-ba7b-246d1d2a1fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:01.951506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e7bc9-808c-4528-ba7b-246d1d2a1fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:01.954929 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-835e7bc9-808c-4528-ba7b-246d1d2a1fb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:02.041299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538430df-4859-4fc1-a68d-52c63bc4ddf1 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:02.050291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59758e8-3afb-4c35-9cb1-a937631fdc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:02.052089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59758e8-3afb-4c35-9cb1-a937631fdc34 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.052478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59758e8-3afb-4c35-9cb1-a937631fdc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.053454 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59758e8-3afb-4c35-9cb1-a937631fdc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.054714 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59758e8-3afb-4c35-9cb1-a937631fdc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:02.056793 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59758e8-3afb-4c35-9cb1-a937631fdc34 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:02.082130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1058/2117] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:02.083296 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057e86-0381-4b10-9619-742917aa7cfd None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.083586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057e86-0381-4b10-9619-742917aa7cfd None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.083864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057e86-0381-4b10-9619-742917aa7cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.112376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e7bc9-808c-4528-ba7b-246d1d2a1fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:02.113380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-d7057e86-0381-4b10-9619-742917aa7cfd None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:02.113888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e7bc9-808c-4528-ba7b-246d1d2a1fb3 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:02.115378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d7057e86-0381-4b10-9619-742917aa7cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:02.124800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1059/2118] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:02.125951 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7057e86-0381-4b10-9619-742917aa7cfd None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:02.127773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1060/2119] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:02.135209 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115d4af-48a4-4b4c-827d-28089ed0069b None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.137782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115d4af-48a4-4b4c-827d-28089ed0069b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.138081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115d4af-48a4-4b4c-827d-28089ed0069b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.138236 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7057e86-0381-4b10-9619-742917aa7cfd None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:02.144559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e00b0-7f74-47fc-b132-56ea3273c36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:02.145281 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e00b0-7f74-47fc-b132-56ea3273c36a admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.145604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e00b0-7f74-47fc-b132-56ea3273c36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.146063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e00b0-7f74-47fc-b132-56ea3273c36a admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.147012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e00b0-7f74-47fc-b132-56ea3273c36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:02.149850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e00b0-7f74-47fc-b132-56ea3273c36a admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:02.160266 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-5115d4af-48a4-4b4c-827d-28089ed0069b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:02.161707 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1060/2120] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:02.162448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5115d4af-48a4-4b4c-827d-28089ed0069b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:02.168005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e00b0-7f74-47fc-b132-56ea3273c36a admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:02.172813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1061/2121] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:02.177318 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115d4af-48a4-4b4c-827d-28089ed0069b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:02.189241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115d4af-48a4-4b4c-827d-28089ed0069b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:02.193252 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e00b0-7f74-47fc-b132-56ea3273c36a admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:02.194303 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f052b8e-f7d3-438d-b480-2b442f0ace6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:02.194963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f052b8e-f7d3-438d-b480-2b442f0ace6e admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.195234 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f052b8e-f7d3-438d-b480-2b442f0ace6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.195489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f052b8e-f7d3-438d-b480-2b442f0ace6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.196532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f052b8e-f7d3-438d-b480-2b442f0ace6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:27:02.196532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f052b8e-f7d3-438d-b480-2b442f0ace6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:02.198040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f052b8e-f7d3-438d-b480-2b442f0ace6e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:02.209199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e3b03-0269-493e-a5a5-f5a9f49acfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:02.210081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3b03-0269-493e-a5a5-f5a9f49acfe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.210429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3b03-0269-493e-a5a5-f5a9f49acfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.210964 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3b03-0269-493e-a5a5-f5a9f49acfe1 admin admin] PATH_INFO: `/v3/projects/e1542fa352604068864f9fc52dcabd64/users/de653ee1e38846cf927dc2eab24bf662/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.215563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1062/2122] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:27:02.222100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f052b8e-f7d3-438d-b480-2b442f0ace6e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:02.235444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e3b03-0269-493e-a5a5-f5a9f49acfe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1542fa352604068864f9fc52dcabd64, user_id=de653ee1e38846cf927dc2eab24bf662, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:02.238478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e3b03-0269-493e-a5a5-f5a9f49acfe1 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:02.244417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f052b8e-f7d3-438d-b480-2b442f0ace6e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:02.252277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597bcd6-f920-4af9-be73-1bffd285a358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:02.253823 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597bcd6-f920-4af9-be73-1bffd285a358 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.254473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597bcd6-f920-4af9-be73-1bffd285a358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.255286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597bcd6-f920-4af9-be73-1bffd285a358 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.255518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597bcd6-f920-4af9-be73-1bffd285a358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:02.256876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1061/2123] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:02 2022] PUT /identity/v3/projects/e1542fa352604068864f9fc52dcabd64/users/de653ee1e38846cf927dc2eab24bf662/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:27:02.257786 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597bcd6-f920-4af9-be73-1bffd285a358 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:02.261908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce74ab7-d223-4dd7-9f0b-7ef01658d3b7 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.262189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce74ab7-d223-4dd7-9f0b-7ef01658d3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.262457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce74ab7-d223-4dd7-9f0b-7ef01658d3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.290770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-7ce74ab7-d223-4dd7-9f0b-7ef01658d3b7 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:02.292908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7ce74ab7-d223-4dd7-9f0b-7ef01658d3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:02.329699 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1063/2124] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:27:02 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:02.331504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597bcd6-f920-4af9-be73-1bffd285a358 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:02.394562 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:02.421018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1062/2125] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:27:02.428437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597bcd6-f920-4af9-be73-1bffd285a358 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:02.435303 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930c46d-221f-43a1-8841-3f396488cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:02.435943 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930c46d-221f-43a1-8841-3f396488cf6c admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.436220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930c46d-221f-43a1-8841-3f396488cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.436494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930c46d-221f-43a1-8841-3f396488cf6c admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.440441 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930c46d-221f-43a1-8841-3f396488cf6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:02.440441 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930c46d-221f-43a1-8841-3f396488cf6c admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:02.464381 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce74ab7-d223-4dd7-9f0b-7ef01658d3b7 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:02.465655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7ce74ab7-d223-4dd7-9f0b-7ef01658d3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:02.469934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1064/2126] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:27:02 2022] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:02.474776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930c46d-221f-43a1-8841-3f396488cf6c admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:02.486497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930c46d-221f-43a1-8841-3f396488cf6c admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:02.492114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b1184-3046-4d47-a4cb-d1c7823d55c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:02.492831 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1184-3046-4d47-a4cb-d1c7823d55c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.493173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1184-3046-4d47-a4cb-d1c7823d55c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.493518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1184-3046-4d47-a4cb-d1c7823d55c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.494273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b1184-3046-4d47-a4cb-d1c7823d55c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:02.496172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b1184-3046-4d47-a4cb-d1c7823d55c2 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:02.511764 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1065/2127] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:02.514618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b1184-3046-4d47-a4cb-d1c7823d55c2 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:02.526462 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b1184-3046-4d47-a4cb-d1c7823d55c2 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:02.532383 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b7b3b-778b-41e4-a43d-1a2490af2e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:02.533320 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b7b3b-778b-41e4-a43d-1a2490af2e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.533733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b7b3b-778b-41e4-a43d-1a2490af2e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.534008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b7b3b-778b-41e4-a43d-1a2490af2e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.534770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b7b3b-778b-41e4-a43d-1a2490af2e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:02.536627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b7b3b-778b-41e4-a43d-1a2490af2e49 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:02.537198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce74ab7-d223-4dd7-9f0b-7ef01658d3b7 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:02.549742 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1066/2128] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:27:02.554331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b7b3b-778b-41e4-a43d-1a2490af2e49 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:02.566669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b7b3b-778b-41e4-a43d-1a2490af2e49 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:02.573494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fce1df-7b3b-4792-934c-d47fd1800437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:02.574419 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fce1df-7b3b-4792-934c-d47fd1800437 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.574744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fce1df-7b3b-4792-934c-d47fd1800437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.575079 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fce1df-7b3b-4792-934c-d47fd1800437 admin admin] PATH_INFO: `/v3/projects/be068028b54e42a385412cf8f2b8e846/users/09d048c91b0e4ee294719b90ca796fb1/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.578963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:02.600174 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fce1df-7b3b-4792-934c-d47fd1800437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be068028b54e42a385412cf8f2b8e846, user_id=09d048c91b0e4ee294719b90ca796fb1, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:02.603303 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fce1df-7b3b-4792-934c-d47fd1800437 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:02.615990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7aafe-29ed-49aa-bc0a-e4f7ed7852c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:02.616717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7aafe-29ed-49aa-bc0a-e4f7ed7852c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.617063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7aafe-29ed-49aa-bc0a-e4f7ed7852c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.617396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7aafe-29ed-49aa-bc0a-e4f7ed7852c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.620512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1067/2129] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:02 2022] PUT /identity/v3/projects/be068028b54e42a385412cf8f2b8e846/users/09d048c91b0e4ee294719b90ca796fb1/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:02.621132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fce1df-7b3b-4792-934c-d47fd1800437 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:02.622837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d3fce1df-7b3b-4792-934c-d47fd1800437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:02.634634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7aafe-29ed-49aa-bc0a-e4f7ed7852c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:02.636471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7aafe-29ed-49aa-bc0a-e4f7ed7852c7 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:02.649766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1063/2130] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:27:02.651518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff55e4-18da-4b31-a0b3-5962b0c98481 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.651680 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff55e4-18da-4b31-a0b3-5962b0c98481 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.651955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff55e4-18da-4b31-a0b3-5962b0c98481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.694893 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-b1ff55e4-18da-4b31-a0b3-5962b0c98481 None None] MFA Rules not processed for user `09d048c91b0e4ee294719b90ca796fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:02.696393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b1ff55e4-18da-4b31-a0b3-5962b0c98481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:02.713166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fce1df-7b3b-4792-934c-d47fd1800437 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:02.718345 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b9743-c901-4d52-825a-027a559a4698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:02.719134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b9743-c901-4d52-825a-027a559a4698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.719478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b9743-c901-4d52-825a-027a559a4698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.720330 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b9743-c901-4d52-825a-027a559a4698 admin admin] PATH_INFO: `/v3/projects/907bcdf49e274ef3b4557361817bafff` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.721228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b9743-c901-4d52-825a-027a559a4698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=907bcdf49e274ef3b4557361817bafff)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:02.723817 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b9743-c901-4d52-825a-027a559a4698 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:02.786872 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-675b9743-c901-4d52-825a-027a559a4698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907bcdf49e274ef3b4557361817bafff', 'request_id': 'req-675b9743-c901-4d52-825a-027a559a4698'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:02.789315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1064/2131] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:02.794202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff55e4-18da-4b31-a0b3-5962b0c98481 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:02.796743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-675b9743-c901-4d52-825a-027a559a4698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907bcdf49e274ef3b4557361817bafff', 'request_id': 'req-675b9743-c901-4d52-825a-027a559a4698'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:02.809681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff55e4-18da-4b31-a0b3-5962b0c98481 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:02.811565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-675b9743-c901-4d52-825a-027a559a4698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907bcdf49e274ef3b4557361817bafff', 'request_id': 'req-675b9743-c901-4d52-825a-027a559a4698'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:02.825251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-675b9743-c901-4d52-825a-027a559a4698 admin admin] The token cache is being invalidate because project 907bcdf49e274ef3b4557361817bafff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:02.825596 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-675b9743-c901-4d52-825a-027a559a4698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:02.826524 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-675b9743-c901-4d52-825a-027a559a4698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:02.833144 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1068/2132] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:02 2022] DELETE /identity/v3/projects/907bcdf49e274ef3b4557361817bafff => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:02.834734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24c22-0be7-4d67-bf51-318c36fc53a0 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.835117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24c22-0be7-4d67-bf51-318c36fc53a0 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.835467 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24c22-0be7-4d67-bf51-318c36fc53a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.863275 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-76f24c22-0be7-4d67-bf51-318c36fc53a0 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:02.864172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-76f24c22-0be7-4d67-bf51-318c36fc53a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:02.879529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:02.905269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e3e8a-b323-4f75-a992-384a1e245d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:02.905859 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3e8a-b323-4f75-a992-384a1e245d3e admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:02.906131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3e8a-b323-4f75-a992-384a1e245d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:02.906397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3e8a-b323-4f75-a992-384a1e245d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:02.907109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e3e8a-b323-4f75-a992-384a1e245d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:02.909094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e3e8a-b323-4f75-a992-384a1e245d3e admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:02.949871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1065/2133] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:27:02 2022] POST /identity/v3/projects => generated 367 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:02.953890 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e3e8a-b323-4f75-a992-384a1e245d3e admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:02.955902 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-fb8e3e8a-b323-4f75-a992-384a1e245d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:03.009613 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1069/2134] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:03.014343 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077b6c2-1e69-4595-a33a-92ca028af1be None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.014608 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077b6c2-1e69-4595-a33a-92ca028af1be None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.014906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077b6c2-1e69-4595-a33a-92ca028af1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:03.049815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-e077b6c2-1e69-4595-a33a-92ca028af1be None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:03.051242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e077b6c2-1e69-4595-a33a-92ca028af1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:03.063029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:03.075008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e3e8a-b323-4f75-a992-384a1e245d3e admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:03.084162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df766cf4-6b68-4b9b-ae15-1062d8190bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:03.084966 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df766cf4-6b68-4b9b-ae15-1062d8190bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.085379 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df766cf4-6b68-4b9b-ae15-1062d8190bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.085804 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df766cf4-6b68-4b9b-ae15-1062d8190bbe admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:03.087330 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df766cf4-6b68-4b9b-ae15-1062d8190bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:03.089638 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df766cf4-6b68-4b9b-ae15-1062d8190bbe admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:03.132665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1066/2135] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:27:02 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:03.133927 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1070/2136] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:03.137628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df766cf4-6b68-4b9b-ae15-1062d8190bbe admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:03.138149 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077b6c2-1e69-4595-a33a-92ca028af1be None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:03.148774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077b6c2-1e69-4595-a33a-92ca028af1be None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:03.159654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ff8ed-68f5-4834-8611-65f66a109e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:03.160568 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ff8ed-68f5-4834-8611-65f66a109e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.160927 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ff8ed-68f5-4834-8611-65f66a109e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.161365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ff8ed-68f5-4834-8611-65f66a109e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:03.162650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ff8ed-68f5-4834-8611-65f66a109e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:27:03.163729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ff8ed-68f5-4834-8611-65f66a109e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:03.166398 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ff8ed-68f5-4834-8611-65f66a109e30 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:03.168012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df766cf4-6b68-4b9b-ae15-1062d8190bbe admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:03.187968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c00414-b8bf-47eb-a31a-c9102f2ce9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:03.189450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00414-b8bf-47eb-a31a-c9102f2ce9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.190009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00414-b8bf-47eb-a31a-c9102f2ce9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.193696 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00414-b8bf-47eb-a31a-c9102f2ce9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:03.194315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1071/2137] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:27:03.195405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c00414-b8bf-47eb-a31a-c9102f2ce9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:03.196559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ff8ed-68f5-4834-8611-65f66a109e30 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:03.198331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a30ff8ed-68f5-4834-8611-65f66a109e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:03.199052 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c00414-b8bf-47eb-a31a-c9102f2ce9c0 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:03.219593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ff8ed-68f5-4834-8611-65f66a109e30 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:03.225332 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95140d32-3e6f-4a7d-989d-0225ff1926cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:03.225982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95140d32-3e6f-4a7d-989d-0225ff1926cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.226281 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95140d32-3e6f-4a7d-989d-0225ff1926cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.226522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95140d32-3e6f-4a7d-989d-0225ff1926cb admin admin] PATH_INFO: `/v3/users/f266e728a1ea421abc67af65e8fc0e40` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:03.227879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95140d32-3e6f-4a7d-989d-0225ff1926cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f266e728a1ea421abc67af65e8fc0e40)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:03.229856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95140d32-3e6f-4a7d-989d-0225ff1926cb admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:03.231587 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1067/2138] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:03.238269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c00414-b8bf-47eb-a31a-c9102f2ce9c0 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:03.258791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c00414-b8bf-47eb-a31a-c9102f2ce9c0 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:03.270137 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfcba0-02e9-464d-bc59-a8aac5baf6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:03.270773 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfcba0-02e9-464d-bc59-a8aac5baf6ed admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.273418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfcba0-02e9-464d-bc59-a8aac5baf6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.273731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfcba0-02e9-464d-bc59-a8aac5baf6ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:03.274552 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfcba0-02e9-464d-bc59-a8aac5baf6ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:03.280708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfcba0-02e9-464d-bc59-a8aac5baf6ed admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:03.338931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1068/2139] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:27:03 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:03.340439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfcba0-02e9-464d-bc59-a8aac5baf6ed admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:03.355320 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-95140d32-3e6f-4a7d-989d-0225ff1926cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f266e728a1ea421abc67af65e8fc0e40'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:03.386572 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-95140d32-3e6f-4a7d-989d-0225ff1926cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f266e728a1ea421abc67af65e8fc0e40'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:03.400882 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-95140d32-3e6f-4a7d-989d-0225ff1926cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f266e728a1ea421abc67af65e8fc0e40'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:03.402280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-95140d32-3e6f-4a7d-989d-0225ff1926cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f266e728a1ea421abc67af65e8fc0e40'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:03.403189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-95140d32-3e6f-4a7d-989d-0225ff1926cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f266e728a1ea421abc67af65e8fc0e40'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:03.425639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1072/2140] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:03 2022] DELETE /identity/v3/users/f266e728a1ea421abc67af65e8fc0e40 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:03.430629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95140d32-3e6f-4a7d-989d-0225ff1926cb admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:03.433194 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-95140d32-3e6f-4a7d-989d-0225ff1926cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:03.444251 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfcba0-02e9-464d-bc59-a8aac5baf6ed admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:03.479571 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:03.520600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51515096-e167-47c8-9176-94bfb9c27d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:03.521272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51515096-e167-47c8-9176-94bfb9c27d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.521536 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51515096-e167-47c8-9176-94bfb9c27d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.521850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51515096-e167-47c8-9176-94bfb9c27d53 admin admin] PATH_INFO: `/v3/projects/fb1bcae1e25e49598bc19301fca8eca2/users/f9310c5ce7844baeba2fe395ad8057ac/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:03.548813 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51515096-e167-47c8-9176-94bfb9c27d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1bcae1e25e49598bc19301fca8eca2, user_id=f9310c5ce7844baeba2fe395ad8057ac, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:03.551699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51515096-e167-47c8-9176-94bfb9c27d53 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:03.553779 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95140d32-3e6f-4a7d-989d-0225ff1926cb admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:03.559467 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ef1c2-d67e-426b-b10e-87500930251e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:03.560158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef1c2-d67e-426b-b10e-87500930251e admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.560430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef1c2-d67e-426b-b10e-87500930251e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.560693 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef1c2-d67e-426b-b10e-87500930251e admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:03.561335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ef1c2-d67e-426b-b10e-87500930251e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:03.563721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ef1c2-d67e-426b-b10e-87500930251e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:03.577118 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1069/2141] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:03 2022] PUT /identity/v3/projects/fb1bcae1e25e49598bc19301fca8eca2/users/f9310c5ce7844baeba2fe395ad8057ac/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:03.579065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4b98d-2c74-447b-978c-2dadfa97478d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.579897 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4b98d-2c74-447b-978c-2dadfa97478d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.581140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4b98d-2c74-447b-978c-2dadfa97478d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:03.596297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1073/2142] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:27:03 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:03.600792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ef1c2-d67e-426b-b10e-87500930251e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:03.602750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-024ef1c2-d67e-426b-b10e-87500930251e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:03.607441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-49d4b98d-2c74-447b-978c-2dadfa97478d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:03.608799 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-49d4b98d-2c74-447b-978c-2dadfa97478d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:03.612929 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:03.622879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ef1c2-d67e-426b-b10e-87500930251e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:03.707191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1070/2143] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:03.707191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4b98d-2c74-447b-978c-2dadfa97478d None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:03.721150 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4b98d-2c74-447b-978c-2dadfa97478d None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:03.729628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030b929-7dc3-4333-af05-452715f7b615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:03.730371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030b929-7dc3-4333-af05-452715f7b615 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.730723 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030b929-7dc3-4333-af05-452715f7b615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.731132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030b929-7dc3-4333-af05-452715f7b615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:03.731978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030b929-7dc3-4333-af05-452715f7b615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:03.733481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4e2c0-6d78-46b8-9e92-a0fd7feb0d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:03.733786 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030b929-7dc3-4333-af05-452715f7b615 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:03.735066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e2c0-6d78-46b8-9e92-a0fd7feb0d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.735602 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e2c0-6d78-46b8-9e92-a0fd7feb0d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.736063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e2c0-6d78-46b8-9e92-a0fd7feb0d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:03.737609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4e2c0-6d78-46b8-9e92-a0fd7feb0d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:03.740409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4e2c0-6d78-46b8-9e92-a0fd7feb0d7d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:03.772267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1071/2144] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:03.775415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030b929-7dc3-4333-af05-452715f7b615 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:03.781785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b030b929-7dc3-4333-af05-452715f7b615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:03.788684 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1074/2145] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:03.790432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4e2c0-6d78-46b8-9e92-a0fd7feb0d7d admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:03.809143 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4e2c0-6d78-46b8-9e92-a0fd7feb0d7d admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:03.817067 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00600277-ef51-4f9f-8e66-6cde498f9c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:03.817708 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00600277-ef51-4f9f-8e66-6cde498f9c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.818081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00600277-ef51-4f9f-8e66-6cde498f9c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.818358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00600277-ef51-4f9f-8e66-6cde498f9c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:03.819916 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00600277-ef51-4f9f-8e66-6cde498f9c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:03.822806 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00600277-ef51-4f9f-8e66-6cde498f9c84 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:03.844127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1075/2146] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:03.845932 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e587cd-006b-405f-bcca-3020a6a902e5 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.846231 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e587cd-006b-405f-bcca-3020a6a902e5 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.846654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e587cd-006b-405f-bcca-3020a6a902e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:03.889324 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f9e587cd-006b-405f-bcca-3020a6a902e5 None None] MFA Rules not processed for user `de653ee1e38846cf927dc2eab24bf662`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:03.890707 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f9e587cd-006b-405f-bcca-3020a6a902e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:03.907520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030b929-7dc3-4333-af05-452715f7b615 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:03.912212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f91c46-b31e-4c7c-a4bf-ac855640a9ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:03.912981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f91c46-b31e-4c7c-a4bf-ac855640a9ab service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.913615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f91c46-b31e-4c7c-a4bf-ac855640a9ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.914231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f91c46-b31e-4c7c-a4bf-ac855640a9ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:03.935537 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f91c46-b31e-4c7c-a4bf-ac855640a9ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:03.940526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f91c46-b31e-4c7c-a4bf-ac855640a9ab service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:03.970653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1072/2147] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:03.972058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f91c46-b31e-4c7c-a4bf-ac855640a9ab service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:03.986401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f91c46-b31e-4c7c-a4bf-ac855640a9ab service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:03.995511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7a354-a2c3-48ad-be03-fb2d5960986b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:03.996909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7a354-a2c3-48ad-be03-fb2d5960986b admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:03.997358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7a354-a2c3-48ad-be03-fb2d5960986b admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:03.997782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7a354-a2c3-48ad-be03-fb2d5960986b admin admin] PATH_INFO: `/v3/projects/fb1bcae1e25e49598bc19301fca8eca2/users/f9310c5ce7844baeba2fe395ad8057ac/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:04.001454 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7a354-a2c3-48ad-be03-fb2d5960986b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1bcae1e25e49598bc19301fca8eca2, user_id=f9310c5ce7844baeba2fe395ad8057ac, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:04.006559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7a354-a2c3-48ad-be03-fb2d5960986b admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:04.015731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1076/2148] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:04.017052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e587cd-006b-405f-bcca-3020a6a902e5 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:04.029483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1073/2149] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:03 2022] PUT /identity/v3/projects/fb1bcae1e25e49598bc19301fca8eca2/users/f9310c5ce7844baeba2fe395ad8057ac/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:04.030694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7a354-a2c3-48ad-be03-fb2d5960986b admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:04.049272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-58c7a354-a2c3-48ad-be03-fb2d5960986b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:04.052253 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e587cd-006b-405f-bcca-3020a6a902e5 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:04.124475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:04.173067 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453009d-5ae4-42a8-91f3-102ab01e3e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:04.173970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453009d-5ae4-42a8-91f3-102ab01e3e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:04.174380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453009d-5ae4-42a8-91f3-102ab01e3e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:04.174693 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453009d-5ae4-42a8-91f3-102ab01e3e8e admin admin] PATH_INFO: `/v3/projects/951cb6214910431385e31db6e0d7e2df/users/0e0dfa142d1c43ee810c31814cf67224/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:04.221698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7a354-a2c3-48ad-be03-fb2d5960986b admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:04.229529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04fe54-d8b8-4fb3-994c-d81870305e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:04.231059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04fe54-d8b8-4fb3-994c-d81870305e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:04.231508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04fe54-d8b8-4fb3-994c-d81870305e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:04.231915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04fe54-d8b8-4fb3-994c-d81870305e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:04.232695 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04fe54-d8b8-4fb3-994c-d81870305e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:04.234785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04fe54-d8b8-4fb3-994c-d81870305e11 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:04.239456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453009d-5ae4-42a8-91f3-102ab01e3e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=951cb6214910431385e31db6e0d7e2df, user_id=0e0dfa142d1c43ee810c31814cf67224, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:04.242405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453009d-5ae4-42a8-91f3-102ab01e3e8e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:04.266323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1077/2150] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:04 2022] PUT /identity/v3/projects/951cb6214910431385e31db6e0d7e2df/users/0e0dfa142d1c43ee810c31814cf67224/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:04.269215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb9f91-c7ae-461f-99a2-bd688f4c0b1d None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:04.269643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb9f91-c7ae-461f-99a2-bd688f4c0b1d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:04.270079 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb9f91-c7ae-461f-99a2-bd688f4c0b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:04.280822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1074/2151] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:27:04 2022] POST /identity/v3/projects => generated 371 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:04.280822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8916064-7550-4f09-8f1c-dd27651febfc None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:04.280822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8916064-7550-4f09-8f1c-dd27651febfc None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:04.280822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8916064-7550-4f09-8f1c-dd27651febfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:04.290746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:04.318587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b8eb9f91-c7ae-461f-99a2-bd688f4c0b1d None None] MFA Rules not processed for user `f9310c5ce7844baeba2fe395ad8057ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:04.319965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b8eb9f91-c7ae-461f-99a2-bd688f4c0b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:04.337477 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-a8916064-7550-4f09-8f1c-dd27651febfc None None] MFA Rules not processed for user `0e0dfa142d1c43ee810c31814cf67224`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:04.339609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a8916064-7550-4f09-8f1c-dd27651febfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:04.433675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1075/2152] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:04.435003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8916064-7550-4f09-8f1c-dd27651febfc None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:04.451691 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1078/2153] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:04.451691 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb9f91-c7ae-461f-99a2-bd688f4c0b1d None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:04.535141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8916064-7550-4f09-8f1c-dd27651febfc None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:04.540685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e4348-1d47-455e-8867-c7c57e0fe549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:04.541333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e4348-1d47-455e-8867-c7c57e0fe549 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:04.541630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e4348-1d47-455e-8867-c7c57e0fe549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:04.541896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e4348-1d47-455e-8867-c7c57e0fe549 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:04.542520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e4348-1d47-455e-8867-c7c57e0fe549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:04.544790 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e4348-1d47-455e-8867-c7c57e0fe549 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:04.548289 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb9f91-c7ae-461f-99a2-bd688f4c0b1d None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:04.554650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0119a4-e4fe-42fa-97e2-d3b0cbbc863b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:04.557021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0119a4-e4fe-42fa-97e2-d3b0cbbc863b admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:04.557647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0119a4-e4fe-42fa-97e2-d3b0cbbc863b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:04.558032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0119a4-e4fe-42fa-97e2-d3b0cbbc863b admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:04.559119 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0119a4-e4fe-42fa-97e2-d3b0cbbc863b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:04.562050 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0119a4-e4fe-42fa-97e2-d3b0cbbc863b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:04.575933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1076/2154] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:27:04 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:04.577541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e4348-1d47-455e-8867-c7c57e0fe549 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:04.579433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f42e4348-1d47-455e-8867-c7c57e0fe549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:04.593373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e4348-1d47-455e-8867-c7c57e0fe549 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:04.593912 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1079/2155] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:27:04 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:04.595971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0119a4-e4fe-42fa-97e2-d3b0cbbc863b admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:04.600281 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1e0119a4-e4fe-42fa-97e2-d3b0cbbc863b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:04.653239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:04.675983 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0119a4-e4fe-42fa-97e2-d3b0cbbc863b admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:04.679765 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:04.680400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:04.680671 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:04.680941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] PATH_INFO: `/v3/projects/546f215d0925459292ff847fbf37382c` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:04.681039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c3b53-82bc-48f5-b921-0096e14785fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:04.681738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c3b53-82bc-48f5-b921-0096e14785fc service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:04.682069 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546f215d0925459292ff847fbf37382c)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:04.682166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c3b53-82bc-48f5-b921-0096e14785fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:04.682405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c3b53-82bc-48f5-b921-0096e14785fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:04.684052 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:04.729846 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:04.758445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546f215d0925459292ff847fbf37382c', 'request_id': 'req-ba55cb15-dafa-4b0e-b52f-063da9db5d96'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:04.769989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546f215d0925459292ff847fbf37382c', 'request_id': 'req-ba55cb15-dafa-4b0e-b52f-063da9db5d96'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:04.778999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546f215d0925459292ff847fbf37382c', 'request_id': 'req-ba55cb15-dafa-4b0e-b52f-063da9db5d96'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:04.789881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c3b53-82bc-48f5-b921-0096e14785fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:04.791455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] The token cache is being invalidate because project 546f215d0925459292ff847fbf37382c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:04.791584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c3b53-82bc-48f5-b921-0096e14785fc service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:04.791819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:04.792590 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:04.794346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1077/2156] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:04 2022] DELETE /identity/v3/projects/546f215d0925459292ff847fbf37382c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:04.794942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:04.796246 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:04.803864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1080/2157] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:04.804751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c3b53-82bc-48f5-b921-0096e14785fc service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:04.817843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c3b53-82bc-48f5-b921-0096e14785fc service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:04.921033 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55cb15-dafa-4b0e-b52f-063da9db5d96 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:04.928139 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96778e0b-69b4-4adf-b3a2-3c1f49ee305d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:04.928654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778e0b-69b4-4adf-b3a2-3c1f49ee305d admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:04.928929 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778e0b-69b4-4adf-b3a2-3c1f49ee305d admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:04.929192 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778e0b-69b4-4adf-b3a2-3c1f49ee305d admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:04.930847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96778e0b-69b4-4adf-b3a2-3c1f49ee305d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:04.931481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96778e0b-69b4-4adf-b3a2-3c1f49ee305d admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:04.943662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1078/2158] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:04.948366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96778e0b-69b4-4adf-b3a2-3c1f49ee305d admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:04.950300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-96778e0b-69b4-4adf-b3a2-3c1f49ee305d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:04.965716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96778e0b-69b4-4adf-b3a2-3c1f49ee305d admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:04.971617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760b2ef-20d1-404e-b8be-43f2ff31758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:04.972925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760b2ef-20d1-404e-b8be-43f2ff31758a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:04.972925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760b2ef-20d1-404e-b8be-43f2ff31758a admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:04.973697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760b2ef-20d1-404e-b8be-43f2ff31758a admin admin] PATH_INFO: `/v3/users/ea2ba7bc60c44c4fbdd080e3737f8fc2` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:04.975078 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760b2ef-20d1-404e-b8be-43f2ff31758a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2ba7bc60c44c4fbdd080e3737f8fc2)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:04.977112 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760b2ef-20d1-404e-b8be-43f2ff31758a admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:04.986783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb1473-078c-4088-b605-2a29f15ba002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:04.987862 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb1473-078c-4088-b605-2a29f15ba002 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:04.988277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb1473-078c-4088-b605-2a29f15ba002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:04.988728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb1473-078c-4088-b605-2a29f15ba002 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:04.989543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb1473-078c-4088-b605-2a29f15ba002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:04.992624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb1473-078c-4088-b605-2a29f15ba002 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:05.031305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1081/2159] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:27:04 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:05.032379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb1473-078c-4088-b605-2a29f15ba002 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:05.044091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb1473-078c-4088-b605-2a29f15ba002 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:05.049702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a74ac-6e14-4a2c-b6a7-f3d214edb9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:05.050353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a74ac-6e14-4a2c-b6a7-f3d214edb9f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:05.050553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3760b2ef-20d1-404e-b8be-43f2ff31758a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2ba7bc60c44c4fbdd080e3737f8fc2'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:05.050725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a74ac-6e14-4a2c-b6a7-f3d214edb9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:05.050922 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a74ac-6e14-4a2c-b6a7-f3d214edb9f5 admin admin] PATH_INFO: `/v3/projects/584d9c6e6f194c579170d1bbb85dcd6c/users/2b3ee05c7f1d48a48bf1572a76a7c24e/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:05.065306 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3760b2ef-20d1-404e-b8be-43f2ff31758a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2ba7bc60c44c4fbdd080e3737f8fc2'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:05.066508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3760b2ef-20d1-404e-b8be-43f2ff31758a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2ba7bc60c44c4fbdd080e3737f8fc2'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:05.067481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3760b2ef-20d1-404e-b8be-43f2ff31758a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2ba7bc60c44c4fbdd080e3737f8fc2'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:05.069701 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a74ac-6e14-4a2c-b6a7-f3d214edb9f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584d9c6e6f194c579170d1bbb85dcd6c, user_id=2b3ee05c7f1d48a48bf1572a76a7c24e, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:05.072615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a74ac-6e14-4a2c-b6a7-f3d214edb9f5 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:05.074955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:05.093899 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3760b2ef-20d1-404e-b8be-43f2ff31758a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2ba7bc60c44c4fbdd080e3737f8fc2'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:05.116930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1079/2160] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:04 2022] DELETE /identity/v3/users/ea2ba7bc60c44c4fbdd080e3737f8fc2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:05.117830 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760b2ef-20d1-404e-b8be-43f2ff31758a admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:05.118982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1082/2161] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:05 2022] PUT /identity/v3/projects/584d9c6e6f194c579170d1bbb85dcd6c/users/2b3ee05c7f1d48a48bf1572a76a7c24e/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:05.124162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-3760b2ef-20d1-404e-b8be-43f2ff31758a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:05.132158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a74ac-6e14-4a2c-b6a7-f3d214edb9f5 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:05.135618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-737a74ac-6e14-4a2c-b6a7-f3d214edb9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:05.228173 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760b2ef-20d1-404e-b8be-43f2ff31758a admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:05.234058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2eb2e-5a3a-4e67-aaaf-9c1ccecde8b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:05.235060 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2eb2e-5a3a-4e67-aaaf-9c1ccecde8b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:05.235183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2eb2e-5a3a-4e67-aaaf-9c1ccecde8b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:05.235569 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2eb2e-5a3a-4e67-aaaf-9c1ccecde8b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:05.255711 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-99b2eb2e-5a3a-4e67-aaaf-9c1ccecde8b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:05.301946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a74ac-6e14-4a2c-b6a7-f3d214edb9f5 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:05.352409 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2eb2e-5a3a-4e67-aaaf-9c1ccecde8b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:05.354359 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2eb2e-5a3a-4e67-aaaf-9c1ccecde8b7 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:05.363961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:05.367491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1080/2162] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:05.368362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2eb2e-5a3a-4e67-aaaf-9c1ccecde8b7 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:05.369722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-99b2eb2e-5a3a-4e67-aaaf-9c1ccecde8b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:05.415746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a482d1-381a-4677-b4d3-5d153342ef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:05.420900 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a482d1-381a-4677-b4d3-5d153342ef83 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:05.421537 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a482d1-381a-4677-b4d3-5d153342ef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:05.422022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a482d1-381a-4677-b4d3-5d153342ef83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:05.425964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a482d1-381a-4677-b4d3-5d153342ef83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:05.436333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a482d1-381a-4677-b4d3-5d153342ef83 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:05.458782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2eb2e-5a3a-4e67-aaaf-9c1ccecde8b7 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:05.464208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe619a-ef3a-4598-aab2-1974ccd391af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:05.464858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe619a-ef3a-4598-aab2-1974ccd391af admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:05.465112 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe619a-ef3a-4598-aab2-1974ccd391af admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:05.465377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe619a-ef3a-4598-aab2-1974ccd391af admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:05.466159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe619a-ef3a-4598-aab2-1974ccd391af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:05.467960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe619a-ef3a-4598-aab2-1974ccd391af admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:05.485397 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1083/2163] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:05.490049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1081/2164] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:05.490225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a482d1-381a-4677-b4d3-5d153342ef83 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:05.498455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe619a-ef3a-4598-aab2-1974ccd391af admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:05.512398 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a482d1-381a-4677-b4d3-5d153342ef83 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:05.518002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe619a-ef3a-4598-aab2-1974ccd391af admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:05.523471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dc67b-39af-4e27-975d-f81f40e7d631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:05.524025 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dc67b-39af-4e27-975d-f81f40e7d631 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:05.524286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dc67b-39af-4e27-975d-f81f40e7d631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:05.524562 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dc67b-39af-4e27-975d-f81f40e7d631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:05.525819 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dc67b-39af-4e27-975d-f81f40e7d631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:05.527466 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dc67b-39af-4e27-975d-f81f40e7d631 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:05.532878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01315d19-5b29-4ce6-94b4-55c0ab947551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:05.537916 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01315d19-5b29-4ce6-94b4-55c0ab947551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:05.537916 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01315d19-5b29-4ce6-94b4-55c0ab947551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:05.537916 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01315d19-5b29-4ce6-94b4-55c0ab947551 admin admin] PATH_INFO: `/v3/projects/584d9c6e6f194c579170d1bbb85dcd6c/users/2b3ee05c7f1d48a48bf1572a76a7c24e/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:05.540749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01315d19-5b29-4ce6-94b4-55c0ab947551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584d9c6e6f194c579170d1bbb85dcd6c, user_id=2b3ee05c7f1d48a48bf1572a76a7c24e, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:05.545522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01315d19-5b29-4ce6-94b4-55c0ab947551 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:05.553616 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1084/2165] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:27:05.559193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dc67b-39af-4e27-975d-f81f40e7d631 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:05.574467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1082/2166] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:05 2022] PUT /identity/v3/projects/584d9c6e6f194c579170d1bbb85dcd6c/users/2b3ee05c7f1d48a48bf1572a76a7c24e/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:05.577179 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dc67b-39af-4e27-975d-f81f40e7d631 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:05.662013 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc4e75-43e4-4e67-b6fd-3da2882a3647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:05.664310 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc4e75-43e4-4e67-b6fd-3da2882a3647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:05.664747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc4e75-43e4-4e67-b6fd-3da2882a3647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:05.666646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc4e75-43e4-4e67-b6fd-3da2882a3647 admin admin] PATH_INFO: `/v3/projects/eeb009d0500748adab3238168c7ff54a/users/29f722b489774290b04de62e1403c85d/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:05.770282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc4e75-43e4-4e67-b6fd-3da2882a3647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb009d0500748adab3238168c7ff54a, user_id=29f722b489774290b04de62e1403c85d, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:05.789561 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc4e75-43e4-4e67-b6fd-3da2882a3647 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:05.850863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1085/2167] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:05 2022] PUT /identity/v3/projects/eeb009d0500748adab3238168c7ff54a/users/29f722b489774290b04de62e1403c85d/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:05.861557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7f64c-4922-4b67-aeec-5be3867cfa06 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:05.863113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7f64c-4922-4b67-aeec-5be3867cfa06 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:05.863551 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7f64c-4922-4b67-aeec-5be3867cfa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:05.868138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc4e75-43e4-4e67-b6fd-3da2882a3647 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:05.870490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-08fc4e75-43e4-4e67-b6fd-3da2882a3647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:05.956281 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:05.970950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-e1f7f64c-4922-4b67-aeec-5be3867cfa06 None None] MFA Rules not processed for user `29f722b489774290b04de62e1403c85d`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:05.977974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e1f7f64c-4922-4b67-aeec-5be3867cfa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:06.049700 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc4e75-43e4-4e67-b6fd-3da2882a3647 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:06.058935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:06.061747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.062172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.063102 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6 admin admin] PATH_INFO: `/v3/projects/991f33c2512d473db2edd52e43674be6` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.066852 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991f33c2512d473db2edd52e43674be6)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:06.073402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:06.085766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1083/2168] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:27:06.090276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7f64c-4922-4b67-aeec-5be3867cfa06 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:06.115650 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7f64c-4922-4b67-aeec-5be3867cfa06 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:06.129066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347bfde-1d6b-463f-808c-df93c02683a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:06.130169 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347bfde-1d6b-463f-808c-df93c02683a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.130340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347bfde-1d6b-463f-808c-df93c02683a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.130652 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347bfde-1d6b-463f-808c-df93c02683a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.131259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347bfde-1d6b-463f-808c-df93c02683a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:06.135085 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347bfde-1d6b-463f-808c-df93c02683a7 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:06.173906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:06.177268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991f33c2512d473db2edd52e43674be6', 'request_id': 'req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:06.190339 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991f33c2512d473db2edd52e43674be6', 'request_id': 'req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:06.195579 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1084/2169] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:27:06 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:27:06.197674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347bfde-1d6b-463f-808c-df93c02683a7 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:06.212646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991f33c2512d473db2edd52e43674be6', 'request_id': 'req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:06.228294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6 admin admin] The token cache is being invalidate because project 991f33c2512d473db2edd52e43674be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:06.228631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:06.229991 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6caed2d6-7e0b-4e33-be7b-ca325b5828d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:06.234893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1086/2170] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:05 2022] DELETE /identity/v3/projects/991f33c2512d473db2edd52e43674be6 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:27:06.239972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897d53e-519b-4a0d-abcd-3de30e65b932 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.240301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897d53e-519b-4a0d-abcd-3de30e65b932 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.240651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897d53e-519b-4a0d-abcd-3de30e65b932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.288147 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347bfde-1d6b-463f-808c-df93c02683a7 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:06.288371 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-8897d53e-519b-4a0d-abcd-3de30e65b932 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:06.292127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-8897d53e-519b-4a0d-abcd-3de30e65b932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:06.294091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0c1a6-e05d-43af-a404-64bd1a603179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:06.294918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0c1a6-e05d-43af-a404-64bd1a603179 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.295417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0c1a6-e05d-43af-a404-64bd1a603179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.295782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0c1a6-e05d-43af-a404-64bd1a603179 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.297106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0c1a6-e05d-43af-a404-64bd1a603179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:06.299247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0c1a6-e05d-43af-a404-64bd1a603179 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:06.312639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1087/2171] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:06.321721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c7528-e206-4607-af2f-96e20c6c9266 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.322028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c7528-e206-4607-af2f-96e20c6c9266 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.322412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c7528-e206-4607-af2f-96e20c6c9266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.327941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1085/2172] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:27:06 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:27:06.342277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0c1a6-e05d-43af-a404-64bd1a603179 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:06.344818 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-3fd0c1a6-e05d-43af-a404-64bd1a603179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:06.364386 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0c1a6-e05d-43af-a404-64bd1a603179 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:06.370527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067b943-edcd-4ea6-94b9-353af3d40077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:06.371338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067b943-edcd-4ea6-94b9-353af3d40077 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.371674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067b943-edcd-4ea6-94b9-353af3d40077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.371953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067b943-edcd-4ea6-94b9-353af3d40077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.373141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067b943-edcd-4ea6-94b9-353af3d40077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:06.375432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-cb1c7528-e206-4607-af2f-96e20c6c9266 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:06.375573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067b943-edcd-4ea6-94b9-353af3d40077 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:06.376678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cb1c7528-e206-4607-af2f-96e20c6c9266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:06.386367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1088/2173] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:06.390406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c7528-e206-4607-af2f-96e20c6c9266 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:06.392559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1086/2174] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:06.397542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067b943-edcd-4ea6-94b9-353af3d40077 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:06.416130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067b943-edcd-4ea6-94b9-353af3d40077 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:06.419457 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c7528-e206-4607-af2f-96e20c6c9266 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:06.423516 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bb12f-f9eb-4cb2-9a47-5a6d743f9877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:06.424545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bb12f-f9eb-4cb2-9a47-5a6d743f9877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.425088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bb12f-f9eb-4cb2-9a47-5a6d743f9877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.425672 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bb12f-f9eb-4cb2-9a47-5a6d743f9877 admin admin] PATH_INFO: `/v3/projects/f79f5224b9a44b0b87f3853c1fdb348e/users/cf1902d87a8b4055a140a412299bd1c0/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.431646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d2f97-8bab-4b6d-a21b-1daabe46a4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:06.432281 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d2f97-8bab-4b6d-a21b-1daabe46a4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.432559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d2f97-8bab-4b6d-a21b-1daabe46a4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.432827 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d2f97-8bab-4b6d-a21b-1daabe46a4d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.433492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d2f97-8bab-4b6d-a21b-1daabe46a4d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:27:06.433797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d2f97-8bab-4b6d-a21b-1daabe46a4d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:06.437315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d2f97-8bab-4b6d-a21b-1daabe46a4d6 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:06.451933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bb12f-f9eb-4cb2-9a47-5a6d743f9877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f5224b9a44b0b87f3853c1fdb348e, user_id=cf1902d87a8b4055a140a412299bd1c0, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:06.455653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bb12f-f9eb-4cb2-9a47-5a6d743f9877 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:06.463775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1089/2175] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:27:06.470111 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d2f97-8bab-4b6d-a21b-1daabe46a4d6 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:06.483905 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1087/2176] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:06 2022] PUT /identity/v3/projects/f79f5224b9a44b0b87f3853c1fdb348e/users/cf1902d87a8b4055a140a412299bd1c0/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:06.487819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bb12f-f9eb-4cb2-9a47-5a6d743f9877 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:06.498943 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d2f97-8bab-4b6d-a21b-1daabe46a4d6 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:06.570294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:06.591554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23ce20-ca7d-4a7a-b553-505261fb3173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:06.592147 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23ce20-ca7d-4a7a-b553-505261fb3173 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.592423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23ce20-ca7d-4a7a-b553-505261fb3173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.592687 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23ce20-ca7d-4a7a-b553-505261fb3173 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.593331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23ce20-ca7d-4a7a-b553-505261fb3173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:06.595323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23ce20-ca7d-4a7a-b553-505261fb3173 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:06.617433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bb12f-f9eb-4cb2-9a47-5a6d743f9877 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:06.624189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c97aa7-4d97-4e0b-a4a5-5a020bdeda3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:06.628532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c97aa7-4d97-4e0b-a4a5-5a020bdeda3b admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.629664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c97aa7-4d97-4e0b-a4a5-5a020bdeda3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.631051 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c97aa7-4d97-4e0b-a4a5-5a020bdeda3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.631764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c97aa7-4d97-4e0b-a4a5-5a020bdeda3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:06.635050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c97aa7-4d97-4e0b-a4a5-5a020bdeda3b admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:06.640173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1090/2177] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:27:06 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:06.644529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23ce20-ca7d-4a7a-b553-505261fb3173 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:06.653466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1088/2178] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:27:06.658431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c97aa7-4d97-4e0b-a4a5-5a020bdeda3b admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:06.669147 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c97aa7-4d97-4e0b-a4a5-5a020bdeda3b admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:06.735064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23ce20-ca7d-4a7a-b553-505261fb3173 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:06.742327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86208509-91a9-42c6-a688-79730f65efc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:06.743076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86208509-91a9-42c6-a688-79730f65efc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.743556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86208509-91a9-42c6-a688-79730f65efc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.743882 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86208509-91a9-42c6-a688-79730f65efc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.744629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86208509-91a9-42c6-a688-79730f65efc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:06.747676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86208509-91a9-42c6-a688-79730f65efc4 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:06.753319 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36109609-337a-411a-a31e-b0ee7d2efca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:06.754279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36109609-337a-411a-a31e-b0ee7d2efca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.754614 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36109609-337a-411a-a31e-b0ee7d2efca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.754912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36109609-337a-411a-a31e-b0ee7d2efca1 admin admin] PATH_INFO: `/v3/projects/f79f5224b9a44b0b87f3853c1fdb348e/users/cf1902d87a8b4055a140a412299bd1c0/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.757221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36109609-337a-411a-a31e-b0ee7d2efca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f5224b9a44b0b87f3853c1fdb348e, user_id=cf1902d87a8b4055a140a412299bd1c0, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:06.761391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36109609-337a-411a-a31e-b0ee7d2efca1 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:06.777257 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1089/2179] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:06 2022] PUT /identity/v3/projects/f79f5224b9a44b0b87f3853c1fdb348e/users/cf1902d87a8b4055a140a412299bd1c0/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:06.779852 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1091/2180] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:27:06 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:06.784139 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36109609-337a-411a-a31e-b0ee7d2efca1 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:06.787929 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a33a-ab33-44b8-b494-689cb6b80082 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.789316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a33a-ab33-44b8-b494-689cb6b80082 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.789808 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a33a-ab33-44b8-b494-689cb6b80082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.838036 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-2401a33a-ab33-44b8-b494-689cb6b80082 None None] MFA Rules not processed for user `cf1902d87a8b4055a140a412299bd1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:06.839311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-2401a33a-ab33-44b8-b494-689cb6b80082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:06.849993 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:06.912123 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36109609-337a-411a-a31e-b0ee7d2efca1 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:06.917711 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10c3c5-8cd5-4a45-ad5d-431be7b33afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:06.919028 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10c3c5-8cd5-4a45-ad5d-431be7b33afb admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.919314 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10c3c5-8cd5-4a45-ad5d-431be7b33afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.919585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10c3c5-8cd5-4a45-ad5d-431be7b33afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.920255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10c3c5-8cd5-4a45-ad5d-431be7b33afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:06.921953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10c3c5-8cd5-4a45-ad5d-431be7b33afb admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:06.932832 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1092/2181] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:27:06.940058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1090/2182] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:06.946254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401a33a-ab33-44b8-b494-689cb6b80082 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:06.947890 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10c3c5-8cd5-4a45-ad5d-431be7b33afb admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:06.950009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6b10c3c5-8cd5-4a45-ad5d-431be7b33afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:06.973775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401a33a-ab33-44b8-b494-689cb6b80082 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:06.984750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e56462-3b64-4464-b6ac-1a33b9d47681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:06.985554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e56462-3b64-4464-b6ac-1a33b9d47681 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:06.985655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e56462-3b64-4464-b6ac-1a33b9d47681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:06.985908 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e56462-3b64-4464-b6ac-1a33b9d47681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:06.986677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e56462-3b64-4464-b6ac-1a33b9d47681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:06.996972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e56462-3b64-4464-b6ac-1a33b9d47681 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:07.031429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1093/2183] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:07.036612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e56462-3b64-4464-b6ac-1a33b9d47681 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:07.049111 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e56462-3b64-4464-b6ac-1a33b9d47681 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:07.050671 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10c3c5-8cd5-4a45-ad5d-431be7b33afb admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:07.054072 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa3adb-a2c6-4d51-85bf-8b0b3af215ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:07.054834 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa3adb-a2c6-4d51-85bf-8b0b3af215ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:07.055123 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9610df-a728-4849-85f9-0c0d0a0269d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:07.055250 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa3adb-a2c6-4d51-85bf-8b0b3af215ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:07.055650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa3adb-a2c6-4d51-85bf-8b0b3af215ab admin admin] PATH_INFO: `/v3/projects/bfc240016ba8447da04bbf7804e3d801/users/20fa4a9037534826bb11e503c20b4dcb/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:07.056102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9610df-a728-4849-85f9-0c0d0a0269d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:07.056918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9610df-a728-4849-85f9-0c0d0a0269d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:07.057209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9610df-a728-4849-85f9-0c0d0a0269d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:07.059177 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-cf9610df-a728-4849-85f9-0c0d0a0269d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:07.087206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:07.092242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa3adb-a2c6-4d51-85bf-8b0b3af215ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc240016ba8447da04bbf7804e3d801, user_id=20fa4a9037534826bb11e503c20b4dcb, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:07.095401 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa3adb-a2c6-4d51-85bf-8b0b3af215ab admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:07.117295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1094/2184] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:07 2022] PUT /identity/v3/projects/bfc240016ba8447da04bbf7804e3d801/users/20fa4a9037534826bb11e503c20b4dcb/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:27:07.123226 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b679a0f-ea29-4105-935d-b2924fbc5341 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:07.123389 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b679a0f-ea29-4105-935d-b2924fbc5341 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:07.136212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b679a0f-ea29-4105-935d-b2924fbc5341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:07.145612 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9610df-a728-4849-85f9-0c0d0a0269d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:07.147343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9610df-a728-4849-85f9-0c0d0a0269d9 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:07.160171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1091/2185] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:07.197401 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-6b679a0f-ea29-4105-935d-b2924fbc5341 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:07.198917 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6b679a0f-ea29-4105-935d-b2924fbc5341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:07.361547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1095/2186] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:07.388442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9610df-a728-4849-85f9-0c0d0a0269d9 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:07.389930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-cf9610df-a728-4849-85f9-0c0d0a0269d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:07.535079 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9610df-a728-4849-85f9-0c0d0a0269d9 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:07.702132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a977fc-c600-4d41-91b3-3be11cee165a None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:07.702342 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a977fc-c600-4d41-91b3-3be11cee165a None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:07.703403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a977fc-c600-4d41-91b3-3be11cee165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:07.741576 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bb231-7cfe-4a2f-9852-19a5ee97b7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:07.742679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bb231-7cfe-4a2f-9852-19a5ee97b7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:07.743221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bb231-7cfe-4a2f-9852-19a5ee97b7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:07.743655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bb231-7cfe-4a2f-9852-19a5ee97b7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:07.771259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bb231-7cfe-4a2f-9852-19a5ee97b7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:07.775916 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bb231-7cfe-4a2f-9852-19a5ee97b7e7 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:07.779721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-61a977fc-c600-4d41-91b3-3be11cee165a None None] MFA Rules not processed for user `2b3ee05c7f1d48a48bf1572a76a7c24e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:07.784229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-61a977fc-c600-4d41-91b3-3be11cee165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:07.822393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1092/2187] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:07.965701 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:07.982695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1096/2188] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:27:07.992187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bb231-7cfe-4a2f-9852-19a5ee97b7e7 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:08.209820 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bb231-7cfe-4a2f-9852-19a5ee97b7e7 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:08.218499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fa1da-de2d-4993-828a-78b44d9d062b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:08.220944 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fa1da-de2d-4993-828a-78b44d9d062b service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:08.221556 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fa1da-de2d-4993-828a-78b44d9d062b service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:08.222091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fa1da-de2d-4993-828a-78b44d9d062b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:08.231572 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-3b9fa1da-de2d-4993-828a-78b44d9d062b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:08.304162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:08.377012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fa1da-de2d-4993-828a-78b44d9d062b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:08.379958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fa1da-de2d-4993-828a-78b44d9d062b service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:08.410790 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1093/2189] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:08.933880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196eb4c-be8b-4d82-8cbb-5be3a01dceaa None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:08.934441 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196eb4c-be8b-4d82-8cbb-5be3a01dceaa None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:08.935957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196eb4c-be8b-4d82-8cbb-5be3a01dceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:09.001661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a196eb4c-be8b-4d82-8cbb-5be3a01dceaa None None] MFA Rules not processed for user `20fa4a9037534826bb11e503c20b4dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:09.001661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a196eb4c-be8b-4d82-8cbb-5be3a01dceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:09.131036 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1097/2190] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:27:09.220959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fa1da-de2d-4993-828a-78b44d9d062b service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:09.222576 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-3b9fa1da-de2d-4993-828a-78b44d9d062b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:09.235003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fa1da-de2d-4993-828a-78b44d9d062b service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:09.239630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1dbf2-f2f6-412c-af50-62144322f152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:09.240275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1dbf2-f2f6-412c-af50-62144322f152 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:09.240538 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1dbf2-f2f6-412c-af50-62144322f152 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:09.240799 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1dbf2-f2f6-412c-af50-62144322f152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:09.251142 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1dbf2-f2f6-412c-af50-62144322f152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:09.252645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1dbf2-f2f6-412c-af50-62144322f152 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:09.263545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1094/2191] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:09.656439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196eb4c-be8b-4d82-8cbb-5be3a01dceaa None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:09.680342 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196eb4c-be8b-4d82-8cbb-5be3a01dceaa None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:09.688580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6a739-1b07-45cb-b0c7-f6a87d29afd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:09.689780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6a739-1b07-45cb-b0c7-f6a87d29afd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:09.690504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6a739-1b07-45cb-b0c7-f6a87d29afd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:09.691168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6a739-1b07-45cb-b0c7-f6a87d29afd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:09.694632 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-fee6a739-1b07-45cb-b0c7-f6a87d29afd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:09.793711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6a739-1b07-45cb-b0c7-f6a87d29afd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:09.795538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6a739-1b07-45cb-b0c7-f6a87d29afd8 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:09.806697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1098/2192] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:09.919441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1dbf2-f2f6-412c-af50-62144322f152 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:09.929198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1dbf2-f2f6-412c-af50-62144322f152 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:09.933866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16512e-7c3d-447b-b83b-02d2d0d819ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:09.934524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16512e-7c3d-447b-b83b-02d2d0d819ed service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:09.934798 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16512e-7c3d-447b-b83b-02d2d0d819ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:09.935091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16512e-7c3d-447b-b83b-02d2d0d819ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:09.945412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16512e-7c3d-447b-b83b-02d2d0d819ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:09.947000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16512e-7c3d-447b-b83b-02d2d0d819ed service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:09.957474 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1095/2193] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:10.657446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6a739-1b07-45cb-b0c7-f6a87d29afd8 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:10.666664 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6a739-1b07-45cb-b0c7-f6a87d29afd8 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:10.670363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7606d7-72cc-44c3-a58e-da8a4832ebd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:10.671040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7606d7-72cc-44c3-a58e-da8a4832ebd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:10.671289 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7606d7-72cc-44c3-a58e-da8a4832ebd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:10.671550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7606d7-72cc-44c3-a58e-da8a4832ebd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:10.754911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7606d7-72cc-44c3-a58e-da8a4832ebd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:10.756641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7606d7-72cc-44c3-a58e-da8a4832ebd6 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:10.768894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1099/2194] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:27:11.900227 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520a5f1-d35a-444f-a621-d9fc80a84a44 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:11.900992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520a5f1-d35a-444f-a621-d9fc80a84a44 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:11.900992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520a5f1-d35a-444f-a621-d9fc80a84a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:11.945096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c520a5f1-d35a-444f-a621-d9fc80a84a44 None None] MFA Rules not processed for user `20fa4a9037534826bb11e503c20b4dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:11.946350 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c520a5f1-d35a-444f-a621-d9fc80a84a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:11.957575 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1096/2195] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:12.013910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7606d7-72cc-44c3-a58e-da8a4832ebd6 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:12.015795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ce7606d7-72cc-44c3-a58e-da8a4832ebd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:12.035905 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7606d7-72cc-44c3-a58e-da8a4832ebd6 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:12.041031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5ba1e-e41e-4043-9be4-5985ff927e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:12.041678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5ba1e-e41e-4043-9be4-5985ff927e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:12.041948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5ba1e-e41e-4043-9be4-5985ff927e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:12.042212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5ba1e-e41e-4043-9be4-5985ff927e0b admin admin] PATH_INFO: `/v3/users/09d048c91b0e4ee294719b90ca796fb1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:12.043407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5ba1e-e41e-4043-9be4-5985ff927e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d048c91b0e4ee294719b90ca796fb1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:12.056287 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5ba1e-e41e-4043-9be4-5985ff927e0b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:12.074858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:12.139465 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e4c5ba1e-e41e-4043-9be4-5985ff927e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d048c91b0e4ee294719b90ca796fb1'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:12.172137 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e4c5ba1e-e41e-4043-9be4-5985ff927e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d048c91b0e4ee294719b90ca796fb1'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:12.200581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e4c5ba1e-e41e-4043-9be4-5985ff927e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d048c91b0e4ee294719b90ca796fb1'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:12.202681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e4c5ba1e-e41e-4043-9be4-5985ff927e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d048c91b0e4ee294719b90ca796fb1'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:12.204159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e4c5ba1e-e41e-4043-9be4-5985ff927e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d048c91b0e4ee294719b90ca796fb1'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:12.242521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1100/2196] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:12 2022] DELETE /identity/v3/users/09d048c91b0e4ee294719b90ca796fb1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:12.251338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b96d3a-aa98-4811-bfe1-615ded6dbd93 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:12.252148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b96d3a-aa98-4811-bfe1-615ded6dbd93 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:12.253246 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b96d3a-aa98-4811-bfe1-615ded6dbd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:12.290681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-88b96d3a-aa98-4811-bfe1-615ded6dbd93 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:12.292057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-88b96d3a-aa98-4811-bfe1-615ded6dbd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:12.399960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1097/2197] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:12.411633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5ba1e-e41e-4043-9be4-5985ff927e0b admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:12.413329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e4c5ba1e-e41e-4043-9be4-5985ff927e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:12.502078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5ba1e-e41e-4043-9be4-5985ff927e0b admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:12.511283 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f597f2-b280-4835-83be-62719891fc5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:12.512410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f597f2-b280-4835-83be-62719891fc5d service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:12.512559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f597f2-b280-4835-83be-62719891fc5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:12.512907 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f597f2-b280-4835-83be-62719891fc5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:12.539579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f597f2-b280-4835-83be-62719891fc5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:12.542486 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f597f2-b280-4835-83be-62719891fc5d service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:12.554758 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1101/2198] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:13.041245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b96d3a-aa98-4811-bfe1-615ded6dbd93 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:13.044282 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-88b96d3a-aa98-4811-bfe1-615ded6dbd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:13.067377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b96d3a-aa98-4811-bfe1-615ded6dbd93 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:13.078008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:13.079084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:13.079451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:13.079829 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] PATH_INFO: `/v3/projects/be068028b54e42a385412cf8f2b8e846` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:13.083324 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be068028b54e42a385412cf8f2b8e846)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:13.085374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:13.167518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be068028b54e42a385412cf8f2b8e846', 'request_id': 'req-ab8d51d5-852e-4284-90be-72d1f64df03b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:13.177132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be068028b54e42a385412cf8f2b8e846', 'request_id': 'req-ab8d51d5-852e-4284-90be-72d1f64df03b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:13.183995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be068028b54e42a385412cf8f2b8e846', 'request_id': 'req-ab8d51d5-852e-4284-90be-72d1f64df03b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:13.197876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] The token cache is being invalidate because project be068028b54e42a385412cf8f2b8e846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:13.198294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:13.198842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:13.200506 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1098/2199] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:13 2022] DELETE /identity/v3/projects/be068028b54e42a385412cf8f2b8e846 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:13.206098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f597f2-b280-4835-83be-62719891fc5d service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:13.218541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f597f2-b280-4835-83be-62719891fc5d service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:13.311385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f91579-f4bc-4b10-ac08-88048167719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:13.315539 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f91579-f4bc-4b10-ac08-88048167719a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:13.315903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f91579-f4bc-4b10-ac08-88048167719a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:13.316314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f91579-f4bc-4b10-ac08-88048167719a admin admin] PATH_INFO: `/v3/users/f9310c5ce7844baeba2fe395ad8057ac` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:13.317816 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f91579-f4bc-4b10-ac08-88048167719a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9310c5ce7844baeba2fe395ad8057ac)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:13.320010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f91579-f4bc-4b10-ac08-88048167719a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:13.366975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:13.378273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a1f91579-f4bc-4b10-ac08-88048167719a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9310c5ce7844baeba2fe395ad8057ac'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:13.392755 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a1f91579-f4bc-4b10-ac08-88048167719a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9310c5ce7844baeba2fe395ad8057ac'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:13.402189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a1f91579-f4bc-4b10-ac08-88048167719a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9310c5ce7844baeba2fe395ad8057ac'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:13.403101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a1f91579-f4bc-4b10-ac08-88048167719a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9310c5ce7844baeba2fe395ad8057ac'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:13.411363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a1f91579-f4bc-4b10-ac08-88048167719a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9310c5ce7844baeba2fe395ad8057ac'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:13.425338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1102/2200] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:13 2022] DELETE /identity/v3/users/f9310c5ce7844baeba2fe395ad8057ac => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:13.858640 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:13.860498 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:13.876049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d51d5-852e-4284-90be-72d1f64df03b admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:13.898224 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:13.983379 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:13.984626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:13.985196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:13.985918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c admin admin] PATH_INFO: `/v3/projects/fb1bcae1e25e49598bc19301fca8eca2` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:13.987978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb1bcae1e25e49598bc19301fca8eca2)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:13.992168 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:14.052169 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb1bcae1e25e49598bc19301fca8eca2', 'request_id': 'req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:14.066776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb1bcae1e25e49598bc19301fca8eca2', 'request_id': 'req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:14.074274 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb1bcae1e25e49598bc19301fca8eca2', 'request_id': 'req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:14.088854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c admin admin] The token cache is being invalidate because project fb1bcae1e25e49598bc19301fca8eca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:14.089150 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:14.089823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-79552a35-f55f-4de5-9ed8-d8ed2a492e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:14.091491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1099/2201] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:13 2022] DELETE /identity/v3/projects/fb1bcae1e25e49598bc19301fca8eca2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:27:14.096967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19635eb3-fc21-4a46-9b55-299fd6e7427f None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:14.097244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19635eb3-fc21-4a46-9b55-299fd6e7427f None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:14.097549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19635eb3-fc21-4a46-9b55-299fd6e7427f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:14.118988 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-19635eb3-fc21-4a46-9b55-299fd6e7427f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:14.120253 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-19635eb3-fc21-4a46-9b55-299fd6e7427f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:14.200662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1103/2202] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:14.209905 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d7221-d212-45ca-9348-14b95f907aa6 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:14.210178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d7221-d212-45ca-9348-14b95f907aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:14.210447 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d7221-d212-45ca-9348-14b95f907aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:14.231797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-c76d7221-d212-45ca-9348-14b95f907aa6 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:14.233032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c76d7221-d212-45ca-9348-14b95f907aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:14.241341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1100/2203] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:14.245767 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19635eb3-fc21-4a46-9b55-299fd6e7427f None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:14.256153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19635eb3-fc21-4a46-9b55-299fd6e7427f None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:14.261317 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e46289-58f6-4e49-b659-dae709dc220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:14.261943 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e46289-58f6-4e49-b659-dae709dc220a admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:14.262211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e46289-58f6-4e49-b659-dae709dc220a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:14.262473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e46289-58f6-4e49-b659-dae709dc220a admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:14.263164 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e46289-58f6-4e49-b659-dae709dc220a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:27:14.263517 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e46289-58f6-4e49-b659-dae709dc220a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:14.265134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e46289-58f6-4e49-b659-dae709dc220a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:14.278444 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1104/2204] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:27:14.282932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d7221-d212-45ca-9348-14b95f907aa6 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:14.293245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d7221-d212-45ca-9348-14b95f907aa6 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:14.303807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10426c68-4f06-41b4-870b-683ff87f1119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:14.303807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10426c68-4f06-41b4-870b-683ff87f1119 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:14.303807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10426c68-4f06-41b4-870b-683ff87f1119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:14.303807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10426c68-4f06-41b4-870b-683ff87f1119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:14.304165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10426c68-4f06-41b4-870b-683ff87f1119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:14.304165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10426c68-4f06-41b4-870b-683ff87f1119 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:14.337465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1101/2205] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:27:14 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:14.341649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e46289-58f6-4e49-b659-dae709dc220a admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:14.352857 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e46289-58f6-4e49-b659-dae709dc220a admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:14.427978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50835a45-d2d4-4602-ae5d-da904fb86ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:14.428665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835a45-d2d4-4602-ae5d-da904fb86ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:14.428984 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835a45-d2d4-4602-ae5d-da904fb86ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:14.429235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835a45-d2d4-4602-ae5d-da904fb86ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:14.429801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50835a45-d2d4-4602-ae5d-da904fb86ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:14.431978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50835a45-d2d4-4602-ae5d-da904fb86ca7 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:14.458603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1105/2206] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:27:14 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:14.459891 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10426c68-4f06-41b4-870b-683ff87f1119 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:14.476626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10426c68-4f06-41b4-870b-683ff87f1119 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:14.481985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc7321-4090-4b6e-ad25-e99e549e8c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:14.482710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc7321-4090-4b6e-ad25-e99e549e8c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:14.483086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc7321-4090-4b6e-ad25-e99e549e8c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:14.483419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc7321-4090-4b6e-ad25-e99e549e8c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:14.484150 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc7321-4090-4b6e-ad25-e99e549e8c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:14.485868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc7321-4090-4b6e-ad25-e99e549e8c22 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:14.497669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1102/2207] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:27:14.501906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50835a45-d2d4-4602-ae5d-da904fb86ca7 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:14.512889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50835a45-d2d4-4602-ae5d-da904fb86ca7 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:14.517582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbe316-a32d-4b76-a22d-14558a89acc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:14.518201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbe316-a32d-4b76-a22d-14558a89acc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:14.518461 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbe316-a32d-4b76-a22d-14558a89acc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:14.518730 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbe316-a32d-4b76-a22d-14558a89acc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:14.519458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbe316-a32d-4b76-a22d-14558a89acc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:14.521077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbe316-a32d-4b76-a22d-14558a89acc4 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:14.533700 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1106/2208] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:14.538242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc7321-4090-4b6e-ad25-e99e549e8c22 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:14.549432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc7321-4090-4b6e-ad25-e99e549e8c22 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:14.556833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2199e6-b40e-4cb6-8e9e-f63182686beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:14.557937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2199e6-b40e-4cb6-8e9e-f63182686beb admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:14.558488 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2199e6-b40e-4cb6-8e9e-f63182686beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:14.558993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2199e6-b40e-4cb6-8e9e-f63182686beb admin admin] PATH_INFO: `/v3/projects/a8346a7c08c5429b80ae26659c0cf3b8/users/a355fcea992c43d1b2d5dff9fcf698db/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:14.588334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2199e6-b40e-4cb6-8e9e-f63182686beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8346a7c08c5429b80ae26659c0cf3b8, user_id=a355fcea992c43d1b2d5dff9fcf698db, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:14.593823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2199e6-b40e-4cb6-8e9e-f63182686beb admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:14.612744 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1103/2209] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:14 2022] PUT /identity/v3/projects/a8346a7c08c5429b80ae26659c0cf3b8/users/a355fcea992c43d1b2d5dff9fcf698db/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:14.623298 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538281c-6b65-4f89-a744-f0069b454f02 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:14.623558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538281c-6b65-4f89-a744-f0069b454f02 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:14.623825 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538281c-6b65-4f89-a744-f0069b454f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:14.660599 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a538281c-6b65-4f89-a744-f0069b454f02 None None] MFA Rules not processed for user `a355fcea992c43d1b2d5dff9fcf698db`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:14.661820 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a538281c-6b65-4f89-a744-f0069b454f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:14.671708 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:14.753992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1107/2210] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:14.758797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2199e6-b40e-4cb6-8e9e-f63182686beb admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:14.814097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:14.833300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2199e6-b40e-4cb6-8e9e-f63182686beb admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:14.839556 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fdfbb-be1c-4239-9b41-8aefeb17a709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:14.840117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fdfbb-be1c-4239-9b41-8aefeb17a709 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:14.840394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fdfbb-be1c-4239-9b41-8aefeb17a709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:14.840665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fdfbb-be1c-4239-9b41-8aefeb17a709 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:14.841520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fdfbb-be1c-4239-9b41-8aefeb17a709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:14.843261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fdfbb-be1c-4239-9b41-8aefeb17a709 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:14.876505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1104/2211] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:27:14 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:14.881046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538281c-6b65-4f89-a744-f0069b454f02 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:14.894727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538281c-6b65-4f89-a744-f0069b454f02 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:14.981930 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac6f8-d9bb-4faa-8fef-ece6814447af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:14.982557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac6f8-d9bb-4faa-8fef-ece6814447af admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:14.982846 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac6f8-d9bb-4faa-8fef-ece6814447af admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:14.983150 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac6f8-d9bb-4faa-8fef-ece6814447af admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:14.984297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ac6f8-d9bb-4faa-8fef-ece6814447af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:14.986292 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ac6f8-d9bb-4faa-8fef-ece6814447af admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:15.028503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1108/2212] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:27:14 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:27:15.038765 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fdfbb-be1c-4239-9b41-8aefeb17a709 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:15.054231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fdfbb-be1c-4239-9b41-8aefeb17a709 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:15.060655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa93281-9f0b-4029-b154-2a52e7cbcda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:15.061381 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa93281-9f0b-4029-b154-2a52e7cbcda5 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:15.061856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa93281-9f0b-4029-b154-2a52e7cbcda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:15.062199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa93281-9f0b-4029-b154-2a52e7cbcda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:15.063001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa93281-9f0b-4029-b154-2a52e7cbcda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:15.064723 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa93281-9f0b-4029-b154-2a52e7cbcda5 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:15.079448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1105/2213] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:15.084498 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac6f8-d9bb-4faa-8fef-ece6814447af admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:15.105632 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac6f8-d9bb-4faa-8fef-ece6814447af admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:15.113682 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507306e-64d7-442f-9ee2-a0d460e75867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:15.114748 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507306e-64d7-442f-9ee2-a0d460e75867 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:15.115240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507306e-64d7-442f-9ee2-a0d460e75867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:15.115698 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507306e-64d7-442f-9ee2-a0d460e75867 admin admin] PATH_INFO: `/v3/projects/72c2a90b745543e2b69d700cc1325a73/users/4b83e31831d84fa8ba45db8c104bed07/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:15.139193 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507306e-64d7-442f-9ee2-a0d460e75867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c2a90b745543e2b69d700cc1325a73, user_id=4b83e31831d84fa8ba45db8c104bed07, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:15.141891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507306e-64d7-442f-9ee2-a0d460e75867 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:15.154697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa93281-9f0b-4029-b154-2a52e7cbcda5 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:15.157269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6fa93281-9f0b-4029-b154-2a52e7cbcda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:15.158651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1109/2214] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:15 2022] PUT /identity/v3/projects/72c2a90b745543e2b69d700cc1325a73/users/4b83e31831d84fa8ba45db8c104bed07/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:15.162555 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507306e-64d7-442f-9ee2-a0d460e75867 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:15.173820 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa93281-9f0b-4029-b154-2a52e7cbcda5 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:15.269639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507306e-64d7-442f-9ee2-a0d460e75867 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:15.278417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea94023-762b-401c-9cb1-4f08c059efd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:15.279119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea94023-762b-401c-9cb1-4f08c059efd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:15.279583 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea94023-762b-401c-9cb1-4f08c059efd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:15.279867 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea94023-762b-401c-9cb1-4f08c059efd6 admin admin] PATH_INFO: `/v3/users/0e0dfa142d1c43ee810c31814cf67224` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:15.282357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea94023-762b-401c-9cb1-4f08c059efd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0dfa142d1c43ee810c31814cf67224)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:15.282751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d0c1a-51c4-4112-ae3e-cbe326a06b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:15.283587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d0c1a-51c4-4112-ae3e-cbe326a06b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:15.284047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d0c1a-51c4-4112-ae3e-cbe326a06b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:15.284197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d0c1a-51c4-4112-ae3e-cbe326a06b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:15.284628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea94023-762b-401c-9cb1-4f08c059efd6 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:15.284863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d0c1a-51c4-4112-ae3e-cbe326a06b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:15.288118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d0c1a-51c4-4112-ae3e-cbe326a06b52 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:15.300570 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1110/2215] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:27:15.304986 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d0c1a-51c4-4112-ae3e-cbe326a06b52 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:15.320493 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d0c1a-51c4-4112-ae3e-cbe326a06b52 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:15.330296 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e01ff-407f-4bab-8ec2-34635c629c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:15.331840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e01ff-407f-4bab-8ec2-34635c629c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:15.332249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e01ff-407f-4bab-8ec2-34635c629c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:15.332518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e01ff-407f-4bab-8ec2-34635c629c41 admin admin] PATH_INFO: `/v3/projects/72c2a90b745543e2b69d700cc1325a73/users/4b83e31831d84fa8ba45db8c104bed07/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:15.335331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e01ff-407f-4bab-8ec2-34635c629c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c2a90b745543e2b69d700cc1325a73, user_id=4b83e31831d84fa8ba45db8c104bed07, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:15.338075 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e01ff-407f-4bab-8ec2-34635c629c41 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:15.351835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:15.359975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1111/2216] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:15 2022] PUT /identity/v3/projects/72c2a90b745543e2b69d700cc1325a73/users/4b83e31831d84fa8ba45db8c104bed07/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:27:15.370609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0ea94023-762b-401c-9cb1-4f08c059efd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0dfa142d1c43ee810c31814cf67224'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:15.370772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce2881-bfbf-401c-a871-a4ade73b1c8d None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:15.372338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce2881-bfbf-401c-a871-a4ade73b1c8d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:15.372978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce2881-bfbf-401c-a871-a4ade73b1c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:15.380913 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0ea94023-762b-401c-9cb1-4f08c059efd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0dfa142d1c43ee810c31814cf67224'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:15.381756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0ea94023-762b-401c-9cb1-4f08c059efd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0dfa142d1c43ee810c31814cf67224'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:15.382465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0ea94023-762b-401c-9cb1-4f08c059efd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0dfa142d1c43ee810c31814cf67224'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:15.397378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0ea94023-762b-401c-9cb1-4f08c059efd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0dfa142d1c43ee810c31814cf67224'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:15.419706 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1106/2217] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:15 2022] DELETE /identity/v3/users/0e0dfa142d1c43ee810c31814cf67224 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:27:15.421840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-86ce2881-bfbf-401c-a871-a4ade73b1c8d None None] MFA Rules not processed for user `4b83e31831d84fa8ba45db8c104bed07`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:15.423840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-86ce2881-bfbf-401c-a871-a4ade73b1c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:15.424636 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226a57-9819-4f4b-8903-91ac42def5b1 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:15.424998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226a57-9819-4f4b-8903-91ac42def5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:15.425338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226a57-9819-4f4b-8903-91ac42def5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:15.447303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-d3226a57-9819-4f4b-8903-91ac42def5b1 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:15.448544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d3226a57-9819-4f4b-8903-91ac42def5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:15.506128 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:15.539359 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1107/2218] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:15.555053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3226a57-9819-4f4b-8903-91ac42def5b1 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:15.557900 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d3226a57-9819-4f4b-8903-91ac42def5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:15.561326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1112/2219] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:15.576614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce2881-bfbf-401c-a871-a4ade73b1c8d None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:15.578256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-86ce2881-bfbf-401c-a871-a4ade73b1c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:15.658199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3226a57-9819-4f4b-8903-91ac42def5b1 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:15.661822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b658c2-5fd0-4e44-b4e3-bbc0aa53b425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:15.662432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b658c2-5fd0-4e44-b4e3-bbc0aa53b425 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:15.662704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b658c2-5fd0-4e44-b4e3-bbc0aa53b425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:15.663020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b658c2-5fd0-4e44-b4e3-bbc0aa53b425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:15.672720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b658c2-5fd0-4e44-b4e3-bbc0aa53b425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:15.674164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b658c2-5fd0-4e44-b4e3-bbc0aa53b425 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:15.681742 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce2881-bfbf-401c-a871-a4ade73b1c8d None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:15.684587 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1108/2220] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:15.688273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ee32c-1bce-4d98-b579-dfb3f764ab86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:15.688913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ee32c-1bce-4d98-b579-dfb3f764ab86 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:15.689182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ee32c-1bce-4d98-b579-dfb3f764ab86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:15.689449 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ee32c-1bce-4d98-b579-dfb3f764ab86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:15.700157 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ee32c-1bce-4d98-b579-dfb3f764ab86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:15.702170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ee32c-1bce-4d98-b579-dfb3f764ab86 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:15.714431 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1113/2221] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:16.224881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b658c2-5fd0-4e44-b4e3-bbc0aa53b425 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:16.233703 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e6b658c2-5fd0-4e44-b4e3-bbc0aa53b425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:16.274196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b658c2-5fd0-4e44-b4e3-bbc0aa53b425 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:16.280024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:16.280776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:16.281231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:16.282344 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] PATH_INFO: `/v3/projects/951cb6214910431385e31db6e0d7e2df` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:16.283356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=951cb6214910431385e31db6e0d7e2df)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:16.285643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:16.377159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951cb6214910431385e31db6e0d7e2df', 'request_id': 'req-4e188b53-f133-48f8-9bc6-6d22bb58edd3'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.389073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951cb6214910431385e31db6e0d7e2df', 'request_id': 'req-4e188b53-f133-48f8-9bc6-6d22bb58edd3'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.398128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ee32c-1bce-4d98-b579-dfb3f764ab86 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:16.398745 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951cb6214910431385e31db6e0d7e2df', 'request_id': 'req-4e188b53-f133-48f8-9bc6-6d22bb58edd3'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.399532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-2a0ee32c-1bce-4d98-b579-dfb3f764ab86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:16.423527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] The token cache is being invalidate because project 951cb6214910431385e31db6e0d7e2df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:16.423817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.424628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.426557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1109/2222] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:16 2022] DELETE /identity/v3/projects/951cb6214910431385e31db6e0d7e2df => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:16.428641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ee32c-1bce-4d98-b579-dfb3f764ab86 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:16.430335 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:16.431880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:16.519168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6baaa7-ab46-4fba-97b0-6299aacde8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:16.519922 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6baaa7-ab46-4fba-97b0-6299aacde8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:16.520226 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6baaa7-ab46-4fba-97b0-6299aacde8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:16.520492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6baaa7-ab46-4fba-97b0-6299aacde8ef admin admin] PATH_INFO: `/v3/users/a355fcea992c43d1b2d5dff9fcf698db` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:16.522087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6baaa7-ab46-4fba-97b0-6299aacde8ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a355fcea992c43d1b2d5dff9fcf698db)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:16.524478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6baaa7-ab46-4fba-97b0-6299aacde8ef admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:16.544855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e188b53-f133-48f8-9bc6-6d22bb58edd3 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:16.550755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315cd0e-1d0f-44a5-be69-e87dcfe4be81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:16.551555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315cd0e-1d0f-44a5-be69-e87dcfe4be81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:16.551833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315cd0e-1d0f-44a5-be69-e87dcfe4be81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:16.552096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315cd0e-1d0f-44a5-be69-e87dcfe4be81 admin admin] PATH_INFO: `/v3/users/29f722b489774290b04de62e1403c85d` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:16.553360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315cd0e-1d0f-44a5-be69-e87dcfe4be81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f722b489774290b04de62e1403c85d)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:16.555376 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315cd0e-1d0f-44a5-be69-e87dcfe4be81 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:16.561591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:16.584136 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:16.642537 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-5f6baaa7-ab46-4fba-97b0-6299aacde8ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a355fcea992c43d1b2d5dff9fcf698db'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.690637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-5f6baaa7-ab46-4fba-97b0-6299aacde8ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a355fcea992c43d1b2d5dff9fcf698db'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.701589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e315cd0e-1d0f-44a5-be69-e87dcfe4be81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f722b489774290b04de62e1403c85d'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.713206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-5f6baaa7-ab46-4fba-97b0-6299aacde8ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a355fcea992c43d1b2d5dff9fcf698db'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.713717 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-5f6baaa7-ab46-4fba-97b0-6299aacde8ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a355fcea992c43d1b2d5dff9fcf698db'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.714933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-5f6baaa7-ab46-4fba-97b0-6299aacde8ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a355fcea992c43d1b2d5dff9fcf698db'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.723558 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e315cd0e-1d0f-44a5-be69-e87dcfe4be81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f722b489774290b04de62e1403c85d'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.725026 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e315cd0e-1d0f-44a5-be69-e87dcfe4be81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f722b489774290b04de62e1403c85d'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.726647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e315cd0e-1d0f-44a5-be69-e87dcfe4be81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f722b489774290b04de62e1403c85d'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.738888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1114/2223] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:16 2022] DELETE /identity/v3/users/a355fcea992c43d1b2d5dff9fcf698db => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:16.743745 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9ecb4-2fc9-4843-bdec-511206c6f150 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:16.744314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9ecb4-2fc9-4843-bdec-511206c6f150 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:16.745189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9ecb4-2fc9-4843-bdec-511206c6f150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:16.765232 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e315cd0e-1d0f-44a5-be69-e87dcfe4be81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f722b489774290b04de62e1403c85d'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:16.788768 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-bda9ecb4-2fc9-4843-bdec-511206c6f150 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:16.795203 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-bda9ecb4-2fc9-4843-bdec-511206c6f150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:16.802744 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1110/2224] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:16 2022] DELETE /identity/v3/users/29f722b489774290b04de62e1403c85d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:27:16.934239 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1115/2225] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:16.949622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315cd0e-1d0f-44a5-be69-e87dcfe4be81 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:16.951461 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e315cd0e-1d0f-44a5-be69-e87dcfe4be81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:17.037566 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315cd0e-1d0f-44a5-be69-e87dcfe4be81 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:17.043380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6847d-7941-43cf-a355-b68a2f61b274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:17.044322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6847d-7941-43cf-a355-b68a2f61b274 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:17.044694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6847d-7941-43cf-a355-b68a2f61b274 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:17.045120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6847d-7941-43cf-a355-b68a2f61b274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:17.057088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6847d-7941-43cf-a355-b68a2f61b274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:17.059105 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6847d-7941-43cf-a355-b68a2f61b274 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:17.071826 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1111/2226] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:17.567378 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9ecb4-2fc9-4843-bdec-511206c6f150 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:17.568952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-bda9ecb4-2fc9-4843-bdec-511206c6f150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:17.581815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9ecb4-2fc9-4843-bdec-511206c6f150 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:17.587034 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:17.587692 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:17.587969 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:17.588235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] PATH_INFO: `/v3/projects/a8346a7c08c5429b80ae26659c0cf3b8` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:17.589462 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8346a7c08c5429b80ae26659c0cf3b8)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:17.591476 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:17.664342 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8346a7c08c5429b80ae26659c0cf3b8', 'request_id': 'req-bf5d6409-7027-4ad4-b343-da1e4edc1506'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:17.671880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6847d-7941-43cf-a355-b68a2f61b274 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:17.675071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a1b6847d-7941-43cf-a355-b68a2f61b274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:17.694513 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8346a7c08c5429b80ae26659c0cf3b8', 'request_id': 'req-bf5d6409-7027-4ad4-b343-da1e4edc1506'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:17.699761 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6847d-7941-43cf-a355-b68a2f61b274 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:17.712756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8346a7c08c5429b80ae26659c0cf3b8', 'request_id': 'req-bf5d6409-7027-4ad4-b343-da1e4edc1506'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:17.728779 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] The token cache is being invalidate because project a8346a7c08c5429b80ae26659c0cf3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:17.729113 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:17.729744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:17.731668 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1116/2227] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:17 2022] DELETE /identity/v3/projects/a8346a7c08c5429b80ae26659c0cf3b8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:17.736439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:17.738928 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:17.786004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:17.804868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:17.805666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:17.806048 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:17.806630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] PATH_INFO: `/v3/projects/eeb009d0500748adab3238168c7ff54a` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:17.808245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb009d0500748adab3238168c7ff54a)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:17.810333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:17.839844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d6409-7027-4ad4-b343-da1e4edc1506 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:17.846019 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bf157-5528-4103-90b9-bf64b954e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:17.846867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bf157-5528-4103-90b9-bf64b954e5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:17.847354 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bf157-5528-4103-90b9-bf64b954e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:17.848124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bf157-5528-4103-90b9-bf64b954e5e5 admin admin] PATH_INFO: `/v3/users/4b83e31831d84fa8ba45db8c104bed07` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:17.849579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bf157-5528-4103-90b9-bf64b954e5e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b83e31831d84fa8ba45db8c104bed07)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:17.851987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bf157-5528-4103-90b9-bf64b954e5e5 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:17.864205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:17.896464 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb009d0500748adab3238168c7ff54a', 'request_id': 'req-0c192256-167a-4404-a135-6e5ca8965c3c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:17.905167 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb009d0500748adab3238168c7ff54a', 'request_id': 'req-0c192256-167a-4404-a135-6e5ca8965c3c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:17.913203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb009d0500748adab3238168c7ff54a', 'request_id': 'req-0c192256-167a-4404-a135-6e5ca8965c3c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:17.933530 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] The token cache is being invalidate because project eeb009d0500748adab3238168c7ff54a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:17.934541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:17.940138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b08bf157-5528-4103-90b9-bf64b954e5e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b83e31831d84fa8ba45db8c104bed07'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:17.940883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:17.945694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1112/2228] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:17 2022] DELETE /identity/v3/projects/eeb009d0500748adab3238168c7ff54a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:17.946718 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:17.951098 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:18.020534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b08bf157-5528-4103-90b9-bf64b954e5e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b83e31831d84fa8ba45db8c104bed07'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:18.051929 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b08bf157-5528-4103-90b9-bf64b954e5e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b83e31831d84fa8ba45db8c104bed07'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:18.057314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b08bf157-5528-4103-90b9-bf64b954e5e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b83e31831d84fa8ba45db8c104bed07'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:18.058154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b08bf157-5528-4103-90b9-bf64b954e5e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b83e31831d84fa8ba45db8c104bed07'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:18.093979 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1117/2229] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:17 2022] DELETE /identity/v3/users/4b83e31831d84fa8ba45db8c104bed07 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:27:18.112415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c192256-167a-4404-a135-6e5ca8965c3c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:18.291784 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809655f0-3e89-42cc-9093-0f9c7c650e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:18.292469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809655f0-3e89-42cc-9093-0f9c7c650e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:18.292738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809655f0-3e89-42cc-9093-0f9c7c650e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:18.293018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809655f0-3e89-42cc-9093-0f9c7c650e44 admin admin] PATH_INFO: `/v3/users/cf1902d87a8b4055a140a412299bd1c0` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:18.294383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809655f0-3e89-42cc-9093-0f9c7c650e44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1902d87a8b4055a140a412299bd1c0)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:18.296382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809655f0-3e89-42cc-9093-0f9c7c650e44 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:18.407088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-809655f0-3e89-42cc-9093-0f9c7c650e44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1902d87a8b4055a140a412299bd1c0'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:18.438088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-809655f0-3e89-42cc-9093-0f9c7c650e44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1902d87a8b4055a140a412299bd1c0'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:18.439258 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-809655f0-3e89-42cc-9093-0f9c7c650e44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1902d87a8b4055a140a412299bd1c0'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:18.441134 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-809655f0-3e89-42cc-9093-0f9c7c650e44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1902d87a8b4055a140a412299bd1c0'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:18.458637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:18.460818 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-809655f0-3e89-42cc-9093-0f9c7c650e44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1902d87a8b4055a140a412299bd1c0'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:18.494372 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1113/2230] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:17 2022] DELETE /identity/v3/users/cf1902d87a8b4055a140a412299bd1c0 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:27:18.767487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bf157-5528-4103-90b9-bf64b954e5e5 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:18.769408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b08bf157-5528-4103-90b9-bf64b954e5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:18.784381 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bf157-5528-4103-90b9-bf64b954e5e5 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:18.908180 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:18.908978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:18.909290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:18.909748 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5 admin admin] PATH_INFO: `/v3/projects/72c2a90b745543e2b69d700cc1325a73` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:18.911708 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c2a90b745543e2b69d700cc1325a73)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:18.914361 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:18.941671 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809655f0-3e89-42cc-9093-0f9c7c650e44 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:18.944040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-809655f0-3e89-42cc-9093-0f9c7c650e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:18.960887 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809655f0-3e89-42cc-9093-0f9c7c650e44 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:18.967803 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:18.968918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:18.969368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:18.969807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440 admin admin] PATH_INFO: `/v3/projects/f79f5224b9a44b0b87f3853c1fdb348e` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:18.971553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79f5224b9a44b0b87f3853c1fdb348e)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:18.974611 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:19.015531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c2a90b745543e2b69d700cc1325a73', 'request_id': 'req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:19.019572 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:19.029790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c2a90b745543e2b69d700cc1325a73', 'request_id': 'req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:19.050096 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c2a90b745543e2b69d700cc1325a73', 'request_id': 'req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:19.065108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5 admin admin] The token cache is being invalidate because project 72c2a90b745543e2b69d700cc1325a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:19.065513 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:19.066479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-538d5a5a-4dd7-428b-b3be-0cb50cc553f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:19.068414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1118/2231] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:18 2022] DELETE /identity/v3/projects/72c2a90b745543e2b69d700cc1325a73 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:19.075277 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79f5224b9a44b0b87f3853c1fdb348e', 'request_id': 'req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:19.098530 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79f5224b9a44b0b87f3853c1fdb348e', 'request_id': 'req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:19.116667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79f5224b9a44b0b87f3853c1fdb348e', 'request_id': 'req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:19.147856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440 admin admin] The token cache is being invalidate because project f79f5224b9a44b0b87f3853c1fdb348e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:19.148123 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:19.150463 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2aeb68f6-f33f-4b9e-b4c3-fe6bfdc61440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:19.154030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1114/2232] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:18 2022] DELETE /identity/v3/projects/f79f5224b9a44b0b87f3853c1fdb348e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:27:19.159336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaff1e-fa84-40eb-bc39-e119c76e0590 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:19.159614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaff1e-fa84-40eb-bc39-e119c76e0590 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:19.159912 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaff1e-fa84-40eb-bc39-e119c76e0590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:19.214803 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b8eaff1e-fa84-40eb-bc39-e119c76e0590 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:19.218949 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b8eaff1e-fa84-40eb-bc39-e119c76e0590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:19.373082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1119/2233] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:19.380838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316852ca-a4e3-406d-aedb-f878ae32c050 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:19.380981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316852ca-a4e3-406d-aedb-f878ae32c050 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:19.381229 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316852ca-a4e3-406d-aedb-f878ae32c050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:19.414135 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-316852ca-a4e3-406d-aedb-f878ae32c050 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:19.415625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-316852ca-a4e3-406d-aedb-f878ae32c050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:19.431827 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1115/2234] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:27:19.436087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaff1e-fa84-40eb-bc39-e119c76e0590 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:19.448030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaff1e-fa84-40eb-bc39-e119c76e0590 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:19.453095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9570f-c274-43c4-a43b-a80d5f90da3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:19.453714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9570f-c274-43c4-a43b-a80d5f90da3a admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:19.453987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9570f-c274-43c4-a43b-a80d5f90da3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:19.454375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9570f-c274-43c4-a43b-a80d5f90da3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:19.455076 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9570f-c274-43c4-a43b-a80d5f90da3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:27:19.455530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9570f-c274-43c4-a43b-a80d5f90da3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:19.457451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9570f-c274-43c4-a43b-a80d5f90da3a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:19.475498 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1120/2235] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:27:19.482701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316852ca-a4e3-406d-aedb-f878ae32c050 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:19.503070 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316852ca-a4e3-406d-aedb-f878ae32c050 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:19.513317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f3e8d-1c0e-45c4-97c0-61cde7d8a5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:19.513317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f3e8d-1c0e-45c4-97c0-61cde7d8a5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:19.513317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f3e8d-1c0e-45c4-97c0-61cde7d8a5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:19.518349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f3e8d-1c0e-45c4-97c0-61cde7d8a5c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:19.518349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f3e8d-1c0e-45c4-97c0-61cde7d8a5c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:19.519073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f3e8d-1c0e-45c4-97c0-61cde7d8a5c6 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:19.574182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1116/2236] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:27:19 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:19.575152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9570f-c274-43c4-a43b-a80d5f90da3a admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:19.588583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9570f-c274-43c4-a43b-a80d5f90da3a admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:19.694384 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89deb8-c081-4db8-ab93-892c3d39645f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:19.695957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89deb8-c081-4db8-ab93-892c3d39645f admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:19.696232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89deb8-c081-4db8-ab93-892c3d39645f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:19.696499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89deb8-c081-4db8-ab93-892c3d39645f admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:19.697140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89deb8-c081-4db8-ab93-892c3d39645f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:19.699811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89deb8-c081-4db8-ab93-892c3d39645f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:19.739314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1121/2237] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:27:19 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:19.739425 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f3e8d-1c0e-45c4-97c0-61cde7d8a5c6 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:19.750805 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f3e8d-1c0e-45c4-97c0-61cde7d8a5c6 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:19.756226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45679b-4759-463a-a6da-fd19fc93239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:19.757011 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45679b-4759-463a-a6da-fd19fc93239e admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:19.757285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45679b-4759-463a-a6da-fd19fc93239e admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:19.757549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45679b-4759-463a-a6da-fd19fc93239e admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:19.758528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45679b-4759-463a-a6da-fd19fc93239e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:19.760019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45679b-4759-463a-a6da-fd19fc93239e admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:19.772605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1117/2238] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:27:19.776925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89deb8-c081-4db8-ab93-892c3d39645f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:19.800811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89deb8-c081-4db8-ab93-892c3d39645f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:19.809964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56de40-028c-4c5d-a30d-6f0a98a827ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:19.810739 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56de40-028c-4c5d-a30d-6f0a98a827ad admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:19.811491 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56de40-028c-4c5d-a30d-6f0a98a827ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:19.811491 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56de40-028c-4c5d-a30d-6f0a98a827ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:19.812254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56de40-028c-4c5d-a30d-6f0a98a827ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:19.816787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56de40-028c-4c5d-a30d-6f0a98a827ad admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:19.840083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1122/2239] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:19.843930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45679b-4759-463a-a6da-fd19fc93239e admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:19.856448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45679b-4759-463a-a6da-fd19fc93239e admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:19.863994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aeaae-d704-4e5f-9f43-48f5ddc213e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:19.864803 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aeaae-d704-4e5f-9f43-48f5ddc213e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:19.865184 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aeaae-d704-4e5f-9f43-48f5ddc213e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:19.865557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aeaae-d704-4e5f-9f43-48f5ddc213e9 admin admin] PATH_INFO: `/v3/projects/7fec1f5ba8ef43ba9a04a16e17b9ad6d/users/72941424337943908351c9d6c812ce97/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:19.910205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aeaae-d704-4e5f-9f43-48f5ddc213e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fec1f5ba8ef43ba9a04a16e17b9ad6d, user_id=72941424337943908351c9d6c812ce97, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:19.916761 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aeaae-d704-4e5f-9f43-48f5ddc213e9 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:19.950683 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1118/2240] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:19 2022] PUT /identity/v3/projects/7fec1f5ba8ef43ba9a04a16e17b9ad6d/users/72941424337943908351c9d6c812ce97/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:19.961229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725e45-5e14-4904-a502-86e7fcab9eb0 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:19.961514 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725e45-5e14-4904-a502-86e7fcab9eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:19.961787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725e45-5e14-4904-a502-86e7fcab9eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:20.005121 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-51725e45-5e14-4904-a502-86e7fcab9eb0 None None] MFA Rules not processed for user `72941424337943908351c9d6c812ce97`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:20.007161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-51725e45-5e14-4904-a502-86e7fcab9eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:20.053348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:20.102132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1123/2241] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:20.115981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aeaae-d704-4e5f-9f43-48f5ddc213e9 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:20.118024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-843aeaae-d704-4e5f-9f43-48f5ddc213e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:20.185774 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aeaae-d704-4e5f-9f43-48f5ddc213e9 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:20.189764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0a1e3-1d33-4ed3-95a3-06885a57bbcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:20.190391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0a1e3-1d33-4ed3-95a3-06885a57bbcf service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:20.190667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0a1e3-1d33-4ed3-95a3-06885a57bbcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:20.191018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0a1e3-1d33-4ed3-95a3-06885a57bbcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:20.200181 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0a1e3-1d33-4ed3-95a3-06885a57bbcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:20.201634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0a1e3-1d33-4ed3-95a3-06885a57bbcf service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:20.211576 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1119/2242] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:21.692718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675e9fd-a03e-4b2c-b97e-b361b03f2934 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:21.693329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675e9fd-a03e-4b2c-b97e-b361b03f2934 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:21.693700 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675e9fd-a03e-4b2c-b97e-b361b03f2934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:21.720596 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c675e9fd-a03e-4b2c-b97e-b361b03f2934 None None] MFA Rules not processed for user `72941424337943908351c9d6c812ce97`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:21.721854 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c675e9fd-a03e-4b2c-b97e-b361b03f2934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:21.730189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1124/2243] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:26.879999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0a1e3-1d33-4ed3-95a3-06885a57bbcf service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:26.882046 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-64c0a1e3-1d33-4ed3-95a3-06885a57bbcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:26.906876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:27.025321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0a1e3-1d33-4ed3-95a3-06885a57bbcf service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:27.031607 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763f9d0-69b7-458e-b860-a24e2620a58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:27.032376 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763f9d0-69b7-458e-b860-a24e2620a58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:27.032850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763f9d0-69b7-458e-b860-a24e2620a58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:27.033169 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763f9d0-69b7-458e-b860-a24e2620a58a admin admin] PATH_INFO: `/v3/users/00b3cd9e2c3e48c299037759cab9ccce` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:27.036178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763f9d0-69b7-458e-b860-a24e2620a58a admin admin] RBAC: Authorizing `identity:delete_user(user_id=00b3cd9e2c3e48c299037759cab9ccce)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:27.036529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763f9d0-69b7-458e-b860-a24e2620a58a admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:27.087036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2763f9d0-69b7-458e-b860-a24e2620a58a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00b3cd9e2c3e48c299037759cab9ccce'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:27.095998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2763f9d0-69b7-458e-b860-a24e2620a58a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00b3cd9e2c3e48c299037759cab9ccce'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:27.096613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2763f9d0-69b7-458e-b860-a24e2620a58a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00b3cd9e2c3e48c299037759cab9ccce'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:27.097677 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2763f9d0-69b7-458e-b860-a24e2620a58a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00b3cd9e2c3e48c299037759cab9ccce'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:27.110653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2763f9d0-69b7-458e-b860-a24e2620a58a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00b3cd9e2c3e48c299037759cab9ccce'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:27.123772 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1120/2244] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:26 2022] DELETE /identity/v3/users/00b3cd9e2c3e48c299037759cab9ccce => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:27.334647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675e9fd-a03e-4b2c-b97e-b361b03f2934 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:27.354654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675e9fd-a03e-4b2c-b97e-b361b03f2934 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:27.431723 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18513a53-6799-407c-bbd0-65e8bece9973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:27.432675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513a53-6799-407c-bbd0-65e8bece9973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:27.432944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513a53-6799-407c-bbd0-65e8bece9973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:27.433350 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513a53-6799-407c-bbd0-65e8bece9973 admin admin] PATH_INFO: `/v3/projects/ec50a06edc0445e798202c786b37aa19` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:27.434610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18513a53-6799-407c-bbd0-65e8bece9973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec50a06edc0445e798202c786b37aa19)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:27.436568 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18513a53-6799-407c-bbd0-65e8bece9973 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:27.492732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-18513a53-6799-407c-bbd0-65e8bece9973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec50a06edc0445e798202c786b37aa19', 'request_id': 'req-18513a53-6799-407c-bbd0-65e8bece9973'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:27.499278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-18513a53-6799-407c-bbd0-65e8bece9973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec50a06edc0445e798202c786b37aa19', 'request_id': 'req-18513a53-6799-407c-bbd0-65e8bece9973'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:27.507541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-18513a53-6799-407c-bbd0-65e8bece9973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec50a06edc0445e798202c786b37aa19', 'request_id': 'req-18513a53-6799-407c-bbd0-65e8bece9973'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:27.519225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-18513a53-6799-407c-bbd0-65e8bece9973 admin admin] The token cache is being invalidate because project ec50a06edc0445e798202c786b37aa19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:27.519515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-18513a53-6799-407c-bbd0-65e8bece9973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:27.520165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-18513a53-6799-407c-bbd0-65e8bece9973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:27.521704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1125/2245] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:27 2022] DELETE /identity/v3/projects/ec50a06edc0445e798202c786b37aa19 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:27.527269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118a279-97ea-48dd-a292-41f82d777789 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:27.527580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118a279-97ea-48dd-a292-41f82d777789 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:27.527953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118a279-97ea-48dd-a292-41f82d777789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:27.548834 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-f118a279-97ea-48dd-a292-41f82d777789 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:27.550050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f118a279-97ea-48dd-a292-41f82d777789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:27.612176 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1121/2246] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:27.620022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedaf5e-79c1-473b-b795-9db6ef0ae2fb None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:27.620303 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedaf5e-79c1-473b-b795-9db6ef0ae2fb None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:27.620553 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedaf5e-79c1-473b-b795-9db6ef0ae2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:27.643466 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-6fedaf5e-79c1-473b-b795-9db6ef0ae2fb None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:27.644744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6fedaf5e-79c1-473b-b795-9db6ef0ae2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:27.652746 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1126/2247] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:27.657080 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118a279-97ea-48dd-a292-41f82d777789 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:27.666804 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118a279-97ea-48dd-a292-41f82d777789 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:27.682549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd6ba1-77aa-4a1d-9112-a96d75e8deb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:27.683235 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd6ba1-77aa-4a1d-9112-a96d75e8deb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:27.683511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd6ba1-77aa-4a1d-9112-a96d75e8deb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:27.683781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd6ba1-77aa-4a1d-9112-a96d75e8deb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:27.684447 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd6ba1-77aa-4a1d-9112-a96d75e8deb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:27:27.684758 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd6ba1-77aa-4a1d-9112-a96d75e8deb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:27.686408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd6ba1-77aa-4a1d-9112-a96d75e8deb0 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:27.705651 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1122/2248] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:27:27.710069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedaf5e-79c1-473b-b795-9db6ef0ae2fb None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:27.719859 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedaf5e-79c1-473b-b795-9db6ef0ae2fb None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:27.725994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e90089-d818-47e9-9a97-ff60f27f8661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:27.726723 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e90089-d818-47e9-9a97-ff60f27f8661 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:27.727032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e90089-d818-47e9-9a97-ff60f27f8661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:27.727297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e90089-d818-47e9-9a97-ff60f27f8661 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:27.727925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e90089-d818-47e9-9a97-ff60f27f8661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:27.729827 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e90089-d818-47e9-9a97-ff60f27f8661 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:27.767941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1127/2249] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:27:27 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:27.772605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd6ba1-77aa-4a1d-9112-a96d75e8deb0 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:27.785452 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd6ba1-77aa-4a1d-9112-a96d75e8deb0 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:27.796488 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:27.854059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ef52f-55bf-4a23-bcdc-b38ee0a248af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:27.854675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef52f-55bf-4a23-bcdc-b38ee0a248af admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:27.854977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef52f-55bf-4a23-bcdc-b38ee0a248af admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:27.855246 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef52f-55bf-4a23-bcdc-b38ee0a248af admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:27.855937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ef52f-55bf-4a23-bcdc-b38ee0a248af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:27.857791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ef52f-55bf-4a23-bcdc-b38ee0a248af admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:27.888797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1123/2250] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:27:27 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:27.892978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e90089-d818-47e9-9a97-ff60f27f8661 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:27.904622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e90089-d818-47e9-9a97-ff60f27f8661 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:27.918584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4d316-a9d1-4b90-820a-c111df667f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:27.919263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4d316-a9d1-4b90-820a-c111df667f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:27.919546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4d316-a9d1-4b90-820a-c111df667f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:27.919816 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4d316-a9d1-4b90-820a-c111df667f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:27.920623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4d316-a9d1-4b90-820a-c111df667f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:27.922272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4d316-a9d1-4b90-820a-c111df667f83 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:27.934245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1128/2251] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:27.937975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ef52f-55bf-4a23-bcdc-b38ee0a248af admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:27.948026 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ef52f-55bf-4a23-bcdc-b38ee0a248af admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:27.952606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597dcd0-85de-425f-9e9e-5fdef300bcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:27.953212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597dcd0-85de-425f-9e9e-5fdef300bcea admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:27.953467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597dcd0-85de-425f-9e9e-5fdef300bcea admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:27.953734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597dcd0-85de-425f-9e9e-5fdef300bcea admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:27.954376 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597dcd0-85de-425f-9e9e-5fdef300bcea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:27.956014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597dcd0-85de-425f-9e9e-5fdef300bcea admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:27.967217 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1124/2252] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:27.971460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4d316-a9d1-4b90-820a-c111df667f83 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:27.982288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4d316-a9d1-4b90-820a-c111df667f83 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:27.987421 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4c7e-3921-4033-98af-a8f4c7464ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:27.988169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4c7e-3921-4033-98af-a8f4c7464ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:27.988558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4c7e-3921-4033-98af-a8f4c7464ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:27.988858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4c7e-3921-4033-98af-a8f4c7464ef9 admin admin] PATH_INFO: `/v3/projects/001b779aebf8445eba01022c8c9abe19/users/0f80c1f4f2d04a9b80ab0c315dfe180d/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:28.006307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d4c7e-3921-4033-98af-a8f4c7464ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=001b779aebf8445eba01022c8c9abe19, user_id=0f80c1f4f2d04a9b80ab0c315dfe180d, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:28.009063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d4c7e-3921-4033-98af-a8f4c7464ef9 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:28.011548 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:28.029713 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1129/2253] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:27 2022] PUT /identity/v3/projects/001b779aebf8445eba01022c8c9abe19/users/0f80c1f4f2d04a9b80ab0c315dfe180d/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:28.035792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45192ef2-0a56-4a29-aa02-f4781cf1daa7 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:28.036088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45192ef2-0a56-4a29-aa02-f4781cf1daa7 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:28.036358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45192ef2-0a56-4a29-aa02-f4781cf1daa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:28.073896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-45192ef2-0a56-4a29-aa02-f4781cf1daa7 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:28.075615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-45192ef2-0a56-4a29-aa02-f4781cf1daa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:28.145517 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1125/2254] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:28.155699 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4c7e-3921-4033-98af-a8f4c7464ef9 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:28.157805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-eb9d4c7e-3921-4033-98af-a8f4c7464ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:28.226777 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4c7e-3921-4033-98af-a8f4c7464ef9 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:28.230525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96661d1-be48-4404-ba8a-d43208119aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:28.231172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96661d1-be48-4404-ba8a-d43208119aed service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:28.231446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96661d1-be48-4404-ba8a-d43208119aed service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:28.231712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96661d1-be48-4404-ba8a-d43208119aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:28.240692 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e611c0-de03-4079-8b8f-4a5fa6957e39 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:28.241346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e611c0-de03-4079-8b8f-4a5fa6957e39 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:28.241693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e611c0-de03-4079-8b8f-4a5fa6957e39 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:28.241791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96661d1-be48-4404-ba8a-d43208119aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:28.243469 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1126/2255] 10.222.0.59 () {54 vars in 921 bytes} [Tue Aug 9 11:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:27:28.243583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96661d1-be48-4404-ba8a-d43208119aed service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:28.253224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1130/2256] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:28.497900 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b958e-0d8b-422e-bc2e-9a1f3b398870 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:28.498825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b958e-0d8b-422e-bc2e-9a1f3b398870 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:28.499192 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b958e-0d8b-422e-bc2e-9a1f3b398870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:28.526365 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-544b958e-0d8b-422e-bc2e-9a1f3b398870 None None] MFA Rules not processed for user `a04b584a68cb488492046faa23e15463`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:28.527901 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-544b958e-0d8b-422e-bc2e-9a1f3b398870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:28.612412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1127/2257] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Aug 9 11:27:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:28.630960 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96661d1-be48-4404-ba8a-d43208119aed service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:28.632405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c96661d1-be48-4404-ba8a-d43208119aed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:28.649215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96661d1-be48-4404-ba8a-d43208119aed service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:28.655309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a362a-7faa-45c8-9194-278d088e3b24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:28.655970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a362a-7faa-45c8-9194-278d088e3b24 service placement] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:28.656241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a362a-7faa-45c8-9194-278d088e3b24 service placement] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:28.657354 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a362a-7faa-45c8-9194-278d088e3b24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:28.667108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a362a-7faa-45c8-9194-278d088e3b24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:28.668727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a362a-7faa-45c8-9194-278d088e3b24 service placement] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:28.699568 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1131/2258] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:29.425264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b958e-0d8b-422e-bc2e-9a1f3b398870 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:29.426854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-544b958e-0d8b-422e-bc2e-9a1f3b398870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:29.443932 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b958e-0d8b-422e-bc2e-9a1f3b398870 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:29.448637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f33059-c55a-459a-a3cf-a86d8be8b82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:29.449309 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f33059-c55a-459a-a3cf-a86d8be8b82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:29.449578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f33059-c55a-459a-a3cf-a86d8be8b82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:29.449853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f33059-c55a-459a-a3cf-a86d8be8b82a admin admin] PATH_INFO: `/v3/users/de653ee1e38846cf927dc2eab24bf662` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:29.451178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f33059-c55a-459a-a3cf-a86d8be8b82a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de653ee1e38846cf927dc2eab24bf662)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:29.453120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f33059-c55a-459a-a3cf-a86d8be8b82a admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:29.492755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:29.525060 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-66f33059-c55a-459a-a3cf-a86d8be8b82a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de653ee1e38846cf927dc2eab24bf662'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:29.536218 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-66f33059-c55a-459a-a3cf-a86d8be8b82a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de653ee1e38846cf927dc2eab24bf662'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:29.536983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-66f33059-c55a-459a-a3cf-a86d8be8b82a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de653ee1e38846cf927dc2eab24bf662'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:29.537693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-66f33059-c55a-459a-a3cf-a86d8be8b82a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de653ee1e38846cf927dc2eab24bf662'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:29.551482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-66f33059-c55a-459a-a3cf-a86d8be8b82a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de653ee1e38846cf927dc2eab24bf662'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:29.569459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1128/2259] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:29 2022] DELETE /identity/v3/users/de653ee1e38846cf927dc2eab24bf662 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:29.788347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a362a-7faa-45c8-9194-278d088e3b24 service placement] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:29.813831 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a362a-7faa-45c8-9194-278d088e3b24 service placement] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:29.895424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:29.896170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:29.896542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:29.896915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] PATH_INFO: `/v3/projects/e1542fa352604068864f9fc52dcabd64` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:29.898312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1542fa352604068864f9fc52dcabd64)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:29.901721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:29.965477 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1542fa352604068864f9fc52dcabd64', 'request_id': 'req-8a11fe56-4cf9-4579-822e-45172a37f12f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:29.994710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1542fa352604068864f9fc52dcabd64', 'request_id': 'req-8a11fe56-4cf9-4579-822e-45172a37f12f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:30.013258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1542fa352604068864f9fc52dcabd64', 'request_id': 'req-8a11fe56-4cf9-4579-822e-45172a37f12f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:30.033799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] The token cache is being invalidate because project e1542fa352604068864f9fc52dcabd64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:30.034089 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:30.037672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:30.039590 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1132/2260] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:29 2022] DELETE /identity/v3/projects/e1542fa352604068864f9fc52dcabd64 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:27:30.044391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f33059-c55a-459a-a3cf-a86d8be8b82a admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:30.046197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-66f33059-c55a-459a-a3cf-a86d8be8b82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:30.065503 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f33059-c55a-459a-a3cf-a86d8be8b82a admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:30.159295 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6936d0-fe0e-400f-acad-1fbb0d757e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:30.160217 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6936d0-fe0e-400f-acad-1fbb0d757e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:30.160576 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6936d0-fe0e-400f-acad-1fbb0d757e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:30.161083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6936d0-fe0e-400f-acad-1fbb0d757e78 admin admin] PATH_INFO: `/v3/users/2b3ee05c7f1d48a48bf1572a76a7c24e` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:30.162514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6936d0-fe0e-400f-acad-1fbb0d757e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3ee05c7f1d48a48bf1572a76a7c24e)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:30.164928 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6936d0-fe0e-400f-acad-1fbb0d757e78 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:30.255521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ae6936d0-fe0e-400f-acad-1fbb0d757e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3ee05c7f1d48a48bf1572a76a7c24e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:30.264977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ae6936d0-fe0e-400f-acad-1fbb0d757e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3ee05c7f1d48a48bf1572a76a7c24e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:30.265678 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ae6936d0-fe0e-400f-acad-1fbb0d757e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3ee05c7f1d48a48bf1572a76a7c24e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:30.266531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ae6936d0-fe0e-400f-acad-1fbb0d757e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3ee05c7f1d48a48bf1572a76a7c24e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:30.281927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-ae6936d0-fe0e-400f-acad-1fbb0d757e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3ee05c7f1d48a48bf1572a76a7c24e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:30.299059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1129/2261] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:30 2022] DELETE /identity/v3/users/2b3ee05c7f1d48a48bf1572a76a7c24e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:30.571954 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:30.573822 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:30.594432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11fe56-4cf9-4579-822e-45172a37f12f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:30.638580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:30.695284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806e47d-a732-4d27-9284-bc3f938c6a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:30.696107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e47d-a732-4d27-9284-bc3f938c6a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:30.699001 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e47d-a732-4d27-9284-bc3f938c6a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:30.699197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e47d-a732-4d27-9284-bc3f938c6a43 admin admin] PATH_INFO: `/v3/projects/584d9c6e6f194c579170d1bbb85dcd6c` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:30.700490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806e47d-a732-4d27-9284-bc3f938c6a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=584d9c6e6f194c579170d1bbb85dcd6c)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:30.708891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806e47d-a732-4d27-9284-bc3f938c6a43 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:30.763888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c806e47d-a732-4d27-9284-bc3f938c6a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '584d9c6e6f194c579170d1bbb85dcd6c', 'request_id': 'req-c806e47d-a732-4d27-9284-bc3f938c6a43'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:30.772257 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c806e47d-a732-4d27-9284-bc3f938c6a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '584d9c6e6f194c579170d1bbb85dcd6c', 'request_id': 'req-c806e47d-a732-4d27-9284-bc3f938c6a43'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:30.786029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c806e47d-a732-4d27-9284-bc3f938c6a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '584d9c6e6f194c579170d1bbb85dcd6c', 'request_id': 'req-c806e47d-a732-4d27-9284-bc3f938c6a43'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:30.805984 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c806e47d-a732-4d27-9284-bc3f938c6a43 admin admin] The token cache is being invalidate because project 584d9c6e6f194c579170d1bbb85dcd6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:30.806574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c806e47d-a732-4d27-9284-bc3f938c6a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:30.807151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c806e47d-a732-4d27-9284-bc3f938c6a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:30.808931 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1133/2262] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:30 2022] DELETE /identity/v3/projects/584d9c6e6f194c579170d1bbb85dcd6c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:30.813989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4097-9a64-4876-bc2d-2a8a290b395a None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:30.814478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4097-9a64-4876-bc2d-2a8a290b395a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:30.814591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4097-9a64-4876-bc2d-2a8a290b395a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:30.834871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ea2c4097-9a64-4876-bc2d-2a8a290b395a None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:30.836157 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ea2c4097-9a64-4876-bc2d-2a8a290b395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:30.850303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:30.902187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1130/2263] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:30.911195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48ec9-a824-48be-9247-a72473e18996 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:30.911488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48ec9-a824-48be-9247-a72473e18996 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:30.911757 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48ec9-a824-48be-9247-a72473e18996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:30.932817 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-56f48ec9-a824-48be-9247-a72473e18996 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:30.934064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-56f48ec9-a824-48be-9247-a72473e18996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:30.944650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1134/2264] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:30.948860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c4097-9a64-4876-bc2d-2a8a290b395a None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:30.960373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c4097-9a64-4876-bc2d-2a8a290b395a None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:30.969447 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09950c-4007-43cf-846a-563e6faa9ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:30.970156 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09950c-4007-43cf-846a-563e6faa9ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:30.970500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09950c-4007-43cf-846a-563e6faa9ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:30.970930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09950c-4007-43cf-846a-563e6faa9ce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:30.971595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09950c-4007-43cf-846a-563e6faa9ce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:27:30.972039 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09950c-4007-43cf-846a-563e6faa9ce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:30.974458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09950c-4007-43cf-846a-563e6faa9ce5 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:30.991519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1131/2265] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:27:30.993090 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f48ec9-a824-48be-9247-a72473e18996 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:31.003853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f48ec9-a824-48be-9247-a72473e18996 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:31.008844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ace6a-c694-4652-84de-21e0f57a0bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:31.009467 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ace6a-c694-4652-84de-21e0f57a0bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:31.009910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ace6a-c694-4652-84de-21e0f57a0bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:31.010330 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ace6a-c694-4652-84de-21e0f57a0bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:31.011040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ace6a-c694-4652-84de-21e0f57a0bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:31.013047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ace6a-c694-4652-84de-21e0f57a0bf1 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:31.046494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1135/2266] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:27:30 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:31.051121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09950c-4007-43cf-846a-563e6faa9ce5 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:31.061794 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09950c-4007-43cf-846a-563e6faa9ce5 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:31.162926 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17698af-d4dc-4417-966a-c12c4ce68241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:31.163612 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17698af-d4dc-4417-966a-c12c4ce68241 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:31.163894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17698af-d4dc-4417-966a-c12c4ce68241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:31.164221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17698af-d4dc-4417-966a-c12c4ce68241 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:31.164871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17698af-d4dc-4417-966a-c12c4ce68241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:31.167296 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17698af-d4dc-4417-966a-c12c4ce68241 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:31.203684 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1132/2267] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:27:31 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:27:31.207930 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ace6a-c694-4652-84de-21e0f57a0bf1 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:31.219336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ace6a-c694-4652-84de-21e0f57a0bf1 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:31.225078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f61a3-366b-423c-a362-524a394af12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:31.225732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f61a3-366b-423c-a362-524a394af12d admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:31.226011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f61a3-366b-423c-a362-524a394af12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:31.226306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f61a3-366b-423c-a362-524a394af12d admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:31.227068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f61a3-366b-423c-a362-524a394af12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:31.228797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f61a3-366b-423c-a362-524a394af12d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:31.241932 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1136/2268] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:31.246351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17698af-d4dc-4417-966a-c12c4ce68241 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:31.258616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17698af-d4dc-4417-966a-c12c4ce68241 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:31.265957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a74765-32cf-4f52-8106-7a109fe3d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:31.266705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a74765-32cf-4f52-8106-7a109fe3d825 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:31.267021 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a74765-32cf-4f52-8106-7a109fe3d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:31.267297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a74765-32cf-4f52-8106-7a109fe3d825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:31.267957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a74765-32cf-4f52-8106-7a109fe3d825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:31.270342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a74765-32cf-4f52-8106-7a109fe3d825 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:31.290690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1133/2269] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:27:31.291985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f61a3-366b-423c-a362-524a394af12d admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:31.312958 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f61a3-366b-423c-a362-524a394af12d admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:31.313945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62d7f8-1af1-41ce-a748-d295871f00c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:31.314717 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62d7f8-1af1-41ce-a748-d295871f00c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:31.315133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62d7f8-1af1-41ce-a748-d295871f00c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:31.315515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62d7f8-1af1-41ce-a748-d295871f00c9 admin admin] PATH_INFO: `/v3/projects/27d3a43fd6f04e5a80d58572e68c947c/users/3f9a89266e5045a3b52d536cd307e27c/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:31.333685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62d7f8-1af1-41ce-a748-d295871f00c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d3a43fd6f04e5a80d58572e68c947c, user_id=3f9a89266e5045a3b52d536cd307e27c, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:31.337270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62d7f8-1af1-41ce-a748-d295871f00c9 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:31.355801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1137/2270] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:27:31 2022] PUT /identity/v3/projects/27d3a43fd6f04e5a80d58572e68c947c/users/3f9a89266e5045a3b52d536cd307e27c/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:31.368314 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c65c1f-c8f8-4aa9-9d18-b78c74a81a43 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:31.369287 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c65c1f-c8f8-4aa9-9d18-b78c74a81a43 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:31.369689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c65c1f-c8f8-4aa9-9d18-b78c74a81a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:31.407602 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-b4c65c1f-c8f8-4aa9-9d18-b78c74a81a43 None None] MFA Rules not processed for user `3f9a89266e5045a3b52d536cd307e27c`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:31.407602 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b4c65c1f-c8f8-4aa9-9d18-b78c74a81a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:31.489603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1134/2271] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:31.501916 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62d7f8-1af1-41ce-a748-d295871f00c9 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:31.503962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-8a62d7f8-1af1-41ce-a748-d295871f00c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:31.566154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:31.585847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62d7f8-1af1-41ce-a748-d295871f00c9 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:31.599367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae49da-6b81-4607-bc10-54c04b56faeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:31.600163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae49da-6b81-4607-bc10-54c04b56faeb service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:31.600704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae49da-6b81-4607-bc10-54c04b56faeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:31.601123 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae49da-6b81-4607-bc10-54c04b56faeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:31.618879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae49da-6b81-4607-bc10-54c04b56faeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:31.633280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae49da-6b81-4607-bc10-54c04b56faeb service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:31.666016 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1138/2272] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:34.130157 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37d92e-c6e2-4494-8c51-53780bdb43da None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:34.130594 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37d92e-c6e2-4494-8c51-53780bdb43da None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:34.131122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37d92e-c6e2-4494-8c51-53780bdb43da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:34.166111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-8d37d92e-c6e2-4494-8c51-53780bdb43da None None] MFA Rules not processed for user `0f80c1f4f2d04a9b80ab0c315dfe180d`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:34.167391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-8d37d92e-c6e2-4494-8c51-53780bdb43da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:34.172658 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:34.253172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1135/2273] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:34.266710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae49da-6b81-4607-bc10-54c04b56faeb service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:34.268255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-83ae49da-6b81-4607-bc10-54c04b56faeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:34.380747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae49da-6b81-4607-bc10-54c04b56faeb service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:34.396052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdc9c4-c42e-476d-b504-1c0686f6b2a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:34.396690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdc9c4-c42e-476d-b504-1c0686f6b2a1 service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:34.396963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdc9c4-c42e-476d-b504-1c0686f6b2a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:34.397232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdc9c4-c42e-476d-b504-1c0686f6b2a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:34.414622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdc9c4-c42e-476d-b504-1c0686f6b2a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:34.416706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdc9c4-c42e-476d-b504-1c0686f6b2a1 service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:34.429329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1139/2274] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:27:36.142400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf297a-e87d-47ee-9d1b-2fe8dcca849e None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:36.142987 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf297a-e87d-47ee-9d1b-2fe8dcca849e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:36.142987 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf297a-e87d-47ee-9d1b-2fe8dcca849e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:36.162733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-9aaf297a-e87d-47ee-9d1b-2fe8dcca849e None None] MFA Rules not processed for user `0f80c1f4f2d04a9b80ab0c315dfe180d`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:36.164047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9aaf297a-e87d-47ee-9d1b-2fe8dcca849e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:36.171755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1136/2275] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:44.423149 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=42 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:46.157763 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=28 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:48.262858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068edcfb-339a-437b-91f0-604eb53198d4 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:48.263919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068edcfb-339a-437b-91f0-604eb53198d4 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:48.264380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068edcfb-339a-437b-91f0-604eb53198d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:48.308802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-068edcfb-339a-437b-91f0-604eb53198d4 None None] MFA Rules not processed for user `20fa4a9037534826bb11e503c20b4dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:48.318589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-068edcfb-339a-437b-91f0-604eb53198d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:48.398903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1140/2276] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:27:58.292269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf297a-e87d-47ee-9d1b-2fe8dcca849e None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:58.379441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf297a-e87d-47ee-9d1b-2fe8dcca849e None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:58.385581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a35ae-bec0-4fc8-99da-d77513173c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:58.386426 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a35ae-bec0-4fc8-99da-d77513173c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:58.386863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a35ae-bec0-4fc8-99da-d77513173c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:58.387399 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a35ae-bec0-4fc8-99da-d77513173c59 admin admin] PATH_INFO: `/v3/users/3f9a89266e5045a3b52d536cd307e27c` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:58.389714 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a35ae-bec0-4fc8-99da-d77513173c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9a89266e5045a3b52d536cd307e27c)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:58.390424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=25 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:58.392464 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a35ae-bec0-4fc8-99da-d77513173c59 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:58.464097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-223a35ae-bec0-4fc8-99da-d77513173c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9a89266e5045a3b52d536cd307e27c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:58.477918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-223a35ae-bec0-4fc8-99da-d77513173c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9a89266e5045a3b52d536cd307e27c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:58.479036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-223a35ae-bec0-4fc8-99da-d77513173c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9a89266e5045a3b52d536cd307e27c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:58.480085 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-223a35ae-bec0-4fc8-99da-d77513173c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9a89266e5045a3b52d536cd307e27c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:58.498146 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-223a35ae-bec0-4fc8-99da-d77513173c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9a89266e5045a3b52d536cd307e27c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:58.511707 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1137/2277] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:58 2022] DELETE /identity/v3/users/3f9a89266e5045a3b52d536cd307e27c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:58.517286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024be09b-f1fc-43c0-b6e0-7da3a7cacdbf None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:58.517571 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024be09b-f1fc-43c0-b6e0-7da3a7cacdbf None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:58.517827 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024be09b-f1fc-43c0-b6e0-7da3a7cacdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:58.539646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-024be09b-f1fc-43c0-b6e0-7da3a7cacdbf None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:58.541077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-024be09b-f1fc-43c0-b6e0-7da3a7cacdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:58.612366 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1141/2278] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:58.625165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a35ae-bec0-4fc8-99da-d77513173c59 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:58.626625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-223a35ae-bec0-4fc8-99da-d77513173c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:58.690661 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a35ae-bec0-4fc8-99da-d77513173c59 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:58.694783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bd819-4be8-40da-9b6a-0fddecdece01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:58.695439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bd819-4be8-40da-9b6a-0fddecdece01 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:58.695714 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bd819-4be8-40da-9b6a-0fddecdece01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:58.695985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bd819-4be8-40da-9b6a-0fddecdece01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:58.706084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bd819-4be8-40da-9b6a-0fddecdece01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:58.707578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bd819-4be8-40da-9b6a-0fddecdece01 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:58.718507 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1138/2279] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:59.006441 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024be09b-f1fc-43c0-b6e0-7da3a7cacdbf None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:59.008118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-024be09b-f1fc-43c0-b6e0-7da3a7cacdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:59.019939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024be09b-f1fc-43c0-b6e0-7da3a7cacdbf None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:59.025017 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:59.025615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:59.025919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:59.026196 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] PATH_INFO: `/v3/projects/27d3a43fd6f04e5a80d58572e68c947c` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:59.027405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d3a43fd6f04e5a80d58572e68c947c)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:59.029294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:59.085151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d3a43fd6f04e5a80d58572e68c947c', 'request_id': 'req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:59.092584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d3a43fd6f04e5a80d58572e68c947c', 'request_id': 'req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:59.102007 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d3a43fd6f04e5a80d58572e68c947c', 'request_id': 'req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:59.114512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] The token cache is being invalidate because project 27d3a43fd6f04e5a80d58572e68c947c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:59.114901 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:59.115647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:59.117476 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1142/2280] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:59 2022] DELETE /identity/v3/projects/27d3a43fd6f04e5a80d58572e68c947c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:08.714133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:09.111188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:10.728316 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16162bc5-61d6-496c-bcf7-3cb819ec7b7b None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:10.729236 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16162bc5-61d6-496c-bcf7-3cb819ec7b7b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:10.729236 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16162bc5-61d6-496c-bcf7-3cb819ec7b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:10.765681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-16162bc5-61d6-496c-bcf7-3cb819ec7b7b None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:10.768449 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-16162bc5-61d6-496c-bcf7-3cb819ec7b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:10.877792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1139/2281] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:28:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:10.928895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:10.930493 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:11.013740 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9141c-ced7-4655-bb01-c9ddf9f6f4ff admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:11.019284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f828796-82fe-4e74-8547-6de6b3a8a0b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:11.019962 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f828796-82fe-4e74-8547-6de6b3a8a0b6 service swift] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:11.020246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f828796-82fe-4e74-8547-6de6b3a8a0b6 service swift] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:11.020514 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f828796-82fe-4e74-8547-6de6b3a8a0b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:11.030081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f828796-82fe-4e74-8547-6de6b3a8a0b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:11.032538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f828796-82fe-4e74-8547-6de6b3a8a0b6 service swift] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:11.043771 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1143/2282] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:28:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:28:11.210632 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16162bc5-61d6-496c-bcf7-3cb819ec7b7b None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:11.212667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-16162bc5-61d6-496c-bcf7-3cb819ec7b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:11.323722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16162bc5-61d6-496c-bcf7-3cb819ec7b7b None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:11.331477 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4e486-fc06-4dbb-871d-bc0f76522a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:11.332186 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4e486-fc06-4dbb-871d-bc0f76522a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:11.332462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4e486-fc06-4dbb-871d-bc0f76522a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:11.332737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4e486-fc06-4dbb-871d-bc0f76522a30 admin admin] PATH_INFO: `/v3/users/131d55f0a1c9462099dd90ab6a9bd75f` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:11.333949 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4e486-fc06-4dbb-871d-bc0f76522a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=131d55f0a1c9462099dd90ab6a9bd75f)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:11.336074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4e486-fc06-4dbb-871d-bc0f76522a30 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:11.413476 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-81c4e486-fc06-4dbb-871d-bc0f76522a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131d55f0a1c9462099dd90ab6a9bd75f'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:11.424695 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-81c4e486-fc06-4dbb-871d-bc0f76522a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131d55f0a1c9462099dd90ab6a9bd75f'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:11.425798 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-81c4e486-fc06-4dbb-871d-bc0f76522a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131d55f0a1c9462099dd90ab6a9bd75f'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:11.426535 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-81c4e486-fc06-4dbb-871d-bc0f76522a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131d55f0a1c9462099dd90ab6a9bd75f'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:11.443300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-81c4e486-fc06-4dbb-871d-bc0f76522a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131d55f0a1c9462099dd90ab6a9bd75f'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:11.456871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1140/2283] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:11 2022] DELETE /identity/v3/users/131d55f0a1c9462099dd90ab6a9bd75f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:11.462736 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d27144-599c-4cc3-98a8-63b90f2b2ee9 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:11.463432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d27144-599c-4cc3-98a8-63b90f2b2ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:11.463923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d27144-599c-4cc3-98a8-63b90f2b2ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:11.493615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-27d27144-599c-4cc3-98a8-63b90f2b2ee9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:11.496119 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-27d27144-599c-4cc3-98a8-63b90f2b2ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:11.586733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1144/2284] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:11.597106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4e486-fc06-4dbb-871d-bc0f76522a30 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:11.598597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-81c4e486-fc06-4dbb-871d-bc0f76522a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:11.630216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:11.664870 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4e486-fc06-4dbb-871d-bc0f76522a30 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:11.668756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c7940-151c-4709-b143-1f7fef0d2c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:11.669416 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c7940-151c-4709-b143-1f7fef0d2c37 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:11.669697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c7940-151c-4709-b143-1f7fef0d2c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:11.670023 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c7940-151c-4709-b143-1f7fef0d2c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:11.679794 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c7940-151c-4709-b143-1f7fef0d2c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:11.681476 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c7940-151c-4709-b143-1f7fef0d2c37 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:11.687025 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38a4a8-cb24-400c-9e81-87af5a5930b7 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:11.687301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38a4a8-cb24-400c-9e81-87af5a5930b7 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:11.687570 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38a4a8-cb24-400c-9e81-87af5a5930b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:11.692534 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1141/2285] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:11.711751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-8c38a4a8-cb24-400c-9e81-87af5a5930b7 None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:11.713050 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-8c38a4a8-cb24-400c-9e81-87af5a5930b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:11.798840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1145/2286] 10.222.0.59 () {58 vars in 967 bytes} [Tue Aug 9 11:28:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:11.813573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c7940-151c-4709-b143-1f7fef0d2c37 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:11.815840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-fb2c7940-151c-4709-b143-1f7fef0d2c37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:11.919585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c7940-151c-4709-b143-1f7fef0d2c37 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:11.928322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c16a0-d574-451b-8570-eab1ea7195d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:11.929019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c16a0-d574-451b-8570-eab1ea7195d5 service swift] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:11.929302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c16a0-d574-451b-8570-eab1ea7195d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:11.929572 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c16a0-d574-451b-8570-eab1ea7195d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:11.942049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c16a0-d574-451b-8570-eab1ea7195d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:11.944539 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c16a0-d574-451b-8570-eab1ea7195d5 service swift] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:11.956517 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1142/2287] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:28:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:28:12.034142 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38a4a8-cb24-400c-9e81-87af5a5930b7 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:12.035966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-8c38a4a8-cb24-400c-9e81-87af5a5930b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:12.071287 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38a4a8-cb24-400c-9e81-87af5a5930b7 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:12.078973 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:12.079970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:12.080319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:12.080463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6 admin admin] PATH_INFO: `/v3/projects/9a437eb161be410c8b3c5ef3ad4baa6f` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:12.082572 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a437eb161be410c8b3c5ef3ad4baa6f)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:12.085408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:12.129798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:12.144026 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a437eb161be410c8b3c5ef3ad4baa6f', 'request_id': 'req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:12.150292 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a437eb161be410c8b3c5ef3ad4baa6f', 'request_id': 'req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:12.160247 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a437eb161be410c8b3c5ef3ad4baa6f', 'request_id': 'req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:12.171815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6 admin admin] The token cache is being invalidate because project 9a437eb161be410c8b3c5ef3ad4baa6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:12.172185 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:12.172895 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a77f50e0-2600-40d2-a1e1-8fbbe17aaee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:12.174495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1146/2288] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:12 2022] DELETE /identity/v3/projects/9a437eb161be410c8b3c5ef3ad4baa6f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:12.179862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186fe13-b35d-4852-8f88-ec6c83bb119e None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:12.180210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186fe13-b35d-4852-8f88-ec6c83bb119e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:12.180484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186fe13-b35d-4852-8f88-ec6c83bb119e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:12.201556 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-b186fe13-b35d-4852-8f88-ec6c83bb119e None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:12.202778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b186fe13-b35d-4852-8f88-ec6c83bb119e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:12.250596 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cda73-a52d-416b-b16d-5cb0a0439529 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:12.250897 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cda73-a52d-416b-b16d-5cb0a0439529 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:12.251173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cda73-a52d-416b-b16d-5cb0a0439529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:12.270616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1143/2289] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:12.276266 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-065cda73-a52d-416b-b16d-5cb0a0439529 None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:12.277576 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-065cda73-a52d-416b-b16d-5cb0a0439529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:12.278764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114d76b-1a41-4797-b350-17cf6afd2a36 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:12.279087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114d76b-1a41-4797-b350-17cf6afd2a36 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:12.279359 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114d76b-1a41-4797-b350-17cf6afd2a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:12.300714 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-a114d76b-1a41-4797-b350-17cf6afd2a36 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:12.301922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a114d76b-1a41-4797-b350-17cf6afd2a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:12.314047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1144/2290] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:12.315060 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114d76b-1a41-4797-b350-17cf6afd2a36 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:12.325955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114d76b-1a41-4797-b350-17cf6afd2a36 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:12.331273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de022672-5193-4f2c-938d-2b23d16bb6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:12.331832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de022672-5193-4f2c-938d-2b23d16bb6ea admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:12.332144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de022672-5193-4f2c-938d-2b23d16bb6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:12.332382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de022672-5193-4f2c-938d-2b23d16bb6ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:12.333048 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de022672-5193-4f2c-938d-2b23d16bb6ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:28:12.333349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de022672-5193-4f2c-938d-2b23d16bb6ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:12.335032 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de022672-5193-4f2c-938d-2b23d16bb6ea admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:12.348681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1147/2291] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:28:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:12.350195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1145/2292] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:28:12.354583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cda73-a52d-416b-b16d-5cb0a0439529 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:12.364559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de022672-5193-4f2c-938d-2b23d16bb6ea admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:12.366412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-de022672-5193-4f2c-938d-2b23d16bb6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:12.366730 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cda73-a52d-416b-b16d-5cb0a0439529 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:12.371691 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764ad76-0c49-4cf3-94b0-fabc460342c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:12.372306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764ad76-0c49-4cf3-94b0-fabc460342c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:12.372633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764ad76-0c49-4cf3-94b0-fabc460342c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:12.372838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764ad76-0c49-4cf3-94b0-fabc460342c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:12.373474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764ad76-0c49-4cf3-94b0-fabc460342c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:12.375539 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764ad76-0c49-4cf3-94b0-fabc460342c1 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:12.404406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1148/2293] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:12 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:12.409511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764ad76-0c49-4cf3-94b0-fabc460342c1 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:12.419599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:12.450086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de022672-5193-4f2c-938d-2b23d16bb6ea admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:12.477231 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764ad76-0c49-4cf3-94b0-fabc460342c1 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:12.487472 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c794f6-b614-4220-9883-6255adc514d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:12.488106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c794f6-b614-4220-9883-6255adc514d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:12.488382 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c794f6-b614-4220-9883-6255adc514d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:12.488647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c794f6-b614-4220-9883-6255adc514d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:12.489293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c794f6-b614-4220-9883-6255adc514d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:12.491294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c794f6-b614-4220-9883-6255adc514d0 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:12.515729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1149/2294] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:12 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:12.519822 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c794f6-b614-4220-9883-6255adc514d0 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:12.529361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebde996-76a4-4cb6-95de-4dfd687afc75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:12.529833 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c794f6-b614-4220-9883-6255adc514d0 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:12.529975 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebde996-76a4-4cb6-95de-4dfd687afc75 service swift] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:12.530250 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebde996-76a4-4cb6-95de-4dfd687afc75 service swift] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:12.530523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebde996-76a4-4cb6-95de-4dfd687afc75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:12.534518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bdd7c-f9fa-4a26-a30a-d6ea9c24f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:12.535155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bdd7c-f9fa-4a26-a30a-d6ea9c24f2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:12.535419 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bdd7c-f9fa-4a26-a30a-d6ea9c24f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:12.535680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bdd7c-f9fa-4a26-a30a-d6ea9c24f2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:12.536390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bdd7c-f9fa-4a26-a30a-d6ea9c24f2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:12.538010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bdd7c-f9fa-4a26-a30a-d6ea9c24f2b6 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:12.548503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1150/2295] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:28:12.552619 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bdd7c-f9fa-4a26-a30a-d6ea9c24f2b6 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:12.562768 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bdd7c-f9fa-4a26-a30a-d6ea9c24f2b6 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:12.571625 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072383b0-d091-465c-9d19-867b55f76322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:12.572274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072383b0-d091-465c-9d19-867b55f76322 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:12.572709 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072383b0-d091-465c-9d19-867b55f76322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:12.573022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072383b0-d091-465c-9d19-867b55f76322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:12.573940 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072383b0-d091-465c-9d19-867b55f76322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:12.575652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072383b0-d091-465c-9d19-867b55f76322 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:12.586534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1151/2296] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:28:12.589459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebde996-76a4-4cb6-95de-4dfd687afc75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:12.590969 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072383b0-d091-465c-9d19-867b55f76322 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:12.591094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebde996-76a4-4cb6-95de-4dfd687afc75 service swift] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:12.600402 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1146/2297] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:28:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 11:28:12.601755 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072383b0-d091-465c-9d19-867b55f76322 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:12.606432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afe5a0-9903-4ba4-9c89-6cc5bdcdd984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:12.607047 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe5a0-9903-4ba4-9c89-6cc5bdcdd984 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:12.607848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe5a0-9903-4ba4-9c89-6cc5bdcdd984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:12.607848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe5a0-9903-4ba4-9c89-6cc5bdcdd984 admin admin] PATH_INFO: `/v3/projects/d5b4feb5fe1746a2b54b81e61558d4c0/users/b477645d5d814644aa77e11066f0489d/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:12.611120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:12.627588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afe5a0-9903-4ba4-9c89-6cc5bdcdd984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b4feb5fe1746a2b54b81e61558d4c0, user_id=b477645d5d814644aa77e11066f0489d, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:12.631236 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afe5a0-9903-4ba4-9c89-6cc5bdcdd984 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:12.647241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1152/2298] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:12 2022] PUT /identity/v3/projects/d5b4feb5fe1746a2b54b81e61558d4c0/users/b477645d5d814644aa77e11066f0489d/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:12.652485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282eb13-b267-4f42-aa39-f45fc17cc066 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:12.652715 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282eb13-b267-4f42-aa39-f45fc17cc066 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:12.652990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282eb13-b267-4f42-aa39-f45fc17cc066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:12.677466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-6282eb13-b267-4f42-aa39-f45fc17cc066 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:12.678690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6282eb13-b267-4f42-aa39-f45fc17cc066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:12.747465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1147/2299] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:12.757196 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afe5a0-9903-4ba4-9c89-6cc5bdcdd984 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:12.759163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d1afe5a0-9903-4ba4-9c89-6cc5bdcdd984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:12.820874 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afe5a0-9903-4ba4-9c89-6cc5bdcdd984 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:12.824610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0a429-60fe-42b8-9f81-7fe1e89d0585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:12.825206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0a429-60fe-42b8-9f81-7fe1e89d0585 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:12.825484 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0a429-60fe-42b8-9f81-7fe1e89d0585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:12.825703 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0a429-60fe-42b8-9f81-7fe1e89d0585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:12.835694 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0a429-60fe-42b8-9f81-7fe1e89d0585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:12.837154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0a429-60fe-42b8-9f81-7fe1e89d0585 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:12.847819 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1153/2300] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:13.025507 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fec86e-2f40-4f59-b31f-a96bea95342e None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:13.026031 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fec86e-2f40-4f59-b31f-a96bea95342e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:13.026117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fec86e-2f40-4f59-b31f-a96bea95342e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:13.047201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-54fec86e-2f40-4f59-b31f-a96bea95342e None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:13.048427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-54fec86e-2f40-4f59-b31f-a96bea95342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:13.067732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:13.135428 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1148/2301] 10.222.0.59 () {58 vars in 967 bytes} [Tue Aug 9 11:28:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:13.161651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0a429-60fe-42b8-9f81-7fe1e89d0585 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:13.318466 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0a429-60fe-42b8-9f81-7fe1e89d0585 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:13.330012 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c564-1469-44c0-a696-052b5d82e87d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:13.333669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c564-1469-44c0-a696-052b5d82e87d service swift] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:13.334697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c564-1469-44c0-a696-052b5d82e87d service swift] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:13.335232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c564-1469-44c0-a696-052b5d82e87d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:13.351271 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083c564-1469-44c0-a696-052b5d82e87d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:13.358633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083c564-1469-44c0-a696-052b5d82e87d service swift] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:13.376223 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1154/2302] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:28:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:28:16.042505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fec86e-2f40-4f59-b31f-a96bea95342e None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:16.044825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-54fec86e-2f40-4f59-b31f-a96bea95342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:16.110066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fec86e-2f40-4f59-b31f-a96bea95342e None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:16.124493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11121fb0-b272-410e-bfa2-f0692af6f1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:16.127300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11121fb0-b272-410e-bfa2-f0692af6f1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:16.128012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11121fb0-b272-410e-bfa2-f0692af6f1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:16.128682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11121fb0-b272-410e-bfa2-f0692af6f1ab admin admin] PATH_INFO: `/v3/users/72941424337943908351c9d6c812ce97` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:16.139243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11121fb0-b272-410e-bfa2-f0692af6f1ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=72941424337943908351c9d6c812ce97)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:16.147393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11121fb0-b272-410e-bfa2-f0692af6f1ab admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:16.284341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-11121fb0-b272-410e-bfa2-f0692af6f1ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72941424337943908351c9d6c812ce97'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:16.315846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-11121fb0-b272-410e-bfa2-f0692af6f1ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72941424337943908351c9d6c812ce97'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:16.319400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-11121fb0-b272-410e-bfa2-f0692af6f1ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72941424337943908351c9d6c812ce97'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:16.320516 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-11121fb0-b272-410e-bfa2-f0692af6f1ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72941424337943908351c9d6c812ce97'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:16.348959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-11121fb0-b272-410e-bfa2-f0692af6f1ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72941424337943908351c9d6c812ce97'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:16.372185 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1149/2303] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:16 2022] DELETE /identity/v3/users/72941424337943908351c9d6c812ce97 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:16.376852 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dab7b-6ab3-44fa-afde-19134dba5947 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:16.377574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dab7b-6ab3-44fa-afde-19134dba5947 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:16.377574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dab7b-6ab3-44fa-afde-19134dba5947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:16.408682 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-d40dab7b-6ab3-44fa-afde-19134dba5947 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:16.410144 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d40dab7b-6ab3-44fa-afde-19134dba5947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:16.518920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1155/2304] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:16.527556 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11121fb0-b272-410e-bfa2-f0692af6f1ab admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:16.528869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-11121fb0-b272-410e-bfa2-f0692af6f1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:16.641599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11121fb0-b272-410e-bfa2-f0692af6f1ab admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:16.647380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab346a-2848-48cf-98c5-df0f23ef6675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:16.648471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab346a-2848-48cf-98c5-df0f23ef6675 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:16.648471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab346a-2848-48cf-98c5-df0f23ef6675 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:16.648956 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab346a-2848-48cf-98c5-df0f23ef6675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:16.664109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab346a-2848-48cf-98c5-df0f23ef6675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:16.666906 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab346a-2848-48cf-98c5-df0f23ef6675 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:16.682894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1150/2305] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:16.989975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dab7b-6ab3-44fa-afde-19134dba5947 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:16.992583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d40dab7b-6ab3-44fa-afde-19134dba5947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:17.018322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dab7b-6ab3-44fa-afde-19134dba5947 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.025356 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c86631-39ae-423e-816d-08291b810333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.026168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c86631-39ae-423e-816d-08291b810333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.026451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c86631-39ae-423e-816d-08291b810333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.026778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c86631-39ae-423e-816d-08291b810333 admin admin] PATH_INFO: `/v3/projects/7fec1f5ba8ef43ba9a04a16e17b9ad6d` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.028196 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c86631-39ae-423e-816d-08291b810333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fec1f5ba8ef43ba9a04a16e17b9ad6d)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.030256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c86631-39ae-423e-816d-08291b810333 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.045671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:17.135828 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-33c86631-39ae-423e-816d-08291b810333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'request_id': 'req-33c86631-39ae-423e-816d-08291b810333'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:17.145740 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-33c86631-39ae-423e-816d-08291b810333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'request_id': 'req-33c86631-39ae-423e-816d-08291b810333'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:17.169020 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-33c86631-39ae-423e-816d-08291b810333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'request_id': 'req-33c86631-39ae-423e-816d-08291b810333'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:17.184780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-33c86631-39ae-423e-816d-08291b810333 admin admin] The token cache is being invalidate because project 7fec1f5ba8ef43ba9a04a16e17b9ad6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:17.185171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-33c86631-39ae-423e-816d-08291b810333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:17.185795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-33c86631-39ae-423e-816d-08291b810333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:17.187668 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1156/2306] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:16 2022] DELETE /identity/v3/projects/7fec1f5ba8ef43ba9a04a16e17b9ad6d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:17.192403 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83def2e1-1d5c-4026-ab70-bd19da49ee11 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.192936 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83def2e1-1d5c-4026-ab70-bd19da49ee11 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.192936 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83def2e1-1d5c-4026-ab70-bd19da49ee11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.224424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-83def2e1-1d5c-4026-ab70-bd19da49ee11 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:17.226648 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-83def2e1-1d5c-4026-ab70-bd19da49ee11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:17.274396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:17.333188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fb3bc-6e1e-45fe-aacf-1f71257d6b53 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.333392 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fb3bc-6e1e-45fe-aacf-1f71257d6b53 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.333630 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fb3bc-6e1e-45fe-aacf-1f71257d6b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.337410 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1151/2307] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:17.370311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-6c5fb3bc-6e1e-45fe-aacf-1f71257d6b53 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:17.373287 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6c5fb3bc-6e1e-45fe-aacf-1f71257d6b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:17.421095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1157/2308] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:17.426180 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83def2e1-1d5c-4026-ab70-bd19da49ee11 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.454552 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83def2e1-1d5c-4026-ab70-bd19da49ee11 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.468711 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facfb80-c454-43b0-801d-46ee12a0e227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.469618 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facfb80-c454-43b0-801d-46ee12a0e227 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.470084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facfb80-c454-43b0-801d-46ee12a0e227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.470354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facfb80-c454-43b0-801d-46ee12a0e227 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.471448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facfb80-c454-43b0-801d-46ee12a0e227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:28:17.471748 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facfb80-c454-43b0-801d-46ee12a0e227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.473506 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facfb80-c454-43b0-801d-46ee12a0e227 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.505172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1152/2309] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:28:17.510331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fb3bc-6e1e-45fe-aacf-1f71257d6b53 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.521224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fb3bc-6e1e-45fe-aacf-1f71257d6b53 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.527395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcd8dd-6df1-43d6-894d-85a8c444acfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.528284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcd8dd-6df1-43d6-894d-85a8c444acfa admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.528742 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcd8dd-6df1-43d6-894d-85a8c444acfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.529153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcd8dd-6df1-43d6-894d-85a8c444acfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.530187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcd8dd-6df1-43d6-894d-85a8c444acfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.532377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcd8dd-6df1-43d6-894d-85a8c444acfa admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.586378 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1158/2310] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:17 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:17.590936 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facfb80-c454-43b0-801d-46ee12a0e227 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.609964 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facfb80-c454-43b0-801d-46ee12a0e227 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.720384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffff53a-6d66-445c-8df4-c63388b30d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.722029 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffff53a-6d66-445c-8df4-c63388b30d1e admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.722029 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffff53a-6d66-445c-8df4-c63388b30d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.722278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffff53a-6d66-445c-8df4-c63388b30d1e admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.723130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffff53a-6d66-445c-8df4-c63388b30d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.725438 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffff53a-6d66-445c-8df4-c63388b30d1e admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.758860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1153/2311] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:17 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:17.760553 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcd8dd-6df1-43d6-894d-85a8c444acfa admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.772822 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcd8dd-6df1-43d6-894d-85a8c444acfa admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.779446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01af829-7028-4918-ab60-9737fe4b2657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.780173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01af829-7028-4918-ab60-9737fe4b2657 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.780509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01af829-7028-4918-ab60-9737fe4b2657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.780840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01af829-7028-4918-ab60-9737fe4b2657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.781586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01af829-7028-4918-ab60-9737fe4b2657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.783706 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01af829-7028-4918-ab60-9737fe4b2657 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.796892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1159/2312] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:17.801927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffff53a-6d66-445c-8df4-c63388b30d1e admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.814351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffff53a-6d66-445c-8df4-c63388b30d1e admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.823000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55e715-f44c-41a6-8021-8b050e03246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.824301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55e715-f44c-41a6-8021-8b050e03246d admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.824301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55e715-f44c-41a6-8021-8b050e03246d admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.825166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55e715-f44c-41a6-8021-8b050e03246d admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.826003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55e715-f44c-41a6-8021-8b050e03246d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.828052 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55e715-f44c-41a6-8021-8b050e03246d admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.840035 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1154/2313] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:17.844451 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01af829-7028-4918-ab60-9737fe4b2657 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.855767 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01af829-7028-4918-ab60-9737fe4b2657 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.860937 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3ab19-0dbb-4a55-9352-99f2d774181a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.861782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3ab19-0dbb-4a55-9352-99f2d774181a admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.862176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3ab19-0dbb-4a55-9352-99f2d774181a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.862515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3ab19-0dbb-4a55-9352-99f2d774181a admin admin] PATH_INFO: `/v3/projects/ef17bd64c2e648c5b0e4543e635e3d7a/users/50e392889ece4517a139dfde15fcb208/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.882450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3ab19-0dbb-4a55-9352-99f2d774181a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef17bd64c2e648c5b0e4543e635e3d7a, user_id=50e392889ece4517a139dfde15fcb208, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.885661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3ab19-0dbb-4a55-9352-99f2d774181a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.910358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1160/2314] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:17 2022] PUT /identity/v3/projects/ef17bd64c2e648c5b0e4543e635e3d7a/users/50e392889ece4517a139dfde15fcb208/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:17.912184 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17912d95-ec9f-4dcf-b2a4-f1dde6adec8f None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.912741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17912d95-ec9f-4dcf-b2a4-f1dde6adec8f None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.913017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17912d95-ec9f-4dcf-b2a4-f1dde6adec8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:18.116502 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-17912d95-ec9f-4dcf-b2a4-f1dde6adec8f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:18.117808 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-17912d95-ec9f-4dcf-b2a4-f1dde6adec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:18.197659 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1155/2315] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:18.207417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3ab19-0dbb-4a55-9352-99f2d774181a admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:18.209399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-37c3ab19-0dbb-4a55-9352-99f2d774181a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:18.284593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3ab19-0dbb-4a55-9352-99f2d774181a admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:18.288643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c2dcb-35e9-467d-83d5-07054e69363d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:18.289466 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c2dcb-35e9-467d-83d5-07054e69363d service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:18.289744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c2dcb-35e9-467d-83d5-07054e69363d service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:18.290009 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c2dcb-35e9-467d-83d5-07054e69363d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:18.301167 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c2dcb-35e9-467d-83d5-07054e69363d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:18.303428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c2dcb-35e9-467d-83d5-07054e69363d service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:18.317896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1161/2316] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:18.569191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de04af4-1806-4b9e-bd5e-8b0cc0226958 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:18.569600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de04af4-1806-4b9e-bd5e-8b0cc0226958 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:18.570085 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de04af4-1806-4b9e-bd5e-8b0cc0226958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:18.625194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-2de04af4-1806-4b9e-bd5e-8b0cc0226958 None None] MFA Rules not processed for user `b477645d5d814644aa77e11066f0489d`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:18.627222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2de04af4-1806-4b9e-bd5e-8b0cc0226958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:18.765074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:18.813821 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1156/2317] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:28:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:18.819487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c2dcb-35e9-467d-83d5-07054e69363d service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:18.822386 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-302c2dcb-35e9-467d-83d5-07054e69363d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:18.837609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c2dcb-35e9-467d-83d5-07054e69363d service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:18.849913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b67014-7fb9-4cd4-86da-59427b48bb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:18.851207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b67014-7fb9-4cd4-86da-59427b48bb1f admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:18.851749 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b67014-7fb9-4cd4-86da-59427b48bb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:18.852051 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b67014-7fb9-4cd4-86da-59427b48bb1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:18.853080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b67014-7fb9-4cd4-86da-59427b48bb1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:18.856469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b67014-7fb9-4cd4-86da-59427b48bb1f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:18.896412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1162/2318] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:18 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:18.901119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de04af4-1806-4b9e-bd5e-8b0cc0226958 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:18.912486 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de04af4-1806-4b9e-bd5e-8b0cc0226958 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:18.984291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9724d9-be79-4ef7-a2a5-eea4b0451cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:18.984930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9724d9-be79-4ef7-a2a5-eea4b0451cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:18.985203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9724d9-be79-4ef7-a2a5-eea4b0451cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:18.985467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9724d9-be79-4ef7-a2a5-eea4b0451cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:18.986116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9724d9-be79-4ef7-a2a5-eea4b0451cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:18.988151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9724d9-be79-4ef7-a2a5-eea4b0451cc2 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:19.012661 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1157/2319] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:18 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:19.016765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b67014-7fb9-4cd4-86da-59427b48bb1f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:19.032159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b67014-7fb9-4cd4-86da-59427b48bb1f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:19.037604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071db890-b230-4259-b7b9-110bd1639219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:19.038319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071db890-b230-4259-b7b9-110bd1639219 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:19.038596 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071db890-b230-4259-b7b9-110bd1639219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:19.038934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071db890-b230-4259-b7b9-110bd1639219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:19.039656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071db890-b230-4259-b7b9-110bd1639219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:19.041376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071db890-b230-4259-b7b9-110bd1639219 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:19.054373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1163/2320] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:19.059008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9724d9-be79-4ef7-a2a5-eea4b0451cc2 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:19.070871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9724d9-be79-4ef7-a2a5-eea4b0451cc2 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:19.076496 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc9907-7bf7-4115-920b-d641af612c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:19.077361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc9907-7bf7-4115-920b-d641af612c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:19.077778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc9907-7bf7-4115-920b-d641af612c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:19.078255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc9907-7bf7-4115-920b-d641af612c9f admin admin] PATH_INFO: `/v3/projects/da836df55bdc4a008fcb46c26d36adb3/users/86edbf3c7e644fb79abc3244486fb484/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:19.107915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc9907-7bf7-4115-920b-d641af612c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da836df55bdc4a008fcb46c26d36adb3, user_id=86edbf3c7e644fb79abc3244486fb484, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:19.110955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc9907-7bf7-4115-920b-d641af612c9f admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:19.140119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1158/2321] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:19 2022] PUT /identity/v3/projects/da836df55bdc4a008fcb46c26d36adb3/users/86edbf3c7e644fb79abc3244486fb484/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:19.144073 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071db890-b230-4259-b7b9-110bd1639219 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:19.157412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071db890-b230-4259-b7b9-110bd1639219 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:19.162754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:19.261860 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80663a7e-d0c5-432e-8d9f-c320d00fb5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:19.263149 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80663a7e-d0c5-432e-8d9f-c320d00fb5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:19.269579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80663a7e-d0c5-432e-8d9f-c320d00fb5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:19.269579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80663a7e-d0c5-432e-8d9f-c320d00fb5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:19.270277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80663a7e-d0c5-432e-8d9f-c320d00fb5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:19.272023 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80663a7e-d0c5-432e-8d9f-c320d00fb5bb admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:19.282913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1164/2322] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:19.287674 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc9907-7bf7-4115-920b-d641af612c9f admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:19.298512 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc9907-7bf7-4115-920b-d641af612c9f admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:19.309951 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe69adb-e8d1-4d33-81d0-4c37874869fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:19.311109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe69adb-e8d1-4d33-81d0-4c37874869fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:19.311584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe69adb-e8d1-4d33-81d0-4c37874869fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:19.312051 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe69adb-e8d1-4d33-81d0-4c37874869fc admin admin] PATH_INFO: `/v3/projects/da836df55bdc4a008fcb46c26d36adb3/users/86edbf3c7e644fb79abc3244486fb484/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:19.314284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe69adb-e8d1-4d33-81d0-4c37874869fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=da836df55bdc4a008fcb46c26d36adb3, user_id=86edbf3c7e644fb79abc3244486fb484, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:19.317293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe69adb-e8d1-4d33-81d0-4c37874869fc admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:19.330197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1159/2323] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:19 2022] PUT /identity/v3/projects/da836df55bdc4a008fcb46c26d36adb3/users/86edbf3c7e644fb79abc3244486fb484/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:19.789851 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f06042-6b65-4d28-ac2d-bbcbf683ad6a None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:19.790141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f06042-6b65-4d28-ac2d-bbcbf683ad6a None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:19.790429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f06042-6b65-4d28-ac2d-bbcbf683ad6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:19.836689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a5f06042-6b65-4d28-ac2d-bbcbf683ad6a None None] MFA Rules not processed for user `50e392889ece4517a139dfde15fcb208`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:19.837973 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a5f06042-6b65-4d28-ac2d-bbcbf683ad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:19.976393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1165/2324] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:28:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:19.990470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe69adb-e8d1-4d33-81d0-4c37874869fc admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:19.993827 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9fe69adb-e8d1-4d33-81d0-4c37874869fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:20.083943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe69adb-e8d1-4d33-81d0-4c37874869fc admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:20.095497 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d792b4-3b5d-49ca-8d08-398bf39bc756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:20.097307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d792b4-3b5d-49ca-8d08-398bf39bc756 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:20.099360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d792b4-3b5d-49ca-8d08-398bf39bc756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:20.099979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d792b4-3b5d-49ca-8d08-398bf39bc756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:20.152901 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d792b4-3b5d-49ca-8d08-398bf39bc756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:20.157338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d792b4-3b5d-49ca-8d08-398bf39bc756 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:20.184826 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1160/2325] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:21.921436 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b414c2-3804-42fb-bcc7-8804b7c404b7 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:21.922604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b414c2-3804-42fb-bcc7-8804b7c404b7 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:21.923727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b414c2-3804-42fb-bcc7-8804b7c404b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:21.947458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-58b414c2-3804-42fb-bcc7-8804b7c404b7 None None] MFA Rules not processed for user `50e392889ece4517a139dfde15fcb208`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:21.948694 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-58b414c2-3804-42fb-bcc7-8804b7c404b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:21.962517 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1166/2326] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:28:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:25.722056 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46b354-bcf6-4ffc-b58e-4cab746565b7 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:25.723282 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46b354-bcf6-4ffc-b58e-4cab746565b7 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:25.723848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46b354-bcf6-4ffc-b58e-4cab746565b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:25.792431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-7a46b354-bcf6-4ffc-b58e-4cab746565b7 None None] MFA Rules not processed for user `86edbf3c7e644fb79abc3244486fb484`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:25.793838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7a46b354-bcf6-4ffc-b58e-4cab746565b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:25.827655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:25.948119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1161/2327] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:28:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:25.963262 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b414c2-3804-42fb-bcc7-8804b7c404b7 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:25.967589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-58b414c2-3804-42fb-bcc7-8804b7c404b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:26.091242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b414c2-3804-42fb-bcc7-8804b7c404b7 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:26.097762 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be2a97-31ed-4315-a9cb-ebb13a872dbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:26.098384 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be2a97-31ed-4315-a9cb-ebb13a872dbb service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:26.098659 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be2a97-31ed-4315-a9cb-ebb13a872dbb service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:26.099017 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be2a97-31ed-4315-a9cb-ebb13a872dbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:26.134854 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=100 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:26.186016 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be2a97-31ed-4315-a9cb-ebb13a872dbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:26.187727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be2a97-31ed-4315-a9cb-ebb13a872dbb service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:26.198946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1167/2328] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:28.227247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aff98-99a7-49af-b94d-1470983976f6 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:28.228675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aff98-99a7-49af-b94d-1470983976f6 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:28.229444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aff98-99a7-49af-b94d-1470983976f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:28.275224 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-587aff98-99a7-49af-b94d-1470983976f6 None None] MFA Rules not processed for user `b477645d5d814644aa77e11066f0489d`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:28.276543 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-587aff98-99a7-49af-b94d-1470983976f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:28.284907 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1162/2329] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:28:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:34.542555 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286afcc-1e6a-4166-927c-0ab107c43249 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:34.543160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286afcc-1e6a-4166-927c-0ab107c43249 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:34.543160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286afcc-1e6a-4166-927c-0ab107c43249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:34.566643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a286afcc-1e6a-4166-927c-0ab107c43249 None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:34.568137 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a286afcc-1e6a-4166-927c-0ab107c43249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:34.632877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1168/2330] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:28:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:34.648978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aff98-99a7-49af-b94d-1470983976f6 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:34.650766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-587aff98-99a7-49af-b94d-1470983976f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:34.735396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aff98-99a7-49af-b94d-1470983976f6 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:34.741823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd1920-7105-42bf-bf07-5af613c46a34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:34.742557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1920-7105-42bf-bf07-5af613c46a34 service swift] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:34.742783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1920-7105-42bf-bf07-5af613c46a34 service swift] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:34.743083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1920-7105-42bf-bf07-5af613c46a34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:34.752927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd1920-7105-42bf-bf07-5af613c46a34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:34.754579 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd1920-7105-42bf-bf07-5af613c46a34 service swift] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:34.764076 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1163/2331] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:28:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:28:44.624407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=42 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:44.760459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=54 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:47.129364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f450388-2f4a-46a5-b661-aad5966040a4 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:47.130054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f450388-2f4a-46a5-b661-aad5966040a4 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:47.130214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f450388-2f4a-46a5-b661-aad5966040a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:47.171967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-6f450388-2f4a-46a5-b661-aad5966040a4 None None] MFA Rules not processed for user `8f9dc600fea34effa2afa8aee54aab7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:47.173326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6f450388-2f4a-46a5-b661-aad5966040a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:47.250888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1169/2332] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:28:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:57.237747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=25 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:58.438723 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f242a7c-5570-4a85-a1e7-d44833ac6a11 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:58.439337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f242a7c-5570-4a85-a1e7-d44833ac6a11 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:58.439337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f242a7c-5570-4a85-a1e7-d44833ac6a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:58.460693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-0f242a7c-5570-4a85-a1e7-d44833ac6a11 None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:58.461974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-0f242a7c-5570-4a85-a1e7-d44833ac6a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:58.469930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1164/2333] 10.222.0.59 () {58 vars in 967 bytes} [Tue Aug 9 11:28:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:58.489392 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f450388-2f4a-46a5-b661-aad5966040a4 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:58.502363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f450388-2f4a-46a5-b661-aad5966040a4 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:58.507481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a42c3e-6be4-4de1-a3db-9b46ef7eb46a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:58.508089 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a42c3e-6be4-4de1-a3db-9b46ef7eb46a service swift] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:58.508363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a42c3e-6be4-4de1-a3db-9b46ef7eb46a service swift] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:58.508628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a42c3e-6be4-4de1-a3db-9b46ef7eb46a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:58.516872 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a42c3e-6be4-4de1-a3db-9b46ef7eb46a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:58.518475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a42c3e-6be4-4de1-a3db-9b46ef7eb46a service swift] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:58.527381 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1170/2334] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:28:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:29:00.589390 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f242a7c-5570-4a85-a1e7-d44833ac6a11 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:00.592324 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-0f242a7c-5570-4a85-a1e7-d44833ac6a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:00.673916 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f242a7c-5570-4a85-a1e7-d44833ac6a11 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:00.681553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc9b3a-f0d5-4b97-bc8d-7f8943324a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:00.681553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc9b3a-f0d5-4b97-bc8d-7f8943324a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:00.681553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc9b3a-f0d5-4b97-bc8d-7f8943324a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:00.681957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc9b3a-f0d5-4b97-bc8d-7f8943324a8a admin admin] PATH_INFO: `/v3/users/20fa4a9037534826bb11e503c20b4dcb` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:00.683112 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc9b3a-f0d5-4b97-bc8d-7f8943324a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=20fa4a9037534826bb11e503c20b4dcb)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:00.686468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc9b3a-f0d5-4b97-bc8d-7f8943324a8a admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:00.743610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-efbc9b3a-f0d5-4b97-bc8d-7f8943324a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20fa4a9037534826bb11e503c20b4dcb'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.753907 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-efbc9b3a-f0d5-4b97-bc8d-7f8943324a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20fa4a9037534826bb11e503c20b4dcb'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.754771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-efbc9b3a-f0d5-4b97-bc8d-7f8943324a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20fa4a9037534826bb11e503c20b4dcb'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.755455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-efbc9b3a-f0d5-4b97-bc8d-7f8943324a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20fa4a9037534826bb11e503c20b4dcb'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.773947 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-efbc9b3a-f0d5-4b97-bc8d-7f8943324a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20fa4a9037534826bb11e503c20b4dcb'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.790142 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1165/2335] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:29:00 2022] DELETE /identity/v3/users/20fa4a9037534826bb11e503c20b4dcb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:01.009861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a42c3e-6be4-4de1-a3db-9b46ef7eb46a service swift] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.022495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a42c3e-6be4-4de1-a3db-9b46ef7eb46a service swift] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.091994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb9184-89be-47a5-8641-1aa3b36d91bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.092629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb9184-89be-47a5-8641-1aa3b36d91bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.092899 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb9184-89be-47a5-8641-1aa3b36d91bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.093152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb9184-89be-47a5-8641-1aa3b36d91bf admin admin] PATH_INFO: `/v3/projects/bfc240016ba8447da04bbf7804e3d801` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.094672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb9184-89be-47a5-8641-1aa3b36d91bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc240016ba8447da04bbf7804e3d801)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.096611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb9184-89be-47a5-8641-1aa3b36d91bf admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.146959 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-0cbb9184-89be-47a5-8641-1aa3b36d91bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc240016ba8447da04bbf7804e3d801', 'request_id': 'req-0cbb9184-89be-47a5-8641-1aa3b36d91bf'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:01.154723 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-0cbb9184-89be-47a5-8641-1aa3b36d91bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc240016ba8447da04bbf7804e3d801', 'request_id': 'req-0cbb9184-89be-47a5-8641-1aa3b36d91bf'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:01.165125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-0cbb9184-89be-47a5-8641-1aa3b36d91bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc240016ba8447da04bbf7804e3d801', 'request_id': 'req-0cbb9184-89be-47a5-8641-1aa3b36d91bf'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:01.177654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-0cbb9184-89be-47a5-8641-1aa3b36d91bf admin admin] The token cache is being invalidate because project bfc240016ba8447da04bbf7804e3d801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:29:01.177927 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-0cbb9184-89be-47a5-8641-1aa3b36d91bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:01.178699 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-0cbb9184-89be-47a5-8641-1aa3b36d91bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:01.180306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1171/2336] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:29:01 2022] DELETE /identity/v3/projects/bfc240016ba8447da04bbf7804e3d801 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:01.185719 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e7385-ce1a-42f4-9116-525ae44549b2 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.185993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e7385-ce1a-42f4-9116-525ae44549b2 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.186260 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e7385-ce1a-42f4-9116-525ae44549b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.207223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-6d6e7385-ce1a-42f4-9116-525ae44549b2 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:01.208460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6d6e7385-ce1a-42f4-9116-525ae44549b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:01.282863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1166/2337] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:01.290912 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dac202-6614-4464-a61d-ac30ac471293 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.291315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dac202-6614-4464-a61d-ac30ac471293 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.291512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dac202-6614-4464-a61d-ac30ac471293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.312670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c0dac202-6614-4464-a61d-ac30ac471293 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:01.313919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c0dac202-6614-4464-a61d-ac30ac471293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:01.322902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1172/2338] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:01.328411 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e7385-ce1a-42f4-9116-525ae44549b2 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.338463 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e7385-ce1a-42f4-9116-525ae44549b2 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.343531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263962e9-a015-4bcf-bdb5-a34a111830c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.343531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263962e9-a015-4bcf-bdb5-a34a111830c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.343531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263962e9-a015-4bcf-bdb5-a34a111830c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.343531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263962e9-a015-4bcf-bdb5-a34a111830c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.348582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263962e9-a015-4bcf-bdb5-a34a111830c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:29:01.348582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263962e9-a015-4bcf-bdb5-a34a111830c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.350471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263962e9-a015-4bcf-bdb5-a34a111830c8 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.360779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:01.368832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1167/2339] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:29:01.370490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dac202-6614-4464-a61d-ac30ac471293 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.381801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dac202-6614-4464-a61d-ac30ac471293 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.389042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58888ba8-3943-4317-afcd-4bb818ea8ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.389042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58888ba8-3943-4317-afcd-4bb818ea8ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.389612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58888ba8-3943-4317-afcd-4bb818ea8ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.389732 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58888ba8-3943-4317-afcd-4bb818ea8ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.390510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58888ba8-3943-4317-afcd-4bb818ea8ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.392375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58888ba8-3943-4317-afcd-4bb818ea8ed6 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.432830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1173/2340] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:29:01 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:29:01.437781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263962e9-a015-4bcf-bdb5-a34a111830c8 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.448854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263962e9-a015-4bcf-bdb5-a34a111830c8 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.508251 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdec2e-07d5-49d1-ba84-59cf9466b16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.508917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdec2e-07d5-49d1-ba84-59cf9466b16c admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.509194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdec2e-07d5-49d1-ba84-59cf9466b16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.509468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdec2e-07d5-49d1-ba84-59cf9466b16c admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.510206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdec2e-07d5-49d1-ba84-59cf9466b16c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.512135 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdec2e-07d5-49d1-ba84-59cf9466b16c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.535700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1168/2341] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:29:01 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:29:01.539964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58888ba8-3943-4317-afcd-4bb818ea8ed6 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.552497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58888ba8-3943-4317-afcd-4bb818ea8ed6 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.558636 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b8382-6e0c-4ea6-9da0-a035df3c3fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.559291 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b8382-6e0c-4ea6-9da0-a035df3c3fff admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.559569 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b8382-6e0c-4ea6-9da0-a035df3c3fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.559839 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b8382-6e0c-4ea6-9da0-a035df3c3fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.560493 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b8382-6e0c-4ea6-9da0-a035df3c3fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.562175 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b8382-6e0c-4ea6-9da0-a035df3c3fff admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.573816 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1174/2342] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:29:01.578050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdec2e-07d5-49d1-ba84-59cf9466b16c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.589572 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdec2e-07d5-49d1-ba84-59cf9466b16c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.597881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8a875-3913-4ff5-8cd5-ce513c9b1a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.598744 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8a875-3913-4ff5-8cd5-ce513c9b1a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.599135 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8a875-3913-4ff5-8cd5-ce513c9b1a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.599534 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8a875-3913-4ff5-8cd5-ce513c9b1a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.600666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8a875-3913-4ff5-8cd5-ce513c9b1a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.602397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8a875-3913-4ff5-8cd5-ce513c9b1a9c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.617044 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1169/2343] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:29:01.621437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b8382-6e0c-4ea6-9da0-a035df3c3fff admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.635169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b8382-6e0c-4ea6-9da0-a035df3c3fff admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.640881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995260b-5713-435d-9af0-c01dc004dd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.641627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995260b-5713-435d-9af0-c01dc004dd50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.641957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995260b-5713-435d-9af0-c01dc004dd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.642152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995260b-5713-435d-9af0-c01dc004dd50 admin admin] PATH_INFO: `/v3/projects/e8cf8263a0794dce9bfcbf43fc88f4aa/users/8cc3dbdb8a2e489ca333d512466bb726/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.659444 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995260b-5713-435d-9af0-c01dc004dd50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cf8263a0794dce9bfcbf43fc88f4aa, user_id=8cc3dbdb8a2e489ca333d512466bb726, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.662537 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995260b-5713-435d-9af0-c01dc004dd50 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.678457 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1175/2344] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:29:01 2022] PUT /identity/v3/projects/e8cf8263a0794dce9bfcbf43fc88f4aa/users/8cc3dbdb8a2e489ca333d512466bb726/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:01.688911 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af76f6a-5e83-4d6f-8272-7b546e7ff630 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.689214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af76f6a-5e83-4d6f-8272-7b546e7ff630 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.689487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af76f6a-5e83-4d6f-8272-7b546e7ff630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.721210 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-7af76f6a-5e83-4d6f-8272-7b546e7ff630 None None] MFA Rules not processed for user `8cc3dbdb8a2e489ca333d512466bb726`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:01.722449 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7af76f6a-5e83-4d6f-8272-7b546e7ff630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:01.800292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1170/2345] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:29:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:01.812138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995260b-5713-435d-9af0-c01dc004dd50 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.813991 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-2995260b-5713-435d-9af0-c01dc004dd50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:01.829656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:01.883234 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995260b-5713-435d-9af0-c01dc004dd50 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.887078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26150cd-874f-448c-8b7b-85241f020c7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.887689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26150cd-874f-448c-8b7b-85241f020c7b service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.887961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26150cd-874f-448c-8b7b-85241f020c7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.888220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26150cd-874f-448c-8b7b-85241f020c7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.897270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26150cd-874f-448c-8b7b-85241f020c7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.898703 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26150cd-874f-448c-8b7b-85241f020c7b service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.907844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1176/2346] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:29:11.796354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:11.903725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=20 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:25.396249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af76f6a-5e83-4d6f-8272-7b546e7ff630 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:25.397960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7af76f6a-5e83-4d6f-8272-7b546e7ff630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:25.474047 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af76f6a-5e83-4d6f-8272-7b546e7ff630 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:25.479531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1cce3-b485-490f-bf0f-180432ae6943 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:25.480113 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1cce3-b485-490f-bf0f-180432ae6943 service placement] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:25.480400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1cce3-b485-490f-bf0f-180432ae6943 service placement] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:25.480951 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1cce3-b485-490f-bf0f-180432ae6943 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:25.482879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-34a1cce3-b485-490f-bf0f-180432ae6943 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:25.496864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1cce3-b485-490f-bf0f-180432ae6943 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:25.498631 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1cce3-b485-490f-bf0f-180432ae6943 service placement] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:25.509875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1171/2347] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:29:30.820447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26150cd-874f-448c-8b7b-85241f020c7b service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:30.885276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26150cd-874f-448c-8b7b-85241f020c7b service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:30.891212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c275f-8675-47fa-8787-7b2e95e165e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:30.892290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c275f-8675-47fa-8787-7b2e95e165e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:30.892290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c275f-8675-47fa-8787-7b2e95e165e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:30.892490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c275f-8675-47fa-8787-7b2e95e165e6 admin admin] PATH_INFO: `/v3/users/8cc3dbdb8a2e489ca333d512466bb726` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:30.893536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c275f-8675-47fa-8787-7b2e95e165e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc3dbdb8a2e489ca333d512466bb726)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:30.895537 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c275f-8675-47fa-8787-7b2e95e165e6 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:30.944853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-415c275f-8675-47fa-8787-7b2e95e165e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc3dbdb8a2e489ca333d512466bb726'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:30.957086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-415c275f-8675-47fa-8787-7b2e95e165e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc3dbdb8a2e489ca333d512466bb726'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:30.965874 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-415c275f-8675-47fa-8787-7b2e95e165e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc3dbdb8a2e489ca333d512466bb726'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:30.966496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-415c275f-8675-47fa-8787-7b2e95e165e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc3dbdb8a2e489ca333d512466bb726'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:30.967234 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-415c275f-8675-47fa-8787-7b2e95e165e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc3dbdb8a2e489ca333d512466bb726'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:30.982437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1177/2348] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:29:30 2022] DELETE /identity/v3/users/8cc3dbdb8a2e489ca333d512466bb726 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:30.987406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9119d05-de56-4674-8330-76bf97e3f3c2 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:30.987978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9119d05-de56-4674-8330-76bf97e3f3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:30.987978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9119d05-de56-4674-8330-76bf97e3f3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:31.008068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-e9119d05-de56-4674-8330-76bf97e3f3c2 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:31.009293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e9119d05-de56-4674-8330-76bf97e3f3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:31.075111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1172/2349] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:31.086449 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c275f-8675-47fa-8787-7b2e95e165e6 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:31.088413 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-415c275f-8675-47fa-8787-7b2e95e165e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:31.160052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c275f-8675-47fa-8787-7b2e95e165e6 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:31.163951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff6214-df3c-499a-9eab-841ac8a8801e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:31.164574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff6214-df3c-499a-9eab-841ac8a8801e service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:31.164854 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff6214-df3c-499a-9eab-841ac8a8801e service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:31.165121 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff6214-df3c-499a-9eab-841ac8a8801e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:31.176082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff6214-df3c-499a-9eab-841ac8a8801e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:31.178009 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff6214-df3c-499a-9eab-841ac8a8801e service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:31.190850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1178/2350] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:29:31.496171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9119d05-de56-4674-8330-76bf97e3f3c2 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:31.497806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e9119d05-de56-4674-8330-76bf97e3f3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:31.512971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9119d05-de56-4674-8330-76bf97e3f3c2 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:31.518514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20236a-4f50-40cc-b153-7204a8688fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:31.519197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20236a-4f50-40cc-b153-7204a8688fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:31.519443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20236a-4f50-40cc-b153-7204a8688fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:31.519713 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20236a-4f50-40cc-b153-7204a8688fed admin admin] PATH_INFO: `/v3/projects/e8cf8263a0794dce9bfcbf43fc88f4aa` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:31.520988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20236a-4f50-40cc-b153-7204a8688fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8cf8263a0794dce9bfcbf43fc88f4aa)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:31.523012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20236a-4f50-40cc-b153-7204a8688fed admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:31.577389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0f20236a-4f50-40cc-b153-7204a8688fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8cf8263a0794dce9bfcbf43fc88f4aa', 'request_id': 'req-0f20236a-4f50-40cc-b153-7204a8688fed'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:31.585154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0f20236a-4f50-40cc-b153-7204a8688fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8cf8263a0794dce9bfcbf43fc88f4aa', 'request_id': 'req-0f20236a-4f50-40cc-b153-7204a8688fed'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:31.590580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0f20236a-4f50-40cc-b153-7204a8688fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8cf8263a0794dce9bfcbf43fc88f4aa', 'request_id': 'req-0f20236a-4f50-40cc-b153-7204a8688fed'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:31.602209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0f20236a-4f50-40cc-b153-7204a8688fed admin admin] The token cache is being invalidate because project e8cf8263a0794dce9bfcbf43fc88f4aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:29:31.602494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0f20236a-4f50-40cc-b153-7204a8688fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:31.603173 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0f20236a-4f50-40cc-b153-7204a8688fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:31.604634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1173/2351] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:29:31 2022] DELETE /identity/v3/projects/e8cf8263a0794dce9bfcbf43fc88f4aa => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:31.609576 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee005-c93f-4c99-a9ee-4e47e2d708f2 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:31.609814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee005-c93f-4c99-a9ee-4e47e2d708f2 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:31.610079 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee005-c93f-4c99-a9ee-4e47e2d708f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:31.632279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-670ee005-c93f-4c99-a9ee-4e47e2d708f2 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:31.633479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-670ee005-c93f-4c99-a9ee-4e47e2d708f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:31.651405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:31.700243 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1179/2352] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:31.709247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f90b6b-ea41-4378-ac12-b8b9d6de8d09 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:31.709522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f90b6b-ea41-4378-ac12-b8b9d6de8d09 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:31.709901 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f90b6b-ea41-4378-ac12-b8b9d6de8d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:31.730522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-f8f90b6b-ea41-4378-ac12-b8b9d6de8d09 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:31.731737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f8f90b6b-ea41-4378-ac12-b8b9d6de8d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:31.740519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1174/2353] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:31.744939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee005-c93f-4c99-a9ee-4e47e2d708f2 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:31.754847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee005-c93f-4c99-a9ee-4e47e2d708f2 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:31.759985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f38bf2-645f-4666-aeab-7151a88dfad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:31.760676 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f38bf2-645f-4666-aeab-7151a88dfad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:31.761035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f38bf2-645f-4666-aeab-7151a88dfad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:31.761464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f38bf2-645f-4666-aeab-7151a88dfad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:31.762174 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f38bf2-645f-4666-aeab-7151a88dfad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:29:31.762532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f38bf2-645f-4666-aeab-7151a88dfad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:31.764288 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f38bf2-645f-4666-aeab-7151a88dfad8 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:31.776446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1180/2354] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:29:31.780778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f90b6b-ea41-4378-ac12-b8b9d6de8d09 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:31.790265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f90b6b-ea41-4378-ac12-b8b9d6de8d09 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:31.795141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce3737-0218-4d39-9724-c99e26c9867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:31.795746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce3737-0218-4d39-9724-c99e26c9867d admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:31.796007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce3737-0218-4d39-9724-c99e26c9867d admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:31.796290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce3737-0218-4d39-9724-c99e26c9867d admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:31.796912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce3737-0218-4d39-9724-c99e26c9867d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:31.798838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce3737-0218-4d39-9724-c99e26c9867d admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:31.803442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:31.829514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1175/2355] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:29:31 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:29:31.833854 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f38bf2-645f-4666-aeab-7151a88dfad8 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:31.844968 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f38bf2-645f-4666-aeab-7151a88dfad8 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:31.906251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0d8a8-2e40-4314-9fc7-c30a08552801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:31.906846 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0d8a8-2e40-4314-9fc7-c30a08552801 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:31.907140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0d8a8-2e40-4314-9fc7-c30a08552801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:31.907405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0d8a8-2e40-4314-9fc7-c30a08552801 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:31.908029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0d8a8-2e40-4314-9fc7-c30a08552801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:31.909949 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0d8a8-2e40-4314-9fc7-c30a08552801 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:31.935101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1181/2356] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:29:31 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:29:31.936398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce3737-0218-4d39-9724-c99e26c9867d admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:31.946917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce3737-0218-4d39-9724-c99e26c9867d admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:31.951638 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5783e-4072-4d8f-8d6b-8e9314b1da4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:31.952343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5783e-4072-4d8f-8d6b-8e9314b1da4b admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:31.952633 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5783e-4072-4d8f-8d6b-8e9314b1da4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:31.952896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5783e-4072-4d8f-8d6b-8e9314b1da4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:31.953663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5783e-4072-4d8f-8d6b-8e9314b1da4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:31.955288 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5783e-4072-4d8f-8d6b-8e9314b1da4b admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:31.965382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1176/2357] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:29:31.970168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0d8a8-2e40-4314-9fc7-c30a08552801 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:31.980881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0d8a8-2e40-4314-9fc7-c30a08552801 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:31.986060 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3f234-bfd1-4eb4-97a2-d10a5f2de3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:31.986664 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3f234-bfd1-4eb4-97a2-d10a5f2de3db admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:31.986977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3f234-bfd1-4eb4-97a2-d10a5f2de3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:31.987245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3f234-bfd1-4eb4-97a2-d10a5f2de3db admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:31.987892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3f234-bfd1-4eb4-97a2-d10a5f2de3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:31.989515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3f234-bfd1-4eb4-97a2-d10a5f2de3db admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:32.000471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1182/2358] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:29:32.006569 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5783e-4072-4d8f-8d6b-8e9314b1da4b admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:32.020170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5783e-4072-4d8f-8d6b-8e9314b1da4b admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:32.025651 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c0708-2035-4adb-97d7-35f27f5d8c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:32.026306 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c0708-2035-4adb-97d7-35f27f5d8c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:32.026574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c0708-2035-4adb-97d7-35f27f5d8c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:32.026866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c0708-2035-4adb-97d7-35f27f5d8c1e admin admin] PATH_INFO: `/v3/projects/58b4497c4bdb4e448910da3a801f60cf/users/63bdbf40d3cf46ad87a3d5b977a03701/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:32.041995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c0708-2035-4adb-97d7-35f27f5d8c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b4497c4bdb4e448910da3a801f60cf, user_id=63bdbf40d3cf46ad87a3d5b977a03701, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:32.044733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c0708-2035-4adb-97d7-35f27f5d8c1e admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:32.059681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1177/2359] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:29:32 2022] PUT /identity/v3/projects/58b4497c4bdb4e448910da3a801f60cf/users/63bdbf40d3cf46ad87a3d5b977a03701/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:32.070274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b8ccf-e09e-45db-9ad2-376967c25e45 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:32.070641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b8ccf-e09e-45db-9ad2-376967c25e45 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:32.070765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b8ccf-e09e-45db-9ad2-376967c25e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:32.099440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c88b8ccf-e09e-45db-9ad2-376967c25e45 None None] MFA Rules not processed for user `63bdbf40d3cf46ad87a3d5b977a03701`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:32.100663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c88b8ccf-e09e-45db-9ad2-376967c25e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:32.167869 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1183/2360] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:29:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:32.181352 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c0708-2035-4adb-97d7-35f27f5d8c1e admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:32.183329 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-741c0708-2035-4adb-97d7-35f27f5d8c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:32.245374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c0708-2035-4adb-97d7-35f27f5d8c1e admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:32.249541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5607d-ebda-4e06-a3f3-f7f82558fbe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:32.250192 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5607d-ebda-4e06-a3f3-f7f82558fbe8 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:32.250446 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5607d-ebda-4e06-a3f3-f7f82558fbe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:32.250717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5607d-ebda-4e06-a3f3-f7f82558fbe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:32.259753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5607d-ebda-4e06-a3f3-f7f82558fbe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:32.261394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5607d-ebda-4e06-a3f3-f7f82558fbe8 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:32.271594 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1178/2361] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:32 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:29:34.614929 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ed38e-58e5-4c11-8755-43f2aa80fd24 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:34.615429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ed38e-58e5-4c11-8755-43f2aa80fd24 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:34.615429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ed38e-58e5-4c11-8755-43f2aa80fd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:34.636057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-e78ed38e-58e5-4c11-8755-43f2aa80fd24 None None] MFA Rules not processed for user `8512df3e232c4fd59b7abad4e6e05c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:34.637300 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e78ed38e-58e5-4c11-8755-43f2aa80fd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:34.650882 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:34.700926 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1184/2362] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:29:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:42.266840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:42.609553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5607d-ebda-4e06-a3f3-f7f82558fbe8 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:42.688335 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5607d-ebda-4e06-a3f3-f7f82558fbe8 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:42.693528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef82ca4-1f57-4193-80ae-aa9302152148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:42.694165 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef82ca4-1f57-4193-80ae-aa9302152148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:42.694437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef82ca4-1f57-4193-80ae-aa9302152148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:42.694702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef82ca4-1f57-4193-80ae-aa9302152148 admin admin] PATH_INFO: `/v3/users/63bdbf40d3cf46ad87a3d5b977a03701` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:42.695856 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef82ca4-1f57-4193-80ae-aa9302152148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63bdbf40d3cf46ad87a3d5b977a03701)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:42.697770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef82ca4-1f57-4193-80ae-aa9302152148 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:42.762463 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4ef82ca4-1f57-4193-80ae-aa9302152148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63bdbf40d3cf46ad87a3d5b977a03701'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:42.772673 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4ef82ca4-1f57-4193-80ae-aa9302152148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63bdbf40d3cf46ad87a3d5b977a03701'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:42.773741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4ef82ca4-1f57-4193-80ae-aa9302152148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63bdbf40d3cf46ad87a3d5b977a03701'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:42.774378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4ef82ca4-1f57-4193-80ae-aa9302152148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63bdbf40d3cf46ad87a3d5b977a03701'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:42.787725 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4ef82ca4-1f57-4193-80ae-aa9302152148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63bdbf40d3cf46ad87a3d5b977a03701'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:42.801372 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1179/2363] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:29:42 2022] DELETE /identity/v3/users/63bdbf40d3cf46ad87a3d5b977a03701 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:42.805975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3e4f-ba60-41ff-8e5e-4836cfa3349b None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:42.806509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3e4f-ba60-41ff-8e5e-4836cfa3349b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:42.806629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3e4f-ba60-41ff-8e5e-4836cfa3349b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:42.826287 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f74f3e4f-ba60-41ff-8e5e-4836cfa3349b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:42.827646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f74f3e4f-ba60-41ff-8e5e-4836cfa3349b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:42.894719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1185/2364] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:42.907461 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef82ca4-1f57-4193-80ae-aa9302152148 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:42.908979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4ef82ca4-1f57-4193-80ae-aa9302152148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:42.982783 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef82ca4-1f57-4193-80ae-aa9302152148 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:42.986873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea1dfc-2c95-493a-aff0-e2b1196989c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:42.987616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1dfc-2c95-493a-aff0-e2b1196989c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:42.987889 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1dfc-2c95-493a-aff0-e2b1196989c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:42.988154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1dfc-2c95-493a-aff0-e2b1196989c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:42.998195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea1dfc-2c95-493a-aff0-e2b1196989c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:42.999827 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea1dfc-2c95-493a-aff0-e2b1196989c9 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:43.010311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1180/2365] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:29:43.665519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f3e4f-ba60-41ff-8e5e-4836cfa3349b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:43.667434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f74f3e4f-ba60-41ff-8e5e-4836cfa3349b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:43.682777 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f3e4f-ba60-41ff-8e5e-4836cfa3349b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:43.688140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9820fca-9960-404c-9774-45ee75dce303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:43.689041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9820fca-9960-404c-9774-45ee75dce303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:43.689319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9820fca-9960-404c-9774-45ee75dce303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:43.689594 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9820fca-9960-404c-9774-45ee75dce303 admin admin] PATH_INFO: `/v3/projects/58b4497c4bdb4e448910da3a801f60cf` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:43.691010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9820fca-9960-404c-9774-45ee75dce303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b4497c4bdb4e448910da3a801f60cf)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:43.692979 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9820fca-9960-404c-9774-45ee75dce303 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:43.749018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c9820fca-9960-404c-9774-45ee75dce303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b4497c4bdb4e448910da3a801f60cf', 'request_id': 'req-c9820fca-9960-404c-9774-45ee75dce303'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:43.756543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c9820fca-9960-404c-9774-45ee75dce303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b4497c4bdb4e448910da3a801f60cf', 'request_id': 'req-c9820fca-9960-404c-9774-45ee75dce303'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:43.766143 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c9820fca-9960-404c-9774-45ee75dce303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b4497c4bdb4e448910da3a801f60cf', 'request_id': 'req-c9820fca-9960-404c-9774-45ee75dce303'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:43.777617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c9820fca-9960-404c-9774-45ee75dce303 admin admin] The token cache is being invalidate because project 58b4497c4bdb4e448910da3a801f60cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:29:43.778202 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c9820fca-9960-404c-9774-45ee75dce303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:43.778654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c9820fca-9960-404c-9774-45ee75dce303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:43.780251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1186/2366] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:29:43 2022] DELETE /identity/v3/projects/58b4497c4bdb4e448910da3a801f60cf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:53.006031 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:53.774305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:10.097051 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea1dfc-2c95-493a-aff0-e2b1196989c9 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:30:10.098871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6bea1dfc-2c95-493a-aff0-e2b1196989c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:30:10.112406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea1dfc-2c95-493a-aff0-e2b1196989c9 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:30:10.176223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020453c-116a-4a60-9c07-c6c49b1c5028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:30:10.176916 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020453c-116a-4a60-9c07-c6c49b1c5028 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:30:10.177259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020453c-116a-4a60-9c07-c6c49b1c5028 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:30:10.177628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020453c-116a-4a60-9c07-c6c49b1c5028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:30:10.179434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b020453c-116a-4a60-9c07-c6c49b1c5028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:30:10.245749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020453c-116a-4a60-9c07-c6c49b1c5028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:30:10.247242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020453c-116a-4a60-9c07-c6c49b1c5028 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:30:10.257688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1181/2367] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:30:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:30:20.253286 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=50 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:31.839267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b3597-988b-499f-b6b0-a702b8fbca8e None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:30:31.839880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b3597-988b-499f-b6b0-a702b8fbca8e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:30:31.839880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b3597-988b-499f-b6b0-a702b8fbca8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:30:31.861977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-7c2b3597-988b-499f-b6b0-a702b8fbca8e None None] MFA Rules not processed for user `50e392889ece4517a139dfde15fcb208`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:30:31.863713 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-7c2b3597-988b-499f-b6b0-a702b8fbca8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:30:31.932075 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1187/2368] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:30:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:30:41.919723 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=25 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:58.756285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020453c-116a-4a60-9c07-c6c49b1c5028 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:30:58.757728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b020453c-116a-4a60-9c07-c6c49b1c5028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:30:58.818970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020453c-116a-4a60-9c07-c6c49b1c5028 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:30:58.824460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6138a70-b38d-47b1-bc08-a032694a34a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:30:58.825667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6138a70-b38d-47b1-bc08-a032694a34a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:30:58.826719 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6138a70-b38d-47b1-bc08-a032694a34a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:30:58.827265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6138a70-b38d-47b1-bc08-a032694a34a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:30:58.829692 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f6138a70-b38d-47b1-bc08-a032694a34a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:30:58.909283 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6138a70-b38d-47b1-bc08-a032694a34a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:30:58.910640 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6138a70-b38d-47b1-bc08-a032694a34a7 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:30:58.922115 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1182/2369] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:30:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:31:08.491178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b3597-988b-499f-b6b0-a702b8fbca8e None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:08.492669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-7c2b3597-988b-499f-b6b0-a702b8fbca8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:08.506078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b3597-988b-499f-b6b0-a702b8fbca8e None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:08.510314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ec54a-2f34-4531-a968-4c26f3f517a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:08.511068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec54a-2f34-4531-a968-4c26f3f517a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:08.511344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec54a-2f34-4531-a968-4c26f3f517a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:08.511610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec54a-2f34-4531-a968-4c26f3f517a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:08.513522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-7a0ec54a-2f34-4531-a968-4c26f3f517a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:08.527075 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ec54a-2f34-4531-a968-4c26f3f517a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:08.528510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ec54a-2f34-4531-a968-4c26f3f517a2 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:08.539274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1188/2370] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:31:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:31:08.916982 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=54 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:18.534499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=6 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:35.696608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6138a70-b38d-47b1-bc08-a032694a34a7 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:35.698081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f6138a70-b38d-47b1-bc08-a032694a34a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:35.712520 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6138a70-b38d-47b1-bc08-a032694a34a7 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:35.718108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2b718-577b-4837-8a72-d8ed2e9a7c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:35.718719 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2b718-577b-4837-8a72-d8ed2e9a7c6b service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:35.719026 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2b718-577b-4837-8a72-d8ed2e9a7c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:35.719289 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2b718-577b-4837-8a72-d8ed2e9a7c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:35.721264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f5f2b718-577b-4837-8a72-d8ed2e9a7c6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:35.731845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2b718-577b-4837-8a72-d8ed2e9a7c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:35.733300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2b718-577b-4837-8a72-d8ed2e9a7c6b service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:35.743067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1183/2371] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:31:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:31:42.341133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ec54a-2f34-4531-a968-4c26f3f517a2 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:42.342714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-7a0ec54a-2f34-4531-a968-4c26f3f517a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:42.420971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ec54a-2f34-4531-a968-4c26f3f517a2 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:42.425522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486e052-8337-4881-954e-986e6ef1916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:42.426195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486e052-8337-4881-954e-986e6ef1916e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:42.426468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486e052-8337-4881-954e-986e6ef1916e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:42.426735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486e052-8337-4881-954e-986e6ef1916e admin admin] PATH_INFO: `/v3/users/50e392889ece4517a139dfde15fcb208` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:42.427890 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486e052-8337-4881-954e-986e6ef1916e admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e392889ece4517a139dfde15fcb208)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:42.429897 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486e052-8337-4881-954e-986e6ef1916e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:42.486904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b486e052-8337-4881-954e-986e6ef1916e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e392889ece4517a139dfde15fcb208'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:42.503667 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b486e052-8337-4881-954e-986e6ef1916e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e392889ece4517a139dfde15fcb208'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:42.512622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b486e052-8337-4881-954e-986e6ef1916e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e392889ece4517a139dfde15fcb208'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:42.513200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b486e052-8337-4881-954e-986e6ef1916e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e392889ece4517a139dfde15fcb208'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:42.513815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b486e052-8337-4881-954e-986e6ef1916e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e392889ece4517a139dfde15fcb208'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:42.526854 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1189/2372] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:31:42 2022] DELETE /identity/v3/users/50e392889ece4517a139dfde15fcb208 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:42.731542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2b718-577b-4837-8a72-d8ed2e9a7c6b service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:42.748481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2b718-577b-4837-8a72-d8ed2e9a7c6b service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:42.824152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29aaba-7a22-4658-9c89-390f60159e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:42.824795 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29aaba-7a22-4658-9c89-390f60159e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:42.825070 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29aaba-7a22-4658-9c89-390f60159e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:42.825337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29aaba-7a22-4658-9c89-390f60159e03 admin admin] PATH_INFO: `/v3/projects/ef17bd64c2e648c5b0e4543e635e3d7a` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:42.826569 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29aaba-7a22-4658-9c89-390f60159e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef17bd64c2e648c5b0e4543e635e3d7a)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:42.828569 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29aaba-7a22-4658-9c89-390f60159e03 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:42.880450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2d29aaba-7a22-4658-9c89-390f60159e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'request_id': 'req-2d29aaba-7a22-4658-9c89-390f60159e03'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:42.890604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2d29aaba-7a22-4658-9c89-390f60159e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'request_id': 'req-2d29aaba-7a22-4658-9c89-390f60159e03'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:42.896959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2d29aaba-7a22-4658-9c89-390f60159e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'request_id': 'req-2d29aaba-7a22-4658-9c89-390f60159e03'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:42.909664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2d29aaba-7a22-4658-9c89-390f60159e03 admin admin] The token cache is being invalidate because project ef17bd64c2e648c5b0e4543e635e3d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:31:42.909983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2d29aaba-7a22-4658-9c89-390f60159e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:42.910646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2d29aaba-7a22-4658-9c89-390f60159e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:42.912249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1184/2373] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:31:42 2022] DELETE /identity/v3/projects/ef17bd64c2e648c5b0e4543e635e3d7a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:42.917510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe31d-7b5b-447f-8137-403d65cd135b None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:42.917822 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe31d-7b5b-447f-8137-403d65cd135b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:42.918163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe31d-7b5b-447f-8137-403d65cd135b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:42.940431 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-6edbe31d-7b5b-447f-8137-403d65cd135b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:42.941699 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6edbe31d-7b5b-447f-8137-403d65cd135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:43.008619 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1190/2374] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:31:43.017260 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c0a03-beda-4c43-b2a5-e4f2461fb671 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.017606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c0a03-beda-4c43-b2a5-e4f2461fb671 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.018000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c0a03-beda-4c43-b2a5-e4f2461fb671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.047764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-6c7c0a03-beda-4c43-b2a5-e4f2461fb671 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:43.049118 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6c7c0a03-beda-4c43-b2a5-e4f2461fb671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:43.058421 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1185/2375] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:43.063891 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbe31d-7b5b-447f-8137-403d65cd135b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:43.074729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbe31d-7b5b-447f-8137-403d65cd135b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:43.080122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcaa12-1e4c-4cad-961e-2422dc7b8f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:43.080833 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcaa12-1e4c-4cad-961e-2422dc7b8f1d admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.081111 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcaa12-1e4c-4cad-961e-2422dc7b8f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.081379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcaa12-1e4c-4cad-961e-2422dc7b8f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.082033 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcaa12-1e4c-4cad-961e-2422dc7b8f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:31:43.082330 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcaa12-1e4c-4cad-961e-2422dc7b8f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:43.084058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcaa12-1e4c-4cad-961e-2422dc7b8f1d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:43.097435 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1191/2376] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:31:43.103141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c0a03-beda-4c43-b2a5-e4f2461fb671 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:43.119644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c0a03-beda-4c43-b2a5-e4f2461fb671 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:43.129557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be839a-12c4-4c85-8f6b-bb51ba4ef27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:43.134082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be839a-12c4-4c85-8f6b-bb51ba4ef27e admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.134082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be839a-12c4-4c85-8f6b-bb51ba4ef27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.134082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be839a-12c4-4c85-8f6b-bb51ba4ef27e admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.134082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be839a-12c4-4c85-8f6b-bb51ba4ef27e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:43.136281 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be839a-12c4-4c85-8f6b-bb51ba4ef27e admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:43.165925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1186/2377] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:31:43 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:31:43.170347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcaa12-1e4c-4cad-961e-2422dc7b8f1d admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:43.180789 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcaa12-1e4c-4cad-961e-2422dc7b8f1d admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:43.184934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:43.248932 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb7419-44af-4274-86c6-7eba09aaa7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:43.249554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb7419-44af-4274-86c6-7eba09aaa7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.249830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb7419-44af-4274-86c6-7eba09aaa7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.250093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb7419-44af-4274-86c6-7eba09aaa7d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.250728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb7419-44af-4274-86c6-7eba09aaa7d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:43.252697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb7419-44af-4274-86c6-7eba09aaa7d8 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:43.280862 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1192/2378] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:31:43 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:31:43.282202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be839a-12c4-4c85-8f6b-bb51ba4ef27e admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:43.293244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be839a-12c4-4c85-8f6b-bb51ba4ef27e admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:43.298555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e990180-8bd3-47cf-a9d5-f4d695ccfaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:43.299248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990180-8bd3-47cf-a9d5-f4d695ccfaf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.299556 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990180-8bd3-47cf-a9d5-f4d695ccfaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.299840 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990180-8bd3-47cf-a9d5-f4d695ccfaf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.300561 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e990180-8bd3-47cf-a9d5-f4d695ccfaf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:43.302413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e990180-8bd3-47cf-a9d5-f4d695ccfaf5 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:43.314647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1187/2379] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:31:43.319015 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb7419-44af-4274-86c6-7eba09aaa7d8 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:43.329588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb7419-44af-4274-86c6-7eba09aaa7d8 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:43.334781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a84d3-d60f-4616-aab0-f9ea70e4f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:43.335400 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a84d3-d60f-4616-aab0-f9ea70e4f877 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.335673 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a84d3-d60f-4616-aab0-f9ea70e4f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.335941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a84d3-d60f-4616-aab0-f9ea70e4f877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.336604 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a84d3-d60f-4616-aab0-f9ea70e4f877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:43.338223 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a84d3-d60f-4616-aab0-f9ea70e4f877 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:43.350226 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1193/2380] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:31:43.355003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e990180-8bd3-47cf-a9d5-f4d695ccfaf5 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:43.371227 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e990180-8bd3-47cf-a9d5-f4d695ccfaf5 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:43.377599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5c437-fb1f-46a4-b8a5-7b0de646d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:43.378297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5c437-fb1f-46a4-b8a5-7b0de646d393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.378605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5c437-fb1f-46a4-b8a5-7b0de646d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.378861 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5c437-fb1f-46a4-b8a5-7b0de646d393 admin admin] PATH_INFO: `/v3/projects/0a9c360edd3f46a6bc20bcb78b174478/users/443ee5d3b542498a8aa78716287f5d83/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.396289 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5c437-fb1f-46a4-b8a5-7b0de646d393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9c360edd3f46a6bc20bcb78b174478, user_id=443ee5d3b542498a8aa78716287f5d83, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:43.398999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5c437-fb1f-46a4-b8a5-7b0de646d393 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:43.417835 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1188/2381] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:31:43 2022] PUT /identity/v3/projects/0a9c360edd3f46a6bc20bcb78b174478/users/443ee5d3b542498a8aa78716287f5d83/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:43.423363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77d9c0-36f7-4481-9f97-653129385e74 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.423645 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77d9c0-36f7-4481-9f97-653129385e74 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.424026 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77d9c0-36f7-4481-9f97-653129385e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.444948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-ca77d9c0-36f7-4481-9f97-653129385e74 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:43.446182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ca77d9c0-36f7-4481-9f97-653129385e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:43.518572 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1194/2382] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:43.531952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5c437-fb1f-46a4-b8a5-7b0de646d393 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:43.533990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6ce5c437-fb1f-46a4-b8a5-7b0de646d393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:43.548770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:43.599334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5c437-fb1f-46a4-b8a5-7b0de646d393 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:43.605145 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ba3f9-a734-4d30-9f8b-cdd1b40a28bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:43.605999 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ba3f9-a734-4d30-9f8b-cdd1b40a28bf service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.606270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ba3f9-a734-4d30-9f8b-cdd1b40a28bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.606592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ba3f9-a734-4d30-9f8b-cdd1b40a28bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.621539 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ba3f9-a734-4d30-9f8b-cdd1b40a28bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:43.623526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ba3f9-a734-4d30-9f8b-cdd1b40a28bf service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:43.634036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1189/2383] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:31:47.974859 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a839b-4c87-4757-9bec-fff963b653bc None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:47.975515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a839b-4c87-4757-9bec-fff963b653bc None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:47.975515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a839b-4c87-4757-9bec-fff963b653bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:48.008094 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-793a839b-4c87-4757-9bec-fff963b653bc None None] MFA Rules not processed for user `443ee5d3b542498a8aa78716287f5d83`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:48.009337 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-793a839b-4c87-4757-9bec-fff963b653bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:48.087876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1195/2384] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:31:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:48.092914 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ba3f9-a734-4d30-9f8b-cdd1b40a28bf service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:48.104291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ba3f9-a734-4d30-9f8b-cdd1b40a28bf service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:48.109053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fd814-d216-4e9d-8bc9-d7c6e220f135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:48.109662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fd814-d216-4e9d-8bc9-d7c6e220f135 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:48.109940 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fd814-d216-4e9d-8bc9-d7c6e220f135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:48.110211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fd814-d216-4e9d-8bc9-d7c6e220f135 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:48.110935 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fd814-d216-4e9d-8bc9-d7c6e220f135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:48.112844 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fd814-d216-4e9d-8bc9-d7c6e220f135 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:48.144723 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1190/2385] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:31:48 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:31:48.149750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a839b-4c87-4757-9bec-fff963b653bc None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:48.162166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a839b-4c87-4757-9bec-fff963b653bc None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:48.193182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:48.252627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a053f2-e7a7-4dde-aef3-47a76fe2c4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:48.253294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a053f2-e7a7-4dde-aef3-47a76fe2c4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:48.253651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a053f2-e7a7-4dde-aef3-47a76fe2c4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:48.253984 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a053f2-e7a7-4dde-aef3-47a76fe2c4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:48.254639 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a053f2-e7a7-4dde-aef3-47a76fe2c4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:48.256939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a053f2-e7a7-4dde-aef3-47a76fe2c4f5 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:48.282018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1196/2386] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:31:48 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:31:48.286087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fd814-d216-4e9d-8bc9-d7c6e220f135 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:48.297727 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fd814-d216-4e9d-8bc9-d7c6e220f135 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:48.302921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236e29a-6b72-4935-a286-d3b17df3c9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:48.303637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236e29a-6b72-4935-a286-d3b17df3c9ac admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:48.303978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236e29a-6b72-4935-a286-d3b17df3c9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:48.304318 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236e29a-6b72-4935-a286-d3b17df3c9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:48.305011 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236e29a-6b72-4935-a286-d3b17df3c9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:48.306749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236e29a-6b72-4935-a286-d3b17df3c9ac admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:48.319558 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1191/2387] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:31:48.324734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a053f2-e7a7-4dde-aef3-47a76fe2c4f5 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:48.337057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a053f2-e7a7-4dde-aef3-47a76fe2c4f5 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:48.344080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b3666-93fc-4f19-b637-63d7ac34aaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:48.344961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b3666-93fc-4f19-b637-63d7ac34aaf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:48.345353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b3666-93fc-4f19-b637-63d7ac34aaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:48.345644 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b3666-93fc-4f19-b637-63d7ac34aaf6 admin admin] PATH_INFO: `/v3/projects/1c59de78bd054269bc7d8fc6cfe3ef2b/users/cf2e46e48129441987035f7d8ec46140/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:48.366807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b3666-93fc-4f19-b637-63d7ac34aaf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c59de78bd054269bc7d8fc6cfe3ef2b, user_id=cf2e46e48129441987035f7d8ec46140, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:48.369545 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b3666-93fc-4f19-b637-63d7ac34aaf6 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:48.385307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1197/2388] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:31:48 2022] PUT /identity/v3/projects/1c59de78bd054269bc7d8fc6cfe3ef2b/users/cf2e46e48129441987035f7d8ec46140/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:48.390137 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236e29a-6b72-4935-a286-d3b17df3c9ac admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:48.406142 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236e29a-6b72-4935-a286-d3b17df3c9ac admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:48.474658 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f355d-75fa-444b-b533-dbbbbedc5a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:48.475525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f355d-75fa-444b-b533-dbbbbedc5a62 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:48.475979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f355d-75fa-444b-b533-dbbbbedc5a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:48.476258 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f355d-75fa-444b-b533-dbbbbedc5a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:48.476916 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f355d-75fa-444b-b533-dbbbbedc5a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:48.479981 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f355d-75fa-444b-b533-dbbbbedc5a62 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:48.495616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1192/2389] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:31:48.496923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b3666-93fc-4f19-b637-63d7ac34aaf6 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:48.509771 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b3666-93fc-4f19-b637-63d7ac34aaf6 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:48.514751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ce8f8-0a0b-47f3-b8ee-1e198d61ab08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:48.515912 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ce8f8-0a0b-47f3-b8ee-1e198d61ab08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:48.515912 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ce8f8-0a0b-47f3-b8ee-1e198d61ab08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:48.516154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ce8f8-0a0b-47f3-b8ee-1e198d61ab08 admin admin] PATH_INFO: `/v3/projects/1c59de78bd054269bc7d8fc6cfe3ef2b/users/cf2e46e48129441987035f7d8ec46140/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:48.518022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ce8f8-0a0b-47f3-b8ee-1e198d61ab08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c59de78bd054269bc7d8fc6cfe3ef2b, user_id=cf2e46e48129441987035f7d8ec46140, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:48.520780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ce8f8-0a0b-47f3-b8ee-1e198d61ab08 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:48.533642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1198/2390] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:31:48 2022] PUT /identity/v3/projects/1c59de78bd054269bc7d8fc6cfe3ef2b/users/cf2e46e48129441987035f7d8ec46140/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:31:53.345252 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ec66-53ab-4fad-a956-7357f27c5a85 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:53.345848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ec66-53ab-4fad-a956-7357f27c5a85 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:53.346017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ec66-53ab-4fad-a956-7357f27c5a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:53.378334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-5b73ec66-53ab-4fad-a956-7357f27c5a85 None None] MFA Rules not processed for user `cf2e46e48129441987035f7d8ec46140`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:53.379532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-5b73ec66-53ab-4fad-a956-7357f27c5a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:53.463753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1193/2391] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:31:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:53.477997 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ce8f8-0a0b-47f3-b8ee-1e198d61ab08 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:53.484404 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c66ce8f8-0a0b-47f3-b8ee-1e198d61ab08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:53.557353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ce8f8-0a0b-47f3-b8ee-1e198d61ab08 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:53.561737 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d7d8b-5f17-4275-b605-c10d06cc8e09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7f8976306ff477592c6c5b62af60f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:53.562920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7d8b-5f17-4275-b605-c10d06cc8e09 service glance] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:53.562920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7d8b-5f17-4275-b605-c10d06cc8e09 service glance] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:53.563504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7d8b-5f17-4275-b605-c10d06cc8e09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:53.628704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d7d8b-5f17-4275-b605-c10d06cc8e09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:53.630198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d7d8b-5f17-4275-b605-c10d06cc8e09 service glance] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:53.647022 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1199/2392] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:31:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:31:53.803401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38793a62-5336-46c4-8e2f-475f884f1c51 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:53.803930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38793a62-5336-46c4-8e2f-475f884f1c51 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:53.804141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38793a62-5336-46c4-8e2f-475f884f1c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:53.813192 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:53.825758 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-38793a62-5336-46c4-8e2f-475f884f1c51 None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:53.827653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-38793a62-5336-46c4-8e2f-475f884f1c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:53.893871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1194/2393] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:31:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:53.945724 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d7d8b-5f17-4275-b605-c10d06cc8e09 service glance] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:53.947200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-277d7d8b-5f17-4275-b605-c10d06cc8e09 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:53.977430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:54.032160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d7d8b-5f17-4275-b605-c10d06cc8e09 service glance] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:54.037480 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00debd4c-0205-4c7e-aa0d-8d8a90254301 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:54.038095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00debd4c-0205-4c7e-aa0d-8d8a90254301 service swift] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:54.038364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00debd4c-0205-4c7e-aa0d-8d8a90254301 service swift] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:54.038616 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00debd4c-0205-4c7e-aa0d-8d8a90254301 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:54.047430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00debd4c-0205-4c7e-aa0d-8d8a90254301 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:54.049021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00debd4c-0205-4c7e-aa0d-8d8a90254301 service swift] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:54.058090 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1200/2394] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:31:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 11:31:56.744953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38793a62-5336-46c4-8e2f-475f884f1c51 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:56.750182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-38793a62-5336-46c4-8e2f-475f884f1c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:56.871551 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38793a62-5336-46c4-8e2f-475f884f1c51 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:56.877782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6959b-357f-45fb-b675-567efae7dbe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:56.878500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6959b-357f-45fb-b675-567efae7dbe9 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:56.878872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6959b-357f-45fb-b675-567efae7dbe9 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:56.879216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6959b-357f-45fb-b675-567efae7dbe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:56.881138 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-65c6959b-357f-45fb-b675-567efae7dbe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:56.960291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6959b-357f-45fb-b675-567efae7dbe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:56.962240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6959b-357f-45fb-b675-567efae7dbe9 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:56.984025 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1195/2395] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:31:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:31:58.198066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00debd4c-0205-4c7e-aa0d-8d8a90254301 service swift] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:58.199600 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-00debd4c-0205-4c7e-aa0d-8d8a90254301 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:58.224820 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00debd4c-0205-4c7e-aa0d-8d8a90254301 service swift] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:58.231230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ad151-fdd2-4656-8703-c76a43c76575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:58.231938 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ad151-fdd2-4656-8703-c76a43c76575 service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:58.232217 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ad151-fdd2-4656-8703-c76a43c76575 service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:58.232525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ad151-fdd2-4656-8703-c76a43c76575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:58.234624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-739ad151-fdd2-4656-8703-c76a43c76575 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:58.306165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ad151-fdd2-4656-8703-c76a43c76575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:58.308250 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ad151-fdd2-4656-8703-c76a43c76575 service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:58.326307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1201/2396] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:31:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:02.212739 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6959b-357f-45fb-b675-567efae7dbe9 service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:02.243186 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6959b-357f-45fb-b675-567efae7dbe9 service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:02.276774 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e253a30-22c4-4dee-be7a-64a6aafb8d8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:02.277415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e253a30-22c4-4dee-be7a-64a6aafb8d8b service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:02.277693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e253a30-22c4-4dee-be7a-64a6aafb8d8b service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:02.279474 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e253a30-22c4-4dee-be7a-64a6aafb8d8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:02.282296 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9e253a30-22c4-4dee-be7a-64a6aafb8d8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:02.320088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e253a30-22c4-4dee-be7a-64a6aafb8d8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:02.325151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e253a30-22c4-4dee-be7a-64a6aafb8d8b service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:02.412051 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1196/2397] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:05.440664 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd869c-068d-40ac-bbfb-4ab9e6cda9ce None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:05.441340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd869c-068d-40ac-bbfb-4ab9e6cda9ce None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:05.441340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd869c-068d-40ac-bbfb-4ab9e6cda9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:05.468469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-4cdd869c-068d-40ac-bbfb-4ab9e6cda9ce None None] MFA Rules not processed for user `443ee5d3b542498a8aa78716287f5d83`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:05.468469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-4cdd869c-068d-40ac-bbfb-4ab9e6cda9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:05.472164 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1202/2398] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:32:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:05.777652 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e253a30-22c4-4dee-be7a-64a6aafb8d8b service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:05.812669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:05.838655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e253a30-22c4-4dee-be7a-64a6aafb8d8b service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:05.843091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d597d0-7436-4e48-aa5f-bda50f3ff193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:05.843721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d597d0-7436-4e48-aa5f-bda50f3ff193 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:05.844130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d597d0-7436-4e48-aa5f-bda50f3ff193 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:05.844408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d597d0-7436-4e48-aa5f-bda50f3ff193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:05.846657 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-93d597d0-7436-4e48-aa5f-bda50f3ff193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:05.858059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d597d0-7436-4e48-aa5f-bda50f3ff193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:05.859566 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d597d0-7436-4e48-aa5f-bda50f3ff193 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:05.868736 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1197/2399] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:07.218062 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd869c-068d-40ac-bbfb-4ab9e6cda9ce None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:07.219725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-4cdd869c-068d-40ac-bbfb-4ab9e6cda9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:07.294436 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd869c-068d-40ac-bbfb-4ab9e6cda9ce None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:07.301205 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6da6d7-dc07-40be-9b86-76d36535fdbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:07.302095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6da6d7-dc07-40be-9b86-76d36535fdbe service placement] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:07.302468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6da6d7-dc07-40be-9b86-76d36535fdbe service placement] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:07.303252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6da6d7-dc07-40be-9b86-76d36535fdbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:07.305213 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cf6da6d7-dc07-40be-9b86-76d36535fdbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:07.320170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6da6d7-dc07-40be-9b86-76d36535fdbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:07.322162 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6da6d7-dc07-40be-9b86-76d36535fdbe service placement] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:07.335064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1203/2400] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:11.935654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d5e74-2240-4a30-b88a-b489c88dd36d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:11.936199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d5e74-2240-4a30-b88a-b489c88dd36d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:11.936281 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d5e74-2240-4a30-b88a-b489c88dd36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:11.968517 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-bc0d5e74-2240-4a30-b88a-b489c88dd36d None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:11.969749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-bc0d5e74-2240-4a30-b88a-b489c88dd36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:11.978802 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1198/2401] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:32:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:11.992920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6da6d7-dc07-40be-9b86-76d36535fdbe service placement] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:12.011375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6da6d7-dc07-40be-9b86-76d36535fdbe service placement] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:12.019069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2004b88-0c16-4242-a784-b6ca6affb62f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:12.020252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2004b88-0c16-4242-a784-b6ca6affb62f service swift] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:12.020252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2004b88-0c16-4242-a784-b6ca6affb62f service swift] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:12.020252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2004b88-0c16-4242-a784-b6ca6affb62f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:12.037617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2004b88-0c16-4242-a784-b6ca6affb62f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:12.041245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2004b88-0c16-4242-a784-b6ca6affb62f service swift] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:12.053367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1204/2402] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:32:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 11:32:14.156279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd1c3-cf12-49d2-84b9-c3310870f929 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:14.156880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd1c3-cf12-49d2-84b9-c3310870f929 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:14.156880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd1c3-cf12-49d2-84b9-c3310870f929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:14.196564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-26abd1c3-cf12-49d2-84b9-c3310870f929 None None] MFA Rules not processed for user `8512df3e232c4fd59b7abad4e6e05c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:14.197794 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-26abd1c3-cf12-49d2-84b9-c3310870f929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:14.208628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1199/2403] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:32:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:14.656124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2004b88-0c16-4242-a784-b6ca6affb62f service swift] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:14.666478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2004b88-0c16-4242-a784-b6ca6affb62f service swift] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:14.678239 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aa8ac-af49-4b47-a1fd-f7b6a7bb5351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:14.678892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aa8ac-af49-4b47-a1fd-f7b6a7bb5351 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:14.679166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aa8ac-af49-4b47-a1fd-f7b6a7bb5351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:14.679429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aa8ac-af49-4b47-a1fd-f7b6a7bb5351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:14.681182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-647aa8ac-af49-4b47-a1fd-f7b6a7bb5351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:14.694386 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647aa8ac-af49-4b47-a1fd-f7b6a7bb5351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:14.695963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647aa8ac-af49-4b47-a1fd-f7b6a7bb5351 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:14.705054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1205/2404] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:24.180143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=17 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:24.701458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:32.456825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abd1c3-cf12-49d2-84b9-c3310870f929 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:32.473784 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abd1c3-cf12-49d2-84b9-c3310870f929 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:32.479832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e26110-1e43-4d28-a9f9-b4298d649d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:32.480584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e26110-1e43-4d28-a9f9-b4298d649d3d service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:32.480735 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e26110-1e43-4d28-a9f9-b4298d649d3d service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:32.481178 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e26110-1e43-4d28-a9f9-b4298d649d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:32.483133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-70e26110-1e43-4d28-a9f9-b4298d649d3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:32.496377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e26110-1e43-4d28-a9f9-b4298d649d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:32.497976 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e26110-1e43-4d28-a9f9-b4298d649d3d service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:32.509030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1200/2405] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:37.474503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d693a0c-38cc-4d63-9c21-0aace5a7f56e None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:37.475316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d693a0c-38cc-4d63-9c21-0aace5a7f56e None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:37.475316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d693a0c-38cc-4d63-9c21-0aace5a7f56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:37.503004 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-6d693a0c-38cc-4d63-9c21-0aace5a7f56e None None] MFA Rules not processed for user `8f9dc600fea34effa2afa8aee54aab7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:37.504991 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6d693a0c-38cc-4d63-9c21-0aace5a7f56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:37.514525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1206/2406] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:32:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:41.358119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e26110-1e43-4d28-a9f9-b4298d649d3d service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:41.369936 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e26110-1e43-4d28-a9f9-b4298d649d3d service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:41.376859 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ff7a7-19ac-472b-91d4-367327dc7866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:41.377793 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ff7a7-19ac-472b-91d4-367327dc7866 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:41.378243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ff7a7-19ac-472b-91d4-367327dc7866 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:41.378509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ff7a7-19ac-472b-91d4-367327dc7866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:41.380555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ca0ff7a7-19ac-472b-91d4-367327dc7866 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:41.394077 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ff7a7-19ac-472b-91d4-367327dc7866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:41.395775 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ff7a7-19ac-472b-91d4-367327dc7866 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:41.411146 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1201/2407] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:45.342187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d693a0c-38cc-4d63-9c21-0aace5a7f56e None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:45.358292 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d693a0c-38cc-4d63-9c21-0aace5a7f56e None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:45.364853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef86345-f96d-46db-bbba-d410dc5e407c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:45.365599 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef86345-f96d-46db-bbba-d410dc5e407c service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:45.365847 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef86345-f96d-46db-bbba-d410dc5e407c service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:45.366132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef86345-f96d-46db-bbba-d410dc5e407c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:45.368218 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5ef86345-f96d-46db-bbba-d410dc5e407c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:45.436173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef86345-f96d-46db-bbba-d410dc5e407c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:45.438026 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef86345-f96d-46db-bbba-d410dc5e407c service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:45.451712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1207/2408] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:51.411735 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=12 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:52.250628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ff7a7-19ac-472b-91d4-367327dc7866 service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:52.262204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ff7a7-19ac-472b-91d4-367327dc7866 service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:52.266901 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75031917-7db1-477b-89c6-b2543870e71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:52.267517 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75031917-7db1-477b-89c6-b2543870e71b service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:52.267829 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75031917-7db1-477b-89c6-b2543870e71b service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:52.268097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75031917-7db1-477b-89c6-b2543870e71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:52.280845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75031917-7db1-477b-89c6-b2543870e71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:52.282542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75031917-7db1-477b-89c6-b2543870e71b service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:52.293982 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1202/2409] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:55.445092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=31 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:02.288961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=6 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:26.132825 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bf6d4-4c7b-4b25-9077-fdfc21b7d957 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:26.133456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bf6d4-4c7b-4b25-9077-fdfc21b7d957 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:26.133456 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bf6d4-4c7b-4b25-9077-fdfc21b7d957 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:26.135009 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1208/2410] 10.222.0.59 () {54 vars in 921 bytes} [Tue Aug 9 11:33:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:33:26.141370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d812cbd-28e4-409c-898e-91bd12a568aa None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:26.141934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d812cbd-28e4-409c-898e-91bd12a568aa None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:26.141934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d812cbd-28e4-409c-898e-91bd12a568aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:26.161779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-6d812cbd-28e4-409c-898e-91bd12a568aa None None] MFA Rules not processed for user `54cdc076295642bf945fe63a972b8aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:33:26.163046 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6d812cbd-28e4-409c-898e-91bd12a568aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:33:26.170222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1203/2411] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Aug 9 11:33:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:33:26.183077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bf6d4-4c7b-4b25-9077-fdfc21b7d957 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:33:26.185012 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d36bf6d4-4c7b-4b25-9077-fdfc21b7d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:33:26.201628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bf6d4-4c7b-4b25-9077-fdfc21b7d957 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:33:26.205929 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7106d9-c4e9-429f-84a2-1189a853764f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:33:26.206533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7106d9-c4e9-429f-84a2-1189a853764f service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:26.206802 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7106d9-c4e9-429f-84a2-1189a853764f service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:26.207134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7106d9-c4e9-429f-84a2-1189a853764f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:26.217064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7106d9-c4e9-429f-84a2-1189a853764f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:33:26.218606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7106d9-c4e9-429f-84a2-1189a853764f service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:33:26.227503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1209/2412] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:33:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:33:26.315158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370149-5166-4545-ae05-e8c6074039f4 None None] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:26.315398 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370149-5166-4545-ae05-e8c6074039f4 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:26.315582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370149-5166-4545-ae05-e8c6074039f4 None None] PATH_INFO: `/` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:26.316953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1204/2413] 10.222.0.59 () {54 vars in 921 bytes} [Tue Aug 9 11:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:33:26.322762 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98aafa-d2f3-437e-8a57-e37e11e9f9cc None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:26.323131 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98aafa-d2f3-437e-8a57-e37e11e9f9cc None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:26.323447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98aafa-d2f3-437e-8a57-e37e11e9f9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:26.349056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-da98aafa-d2f3-437e-8a57-e37e11e9f9cc None None] MFA Rules not processed for user `2136cf1160a64951ad780424cb28403b`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:33:26.350375 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-da98aafa-d2f3-437e-8a57-e37e11e9f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:33:26.372215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1210/2414] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Aug 9 11:33:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:33:26.385054 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30370149-5166-4545-ae05-e8c6074039f4 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:33:26.397976 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30370149-5166-4545-ae05-e8c6074039f4 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:33:26.401900 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922b731-da8f-40dd-ae80-6aed63c81580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:33:26.402718 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922b731-da8f-40dd-ae80-6aed63c81580 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:26.403002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922b731-da8f-40dd-ae80-6aed63c81580 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:26.403291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922b731-da8f-40dd-ae80-6aed63c81580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:26.414416 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922b731-da8f-40dd-ae80-6aed63c81580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:33:26.415912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922b731-da8f-40dd-ae80-6aed63c81580 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:33:26.427455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1205/2415] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:33:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:33:26.435577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98aafa-d2f3-437e-8a57-e37e11e9f9cc None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:33:26.445408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98aafa-d2f3-437e-8a57-e37e11e9f9cc None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:33:26.449369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8acde-6a2b-4064-9331-8a8c367e75d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:33:26.449976 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8acde-6a2b-4064-9331-8a8c367e75d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:26.450282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8acde-6a2b-4064-9331-8a8c367e75d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:26.450554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8acde-6a2b-4064-9331-8a8c367e75d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:26.452577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-52d8acde-6a2b-4064-9331-8a8c367e75d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:33:26.521492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8acde-6a2b-4064-9331-8a8c367e75d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:33:26.522980 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8acde-6a2b-4064-9331-8a8c367e75d9 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:33:26.532696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1211/2416] 10.222.0.59 () {60 vars in 1396 bytes} [Tue Aug 9 11:33:26 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:33:36.422492 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=9 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:36.528412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=37 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:08.708216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922b731-da8f-40dd-ae80-6aed63c81580 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:34:08.755496 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922b731-da8f-40dd-ae80-6aed63c81580 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:34:08.759485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1cce6-872f-460f-bfbf-56481c635c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:34:08.760108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1cce6-872f-460f-bfbf-56481c635c5e service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:08.760384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1cce6-872f-460f-bfbf-56481c635c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:08.760654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1cce6-872f-460f-bfbf-56481c635c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:08.762451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ede1cce6-872f-460f-bfbf-56481c635c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:08.893518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1cce6-872f-460f-bfbf-56481c635c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:34:08.895018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1cce6-872f-460f-bfbf-56481c635c5e service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:34:08.915685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1206/2417] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:34:12.217650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8acde-6a2b-4064-9331-8a8c367e75d9 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:34:12.219215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-52d8acde-6a2b-4064-9331-8a8c367e75d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:12.295320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1cce6-872f-460f-bfbf-56481c635c5e service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:34:12.297847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ede1cce6-872f-460f-bfbf-56481c635c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:12.310333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8acde-6a2b-4064-9331-8a8c367e75d9 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:34:12.315928 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b021d-7fe0-4d9b-b20e-f71f7f26862b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:34:12.316299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1cce6-872f-460f-bfbf-56481c635c5e service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:34:12.316537 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b021d-7fe0-4d9b-b20e-f71f7f26862b service placement] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:12.316821 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b021d-7fe0-4d9b-b20e-f71f7f26862b service placement] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:12.317114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b021d-7fe0-4d9b-b20e-f71f7f26862b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:12.319055 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-775b021d-7fe0-4d9b-b20e-f71f7f26862b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:12.321373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d81d9-bbdb-491f-9a59-4fced794bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:34:12.322008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d81d9-bbdb-491f-9a59-4fced794bbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:12.322282 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d81d9-bbdb-491f-9a59-4fced794bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:12.322612 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d81d9-bbdb-491f-9a59-4fced794bbd4 admin admin] PATH_INFO: `/v3/users/8f9dc600fea34effa2afa8aee54aab7e` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:12.324164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d81d9-bbdb-491f-9a59-4fced794bbd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9dc600fea34effa2afa8aee54aab7e)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:34:12.326328 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d81d9-bbdb-491f-9a59-4fced794bbd4 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:34:12.331830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b021d-7fe0-4d9b-b20e-f71f7f26862b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:34:12.333759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b021d-7fe0-4d9b-b20e-f71f7f26862b service placement] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:34:12.345072 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1212/2418] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:34:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:34:12.392297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7d3d81d9-bbdb-491f-9a59-4fced794bbd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9dc600fea34effa2afa8aee54aab7e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:34:12.401156 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7d3d81d9-bbdb-491f-9a59-4fced794bbd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9dc600fea34effa2afa8aee54aab7e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:34:12.403218 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7d3d81d9-bbdb-491f-9a59-4fced794bbd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9dc600fea34effa2afa8aee54aab7e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:34:12.403931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7d3d81d9-bbdb-491f-9a59-4fced794bbd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9dc600fea34effa2afa8aee54aab7e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:34:12.413939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:12.418622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7d3d81d9-bbdb-491f-9a59-4fced794bbd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9dc600fea34effa2afa8aee54aab7e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:34:12.433531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1207/2419] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:34:12 2022] DELETE /identity/v3/users/8f9dc600fea34effa2afa8aee54aab7e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:34:12.613719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b021d-7fe0-4d9b-b20e-f71f7f26862b service placement] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:34:12.628528 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b021d-7fe0-4d9b-b20e-f71f7f26862b service placement] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:34:12.690373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:34:12.691156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:12.691432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:12.691736 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c admin admin] PATH_INFO: `/v3/projects/b0a6fd5299a7475bad7836d22b23967d` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:12.693072 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a6fd5299a7475bad7836d22b23967d)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:34:12.695038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:34:12.746557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a6fd5299a7475bad7836d22b23967d', 'request_id': 'req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:34:12.753036 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a6fd5299a7475bad7836d22b23967d', 'request_id': 'req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:34:12.761915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a6fd5299a7475bad7836d22b23967d', 'request_id': 'req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:34:12.772956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c admin admin] The token cache is being invalidate because project b0a6fd5299a7475bad7836d22b23967d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:34:12.773087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:34:12.773780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-1b6da9b1-e5eb-4078-9f7f-d7e3d747f73c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:34:12.775267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1213/2420] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:34:12 2022] DELETE /identity/v3/projects/b0a6fd5299a7475bad7836d22b23967d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:34:12.780471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ac62-e4a9-403d-be6c-e408664e2574 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:12.780811 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ac62-e4a9-403d-be6c-e408664e2574 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:12.781036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ac62-e4a9-403d-be6c-e408664e2574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:12.843997 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-0f00ac62-e4a9-403d-be6c-e408664e2574 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:34:12.845328 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-0f00ac62-e4a9-403d-be6c-e408664e2574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:12.902438 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1208/2421] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:34:12.910536 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901378e-7fe0-4e65-ac0e-2afa25dc6657 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:12.910758 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901378e-7fe0-4e65-ac0e-2afa25dc6657 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:12.911086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901378e-7fe0-4e65-ac0e-2afa25dc6657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:12.938046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-9901378e-7fe0-4e65-ac0e-2afa25dc6657 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:34:12.940089 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9901378e-7fe0-4e65-ac0e-2afa25dc6657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:12.948586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1214/2422] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:34:12.953493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00ac62-e4a9-403d-be6c-e408664e2574 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:34:12.964278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00ac62-e4a9-403d-be6c-e408664e2574 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:34:12.970114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d081227-b27f-4353-adab-e96fbd8164a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:34:12.970603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d081227-b27f-4353-adab-e96fbd8164a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:12.970888 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d081227-b27f-4353-adab-e96fbd8164a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:12.971151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d081227-b27f-4353-adab-e96fbd8164a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:12.971824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d081227-b27f-4353-adab-e96fbd8164a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:34:12.972117 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d081227-b27f-4353-adab-e96fbd8164a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:34:12.974896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d081227-b27f-4353-adab-e96fbd8164a1 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:34:12.986791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1209/2423] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:34:12.991788 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901378e-7fe0-4e65-ac0e-2afa25dc6657 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:34:13.001635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901378e-7fe0-4e65-ac0e-2afa25dc6657 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:34:13.007253 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed1081-94d3-4627-aaba-dc5114618b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:34:13.007844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed1081-94d3-4627-aaba-dc5114618b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:13.008112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed1081-94d3-4627-aaba-dc5114618b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:13.008381 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed1081-94d3-4627-aaba-dc5114618b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:13.008996 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed1081-94d3-4627-aaba-dc5114618b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:34:13.010973 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed1081-94d3-4627-aaba-dc5114618b5e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:34:13.027488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:13.043048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1215/2424] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:34:12 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:34:13.048040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d081227-b27f-4353-adab-e96fbd8164a1 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:34:13.060004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d081227-b27f-4353-adab-e96fbd8164a1 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:34:13.125770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b0320-e5a7-47be-b4a1-a7ae434bc2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:34:13.126433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b0320-e5a7-47be-b4a1-a7ae434bc2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:13.126709 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b0320-e5a7-47be-b4a1-a7ae434bc2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:13.127009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b0320-e5a7-47be-b4a1-a7ae434bc2a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:13.127642 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b0320-e5a7-47be-b4a1-a7ae434bc2a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:34:13.129586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b0320-e5a7-47be-b4a1-a7ae434bc2a8 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:34:13.153234 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1210/2425] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:34:13 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:34:13.158207 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed1081-94d3-4627-aaba-dc5114618b5e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:34:13.172825 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed1081-94d3-4627-aaba-dc5114618b5e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:34:13.178649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730eb801-63e5-4710-9f21-2c5e59814076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:34:13.179290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eb801-63e5-4710-9f21-2c5e59814076 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:13.179637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eb801-63e5-4710-9f21-2c5e59814076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:13.179963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eb801-63e5-4710-9f21-2c5e59814076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:13.180558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730eb801-63e5-4710-9f21-2c5e59814076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:34:13.182177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730eb801-63e5-4710-9f21-2c5e59814076 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:34:13.192646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1216/2426] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:34:13.196788 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b0320-e5a7-47be-b4a1-a7ae434bc2a8 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:34:13.207094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b0320-e5a7-47be-b4a1-a7ae434bc2a8 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:34:13.212565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbe412-a563-428d-b57d-38a429ec1f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:34:13.213148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbe412-a563-428d-b57d-38a429ec1f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:13.213419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbe412-a563-428d-b57d-38a429ec1f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:13.213685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbe412-a563-428d-b57d-38a429ec1f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:13.214320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbe412-a563-428d-b57d-38a429ec1f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:34:13.216002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbe412-a563-428d-b57d-38a429ec1f43 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:34:13.226902 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1211/2427] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:34:13.231867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730eb801-63e5-4710-9f21-2c5e59814076 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:34:13.242014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730eb801-63e5-4710-9f21-2c5e59814076 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:34:13.246796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458e6d8-c9d4-44af-b7bb-5ebdaf4532fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:34:13.247475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e6d8-c9d4-44af-b7bb-5ebdaf4532fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:13.247748 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e6d8-c9d4-44af-b7bb-5ebdaf4532fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:13.248010 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e6d8-c9d4-44af-b7bb-5ebdaf4532fc admin admin] PATH_INFO: `/v3/projects/4f10ad025e8e405e82f06156adef690e/users/62968629eb0e4ccf8713787d6c4aef5b/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:13.262679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458e6d8-c9d4-44af-b7bb-5ebdaf4532fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f10ad025e8e405e82f06156adef690e, user_id=62968629eb0e4ccf8713787d6c4aef5b, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:34:13.265388 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458e6d8-c9d4-44af-b7bb-5ebdaf4532fc admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:34:13.280446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1217/2428] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:34:13 2022] PUT /identity/v3/projects/4f10ad025e8e405e82f06156adef690e/users/62968629eb0e4ccf8713787d6c4aef5b/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:34:13.286699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e60228-9e94-44a0-b981-00771064c5f9 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:13.287084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e60228-9e94-44a0-b981-00771064c5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:13.287480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e60228-9e94-44a0-b981-00771064c5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:13.310300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-a7e60228-9e94-44a0-b981-00771064c5f9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:34:13.311461 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a7e60228-9e94-44a0-b981-00771064c5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:13.324402 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:13.374708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1212/2429] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:34:13.390499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458e6d8-c9d4-44af-b7bb-5ebdaf4532fc admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:34:13.392448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b458e6d8-c9d4-44af-b7bb-5ebdaf4532fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:13.463037 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458e6d8-c9d4-44af-b7bb-5ebdaf4532fc admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:34:13.466851 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff331a59-3e02-486b-88ee-b729e45b83c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:34:13.467490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff331a59-3e02-486b-88ee-b729e45b83c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:13.467739 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff331a59-3e02-486b-88ee-b729e45b83c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:13.468019 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff331a59-3e02-486b-88ee-b729e45b83c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:13.482210 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff331a59-3e02-486b-88ee-b729e45b83c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:34:13.483684 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff331a59-3e02-486b-88ee-b729e45b83c0 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:34:13.493493 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1218/2430] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:34:17.972126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5297e-8d18-4d01-8720-f8c748548d41 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:17.973203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5297e-8d18-4d01-8720-f8c748548d41 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:17.975519 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5297e-8d18-4d01-8720-f8c748548d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:18.063821 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-33b5297e-8d18-4d01-8720-f8c748548d41 None None] MFA Rules not processed for user `62968629eb0e4ccf8713787d6c4aef5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:34:18.065832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-33b5297e-8d18-4d01-8720-f8c748548d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:18.182005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1213/2431] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:34:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:34:18.189525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff331a59-3e02-486b-88ee-b729e45b83c0 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:34:18.191707 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ff331a59-3e02-486b-88ee-b729e45b83c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:18.381782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff331a59-3e02-486b-88ee-b729e45b83c0 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:34:18.388164 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448b84-6cb8-42b1-bef7-10022d372ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:34:18.388813 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448b84-6cb8-42b1-bef7-10022d372ac9 service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:18.389110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448b84-6cb8-42b1-bef7-10022d372ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:18.389384 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448b84-6cb8-42b1-bef7-10022d372ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:18.400755 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29448b84-6cb8-42b1-bef7-10022d372ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:34:18.402399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29448b84-6cb8-42b1-bef7-10022d372ac9 service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:34:18.412738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1219/2432] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:34:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:34:20.267745 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00382a40-688f-4739-a311-512a1d20bc44 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:20.268448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00382a40-688f-4739-a311-512a1d20bc44 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:20.268653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00382a40-688f-4739-a311-512a1d20bc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:20.299229 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-00382a40-688f-4739-a311-512a1d20bc44 None None] MFA Rules not processed for user `62968629eb0e4ccf8713787d6c4aef5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:34:20.300444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-00382a40-688f-4739-a311-512a1d20bc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:20.307548 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1214/2433] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:34:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:34:23.611838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4050b7-d057-40be-a4f9-0e236efbabee None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:23.612367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4050b7-d057-40be-a4f9-0e236efbabee None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:23.612367 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4050b7-d057-40be-a4f9-0e236efbabee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:23.636117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-0a4050b7-d057-40be-a4f9-0e236efbabee None None] MFA Rules not processed for user `0f80c1f4f2d04a9b80ab0c315dfe180d`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:34:23.637325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0a4050b7-d057-40be-a4f9-0e236efbabee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:23.642751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:23.707968 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1220/2434] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:34:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:34:26.785214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00382a40-688f-4739-a311-512a1d20bc44 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:34:26.787375 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-00382a40-688f-4739-a311-512a1d20bc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:26.881573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00382a40-688f-4739-a311-512a1d20bc44 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:34:26.887480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841a6e2-64cd-460b-93a6-3a8d0ab37ece service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:34:26.888131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841a6e2-64cd-460b-93a6-3a8d0ab37ece service placement] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:26.888755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841a6e2-64cd-460b-93a6-3a8d0ab37ece service placement] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:26.889189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841a6e2-64cd-460b-93a6-3a8d0ab37ece service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:26.891116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7841a6e2-64cd-460b-93a6-3a8d0ab37ece service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:26.904649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841a6e2-64cd-460b-93a6-3a8d0ab37ece service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:34:26.906972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841a6e2-64cd-460b-93a6-3a8d0ab37ece service placement] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:34:26.918903 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1215/2435] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:34:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:34:32.287003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff6126-5928-4ff5-a3d2-b75a99d26b62 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:34:32.287633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff6126-5928-4ff5-a3d2-b75a99d26b62 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:34:32.287805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff6126-5928-4ff5-a3d2-b75a99d26b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:34:32.313873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a0ff6126-5928-4ff5-a3d2-b75a99d26b62 None None] MFA Rules not processed for user `8512df3e232c4fd59b7abad4e6e05c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:34:32.315721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a0ff6126-5928-4ff5-a3d2-b75a99d26b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:34:32.378493 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1221/2436] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:34:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:34:36.913746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=86 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:42.369831 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=45 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:35:36.064374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba5b67-055d-4b30-9ddf-d19e704458c3 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:35:36.064961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba5b67-055d-4b30-9ddf-d19e704458c3 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:35:36.064961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba5b67-055d-4b30-9ddf-d19e704458c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:35:36.104789 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-d0ba5b67-055d-4b30-9ddf-d19e704458c3 None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:35:36.106000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d0ba5b67-055d-4b30-9ddf-d19e704458c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:35:36.162187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1216/2437] 10.222.0.59 () {58 vars in 967 bytes} [Tue Aug 9 11:35:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:35:36.204215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff6126-5928-4ff5-a3d2-b75a99d26b62 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:35:36.206225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a0ff6126-5928-4ff5-a3d2-b75a99d26b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:35:36.278287 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff6126-5928-4ff5-a3d2-b75a99d26b62 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:35:36.285054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6c1a8-8cc7-4814-82f5-0c97823b702f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:35:36.285785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6c1a8-8cc7-4814-82f5-0c97823b702f service swift] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:35:36.286066 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6c1a8-8cc7-4814-82f5-0c97823b702f service swift] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:35:36.286331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6c1a8-8cc7-4814-82f5-0c97823b702f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:35:36.295489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6c1a8-8cc7-4814-82f5-0c97823b702f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:35:36.297086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6c1a8-8cc7-4814-82f5-0c97823b702f service swift] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:35:36.305341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1222/2438] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:35:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:35:39.959074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba5b67-055d-4b30-9ddf-d19e704458c3 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:35:39.960993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d0ba5b67-055d-4b30-9ddf-d19e704458c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:35:39.976319 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba5b67-055d-4b30-9ddf-d19e704458c3 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:35:39.981446 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f5798-cb67-4f36-a9ad-1b20d056c725 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:35:39.982090 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f5798-cb67-4f36-a9ad-1b20d056c725 service placement] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:35:39.982367 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f5798-cb67-4f36-a9ad-1b20d056c725 service placement] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:35:39.982640 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f5798-cb67-4f36-a9ad-1b20d056c725 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:35:39.984429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-af0f5798-cb67-4f36-a9ad-1b20d056c725 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:35:39.996810 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f5798-cb67-4f36-a9ad-1b20d056c725 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:35:39.998596 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f5798-cb67-4f36-a9ad-1b20d056c725 service placement] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:35:40.010204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1217/2439] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:35:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:35:43.273665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6c1a8-8cc7-4814-82f5-0c97823b702f service swift] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:35:43.275228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0da6c1a8-8cc7-4814-82f5-0c97823b702f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:35:43.289069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6c1a8-8cc7-4814-82f5-0c97823b702f service swift] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:35:43.293494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be646840-fe51-42e5-81bc-d2af9c077dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:35:43.294122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be646840-fe51-42e5-81bc-d2af9c077dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:35:43.294417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be646840-fe51-42e5-81bc-d2af9c077dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:35:43.294740 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be646840-fe51-42e5-81bc-d2af9c077dbf admin admin] PATH_INFO: `/v3/users/443ee5d3b542498a8aa78716287f5d83` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:35:43.295902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be646840-fe51-42e5-81bc-d2af9c077dbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=443ee5d3b542498a8aa78716287f5d83)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:35:43.297823 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be646840-fe51-42e5-81bc-d2af9c077dbf admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:35:43.344772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-be646840-fe51-42e5-81bc-d2af9c077dbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443ee5d3b542498a8aa78716287f5d83'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.356391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-be646840-fe51-42e5-81bc-d2af9c077dbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443ee5d3b542498a8aa78716287f5d83'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.366136 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-be646840-fe51-42e5-81bc-d2af9c077dbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443ee5d3b542498a8aa78716287f5d83'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.366957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-be646840-fe51-42e5-81bc-d2af9c077dbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443ee5d3b542498a8aa78716287f5d83'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.367978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-be646840-fe51-42e5-81bc-d2af9c077dbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443ee5d3b542498a8aa78716287f5d83'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.383336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1223/2440] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:35:43 2022] DELETE /identity/v3/users/443ee5d3b542498a8aa78716287f5d83 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:35:43.565295 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f5798-cb67-4f36-a9ad-1b20d056c725 service placement] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:35:43.578796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f5798-cb67-4f36-a9ad-1b20d056c725 service placement] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:35:43.642868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:35:43.643377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:35:43.643649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:35:43.643909 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] PATH_INFO: `/v3/projects/0a9c360edd3f46a6bc20bcb78b174478` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:35:43.645068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a9c360edd3f46a6bc20bcb78b174478)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:35:43.646989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:35:43.705688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a9c360edd3f46a6bc20bcb78b174478', 'request_id': 'req-218f1ebb-961c-4345-b6c0-4268c1e36084'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.714211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a9c360edd3f46a6bc20bcb78b174478', 'request_id': 'req-218f1ebb-961c-4345-b6c0-4268c1e36084'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.719948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a9c360edd3f46a6bc20bcb78b174478', 'request_id': 'req-218f1ebb-961c-4345-b6c0-4268c1e36084'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.730846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] The token cache is being invalidate because project 0a9c360edd3f46a6bc20bcb78b174478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:35:43.731136 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.731770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.733436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1218/2441] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:35:43 2022] DELETE /identity/v3/projects/0a9c360edd3f46a6bc20bcb78b174478 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:35:43.737780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be646840-fe51-42e5-81bc-d2af9c077dbf admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:35:43.739325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-be646840-fe51-42e5-81bc-d2af9c077dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:35:43.753014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be646840-fe51-42e5-81bc-d2af9c077dbf admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:35:43.810436 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee9a08-3aa0-43a8-af45-818b5c3f193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:35:43.811145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9a08-3aa0-43a8-af45-818b5c3f193e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:35:43.811402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9a08-3aa0-43a8-af45-818b5c3f193e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:35:43.811685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9a08-3aa0-43a8-af45-818b5c3f193e admin admin] PATH_INFO: `/v3/users/cf2e46e48129441987035f7d8ec46140` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:35:43.814829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee9a08-3aa0-43a8-af45-818b5c3f193e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2e46e48129441987035f7d8ec46140)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:35:43.816754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee9a08-3aa0-43a8-af45-818b5c3f193e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:35:43.819460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:35:43.868785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-29ee9a08-3aa0-43a8-af45-818b5c3f193e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2e46e48129441987035f7d8ec46140'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.882031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-29ee9a08-3aa0-43a8-af45-818b5c3f193e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2e46e48129441987035f7d8ec46140'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.891051 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-29ee9a08-3aa0-43a8-af45-818b5c3f193e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2e46e48129441987035f7d8ec46140'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.891681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-29ee9a08-3aa0-43a8-af45-818b5c3f193e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2e46e48129441987035f7d8ec46140'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.892278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-29ee9a08-3aa0-43a8-af45-818b5c3f193e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2e46e48129441987035f7d8ec46140'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:43.907322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1224/2442] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:35:43 2022] DELETE /identity/v3/users/cf2e46e48129441987035f7d8ec46140 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:35:44.103691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:35:44.105439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:35:44.118996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f1ebb-961c-4345-b6c0-4268c1e36084 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:35:44.129440 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:35:44.181663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:35:44.182217 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:35:44.182493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:35:44.182757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] PATH_INFO: `/v3/projects/1c59de78bd054269bc7d8fc6cfe3ef2b` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:35:44.183972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c59de78bd054269bc7d8fc6cfe3ef2b)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:35:44.185930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:35:44.244593 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c59de78bd054269bc7d8fc6cfe3ef2b', 'request_id': 'req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:44.253644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c59de78bd054269bc7d8fc6cfe3ef2b', 'request_id': 'req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:44.260618 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c59de78bd054269bc7d8fc6cfe3ef2b', 'request_id': 'req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:44.273704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] The token cache is being invalidate because project 1c59de78bd054269bc7d8fc6cfe3ef2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:35:44.273978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:44.274646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:35:44.276172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1219/2443] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:35:44 2022] DELETE /identity/v3/projects/1c59de78bd054269bc7d8fc6cfe3ef2b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:35:53.903729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:35:54.270359 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:09.580448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee9a08-3aa0-43a8-af45-818b5c3f193e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:09.582243 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-29ee9a08-3aa0-43a8-af45-818b5c3f193e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:09.652914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee9a08-3aa0-43a8-af45-818b5c3f193e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:09.709966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931fd3d-75fa-4a53-8b8d-9a1df782f11b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7f8976306ff477592c6c5b62af60f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:09.710593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931fd3d-75fa-4a53-8b8d-9a1df782f11b service glance] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:09.710927 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931fd3d-75fa-4a53-8b8d-9a1df782f11b service glance] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:09.711201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931fd3d-75fa-4a53-8b8d-9a1df782f11b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:09.713131 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-7931fd3d-75fa-4a53-8b8d-9a1df782f11b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:09.811226 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931fd3d-75fa-4a53-8b8d-9a1df782f11b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:09.812585 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931fd3d-75fa-4a53-8b8d-9a1df782f11b service glance] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:09.824203 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1225/2444] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:36:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:36:10.001110 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:10.002965 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:10.064817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae95dee-7d77-4eb3-9762-78f9ff9fb67c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:10.068723 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dfe49-af71-48b2-aa45-04fbf24c5e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:10.069329 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dfe49-af71-48b2-aa45-04fbf24c5e74 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:10.069596 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dfe49-af71-48b2-aa45-04fbf24c5e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:10.069863 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dfe49-af71-48b2-aa45-04fbf24c5e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:10.071733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-337dfe49-af71-48b2-aa45-04fbf24c5e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:10.096089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dfe49-af71-48b2-aa45-04fbf24c5e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:10.097670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dfe49-af71-48b2-aa45-04fbf24c5e74 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:10.109408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1220/2445] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:36:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:36:19.819081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=74 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:20.103992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=26 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:28.836011 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4b1ec-979b-417c-b772-ba7bf4652591 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:28.836566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4b1ec-979b-417c-b772-ba7bf4652591 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:28.836566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4b1ec-979b-417c-b772-ba7bf4652591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:28.890295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b6d4b1ec-979b-417c-b772-ba7bf4652591 None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:36:28.891574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b6d4b1ec-979b-417c-b772-ba7bf4652591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:28.963206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1226/2446] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:36:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:36:28.977269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dfe49-af71-48b2-aa45-04fbf24c5e74 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:28.978748 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-337dfe49-af71-48b2-aa45-04fbf24c5e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:29.076098 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dfe49-af71-48b2-aa45-04fbf24c5e74 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:29.082027 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d454b-0fba-4798-a5a5-d0ae6d1b6d91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:29.082625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d454b-0fba-4798-a5a5-d0ae6d1b6d91 service swift] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:29.082933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d454b-0fba-4798-a5a5-d0ae6d1b6d91 service swift] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:29.083182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d454b-0fba-4798-a5a5-d0ae6d1b6d91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:29.091580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d454b-0fba-4798-a5a5-d0ae6d1b6d91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:29.093160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d454b-0fba-4798-a5a5-d0ae6d1b6d91 service swift] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:29.102201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1221/2447] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:36:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:36:36.934147 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4b1ec-979b-417c-b772-ba7bf4652591 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:36.950707 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4b1ec-979b-417c-b772-ba7bf4652591 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:36.956759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516e6fe-c9b2-4660-bc4d-4a862f1c6b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:36.957626 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e6fe-c9b2-4660-bc4d-4a862f1c6b43 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:36.958079 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e6fe-c9b2-4660-bc4d-4a862f1c6b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:36.958499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e6fe-c9b2-4660-bc4d-4a862f1c6b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:36.960675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f516e6fe-c9b2-4660-bc4d-4a862f1c6b43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:37.048532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516e6fe-c9b2-4660-bc4d-4a862f1c6b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:37.050405 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516e6fe-c9b2-4660-bc4d-4a862f1c6b43 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:37.061858 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1227/2448] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:36:39.098319 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=41 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:39.572739 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d454b-0fba-4798-a5a5-d0ae6d1b6d91 service swift] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:39.584003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d454b-0fba-4798-a5a5-d0ae6d1b6d91 service swift] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:39.588080 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cfc46-c882-45c9-b05a-41e36126c1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:39.588758 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cfc46-c882-45c9-b05a-41e36126c1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:39.589037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cfc46-c882-45c9-b05a-41e36126c1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:39.589433 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cfc46-c882-45c9-b05a-41e36126c1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:39.591246 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ef2cfc46-c882-45c9-b05a-41e36126c1d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:39.602237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cfc46-c882-45c9-b05a-41e36126c1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:39.604819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cfc46-c882-45c9-b05a-41e36126c1d0 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:39.615809 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1222/2449] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:36:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:36:41.063082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516e6fe-c9b2-4660-bc4d-4a862f1c6b43 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:41.065564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f516e6fe-c9b2-4660-bc4d-4a862f1c6b43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:41.078208 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516e6fe-c9b2-4660-bc4d-4a862f1c6b43 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:41.089784 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3497f32-457e-422c-98b6-9e0ff8eb2fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:41.090585 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497f32-457e-422c-98b6-9e0ff8eb2fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:41.091074 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497f32-457e-422c-98b6-9e0ff8eb2fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:41.091348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497f32-457e-422c-98b6-9e0ff8eb2fea admin admin] PATH_INFO: `/v3/users/8512df3e232c4fd59b7abad4e6e05c9d` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:41.108675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3497f32-457e-422c-98b6-9e0ff8eb2fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8512df3e232c4fd59b7abad4e6e05c9d)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:41.110758 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3497f32-457e-422c-98b6-9e0ff8eb2fea admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:41.164782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c3497f32-457e-422c-98b6-9e0ff8eb2fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8512df3e232c4fd59b7abad4e6e05c9d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:41.167546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:41.184245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c3497f32-457e-422c-98b6-9e0ff8eb2fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8512df3e232c4fd59b7abad4e6e05c9d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:41.214932 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c3497f32-457e-422c-98b6-9e0ff8eb2fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8512df3e232c4fd59b7abad4e6e05c9d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:41.215682 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c3497f32-457e-422c-98b6-9e0ff8eb2fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8512df3e232c4fd59b7abad4e6e05c9d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:41.216299 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-c3497f32-457e-422c-98b6-9e0ff8eb2fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8512df3e232c4fd59b7abad4e6e05c9d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:41.230299 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1228/2450] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:36:41 2022] DELETE /identity/v3/users/8512df3e232c4fd59b7abad4e6e05c9d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:36:41.416188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cfc46-c882-45c9-b05a-41e36126c1d0 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:41.429781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cfc46-c882-45c9-b05a-41e36126c1d0 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:41.496278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:41.497627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:41.498013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:41.498457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7 admin admin] PATH_INFO: `/v3/projects/73d1d7152cc64ac1948d1a97b6b63bd2` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:41.515554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d1d7152cc64ac1948d1a97b6b63bd2)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:41.518583 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:41.573453 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d1d7152cc64ac1948d1a97b6b63bd2', 'request_id': 'req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:41.582104 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d1d7152cc64ac1948d1a97b6b63bd2', 'request_id': 'req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:41.588343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d1d7152cc64ac1948d1a97b6b63bd2', 'request_id': 'req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:41.600024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7 admin admin] The token cache is being invalidate because project 73d1d7152cc64ac1948d1a97b6b63bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:36:41.600343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:41.600974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-7031cad3-b50a-4f14-bb6f-0cf6281a83d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:41.602435 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1223/2451] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:36:41 2022] DELETE /identity/v3/projects/73d1d7152cc64ac1948d1a97b6b63bd2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:36:41.607361 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5703d-3eba-4978-aa3b-2439c08d24c9 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:41.607635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5703d-3eba-4978-aa3b-2439c08d24c9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:41.607896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5703d-3eba-4978-aa3b-2439c08d24c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:41.627192 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-84e5703d-3eba-4978-aa3b-2439c08d24c9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:36:41.628387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-84e5703d-3eba-4978-aa3b-2439c08d24c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:41.706527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1229/2452] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:36:41.717530 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc81551-3bd8-415b-b998-b7ff9d21f863 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:41.717813 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc81551-3bd8-415b-b998-b7ff9d21f863 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:41.718075 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc81551-3bd8-415b-b998-b7ff9d21f863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:41.738439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-9cc81551-3bd8-415b-b998-b7ff9d21f863 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:36:41.739669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9cc81551-3bd8-415b-b998-b7ff9d21f863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:41.748257 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1224/2453] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:36:41.752756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5703d-3eba-4978-aa3b-2439c08d24c9 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:41.763346 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5703d-3eba-4978-aa3b-2439c08d24c9 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:41.769268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799fc84-ce49-4ca4-af81-49b19577f5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:41.769864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799fc84-ce49-4ca4-af81-49b19577f5cd admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:41.770133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799fc84-ce49-4ca4-af81-49b19577f5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:41.770390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799fc84-ce49-4ca4-af81-49b19577f5cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:41.771088 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799fc84-ce49-4ca4-af81-49b19577f5cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:36:41.771414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799fc84-ce49-4ca4-af81-49b19577f5cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:41.773077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799fc84-ce49-4ca4-af81-49b19577f5cd admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:41.785024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1230/2454] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:36:41.789689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc81551-3bd8-415b-b998-b7ff9d21f863 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:41.799865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc81551-3bd8-415b-b998-b7ff9d21f863 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:41.806769 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc12d6-9d0f-43c8-bb24-a1b5fe1cb187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:41.807641 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc12d6-9d0f-43c8-bb24-a1b5fe1cb187 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:41.807974 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc12d6-9d0f-43c8-bb24-a1b5fe1cb187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:41.808341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc12d6-9d0f-43c8-bb24-a1b5fe1cb187 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:41.809269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc12d6-9d0f-43c8-bb24-a1b5fe1cb187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:41.812281 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc12d6-9d0f-43c8-bb24-a1b5fe1cb187 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:41.855948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1225/2455] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:36:41 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:36:41.862393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799fc84-ce49-4ca4-af81-49b19577f5cd admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:41.877692 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799fc84-ce49-4ca4-af81-49b19577f5cd admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:41.938144 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34210d8e-7b48-4dfd-9fcd-7ac888533fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:41.938776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34210d8e-7b48-4dfd-9fcd-7ac888533fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:41.939086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34210d8e-7b48-4dfd-9fcd-7ac888533fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:41.939356 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34210d8e-7b48-4dfd-9fcd-7ac888533fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:41.939982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34210d8e-7b48-4dfd-9fcd-7ac888533fd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:41.941900 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34210d8e-7b48-4dfd-9fcd-7ac888533fd2 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:41.968540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1231/2456] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:36:41 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:36:41.974553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc12d6-9d0f-43c8-bb24-a1b5fe1cb187 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:41.985824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc12d6-9d0f-43c8-bb24-a1b5fe1cb187 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:41.991001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3fbe6-6309-44e1-aff8-55db65929a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:41.991664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3fbe6-6309-44e1-aff8-55db65929a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:41.991936 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3fbe6-6309-44e1-aff8-55db65929a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:41.992197 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3fbe6-6309-44e1-aff8-55db65929a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:41.992831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3fbe6-6309-44e1-aff8-55db65929a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:41.994491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3fbe6-6309-44e1-aff8-55db65929a7b admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:42.005312 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1226/2457] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:36:42.009846 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34210d8e-7b48-4dfd-9fcd-7ac888533fd2 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:42.020546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34210d8e-7b48-4dfd-9fcd-7ac888533fd2 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:42.026170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789fd03-cc36-4be5-9026-9d6af72958d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:42.026765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789fd03-cc36-4be5-9026-9d6af72958d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:42.027072 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789fd03-cc36-4be5-9026-9d6af72958d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:42.027337 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789fd03-cc36-4be5-9026-9d6af72958d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:42.027975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789fd03-cc36-4be5-9026-9d6af72958d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:42.029576 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789fd03-cc36-4be5-9026-9d6af72958d0 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:42.041998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1232/2458] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:36:42.046310 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3fbe6-6309-44e1-aff8-55db65929a7b admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:42.057034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3fbe6-6309-44e1-aff8-55db65929a7b admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:42.062570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fc145-4acf-46af-a537-3984abd2b623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:42.063259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fc145-4acf-46af-a537-3984abd2b623 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:42.063531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fc145-4acf-46af-a537-3984abd2b623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:42.063800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fc145-4acf-46af-a537-3984abd2b623 admin admin] PATH_INFO: `/v3/projects/8ed2980eafa94168af9b4bf61b1f8ff9/users/a67a964a727f4a35b3b57e3a7d8c09a1/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:42.079318 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fc145-4acf-46af-a537-3984abd2b623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed2980eafa94168af9b4bf61b1f8ff9, user_id=a67a964a727f4a35b3b57e3a7d8c09a1, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:42.082276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fc145-4acf-46af-a537-3984abd2b623 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:42.085424 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:42.100221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1227/2459] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:36:42 2022] PUT /identity/v3/projects/8ed2980eafa94168af9b4bf61b1f8ff9/users/a67a964a727f4a35b3b57e3a7d8c09a1/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:36:42.111039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ee69b-af5c-4621-9184-a0f63bc0b038 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:42.111565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ee69b-af5c-4621-9184-a0f63bc0b038 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:42.111666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ee69b-af5c-4621-9184-a0f63bc0b038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:42.146648 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-9c2ee69b-af5c-4621-9184-a0f63bc0b038 None None] MFA Rules not processed for user `a67a964a727f4a35b3b57e3a7d8c09a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:36:42.148342 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9c2ee69b-af5c-4621-9184-a0f63bc0b038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:42.173575 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:42.222265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1233/2460] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:36:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:36:42.227087 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fc145-4acf-46af-a537-3984abd2b623 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:42.295759 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fc145-4acf-46af-a537-3984abd2b623 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:42.301053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa8753-7a0b-4e4d-a9e9-3c976bc11c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:42.301668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8753-7a0b-4e4d-a9e9-3c976bc11c47 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:42.301942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8753-7a0b-4e4d-a9e9-3c976bc11c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:42.302380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8753-7a0b-4e4d-a9e9-3c976bc11c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:42.303004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa8753-7a0b-4e4d-a9e9-3c976bc11c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:42.304904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa8753-7a0b-4e4d-a9e9-3c976bc11c47 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:42.338455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1228/2461] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:36:42 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:36:42.339700 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ee69b-af5c-4621-9184-a0f63bc0b038 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:42.350482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ee69b-af5c-4621-9184-a0f63bc0b038 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:42.413341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9ce3b-5434-44b3-84ee-e12017b0a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:42.413954 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9ce3b-5434-44b3-84ee-e12017b0a257 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:42.414229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9ce3b-5434-44b3-84ee-e12017b0a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:42.414497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9ce3b-5434-44b3-84ee-e12017b0a257 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:42.415163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9ce3b-5434-44b3-84ee-e12017b0a257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:42.417114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9ce3b-5434-44b3-84ee-e12017b0a257 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:42.440419 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1234/2462] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:36:42 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:36:42.444305 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa8753-7a0b-4e4d-a9e9-3c976bc11c47 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:42.455824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa8753-7a0b-4e4d-a9e9-3c976bc11c47 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:42.461079 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca337b-69bb-4d50-8013-2a393c435e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:42.461703 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca337b-69bb-4d50-8013-2a393c435e5c admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:42.461976 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca337b-69bb-4d50-8013-2a393c435e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:42.462244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca337b-69bb-4d50-8013-2a393c435e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:42.462960 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca337b-69bb-4d50-8013-2a393c435e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:42.464574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca337b-69bb-4d50-8013-2a393c435e5c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:42.477014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1229/2463] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:36:42.481225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9ce3b-5434-44b3-84ee-e12017b0a257 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:42.491704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9ce3b-5434-44b3-84ee-e12017b0a257 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:42.497178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c3af8-815d-4d4d-9ce8-eeb5d0a8d5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:42.497898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c3af8-815d-4d4d-9ce8-eeb5d0a8d5c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:42.498181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c3af8-815d-4d4d-9ce8-eeb5d0a8d5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:42.498453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c3af8-815d-4d4d-9ce8-eeb5d0a8d5c5 admin admin] PATH_INFO: `/v3/projects/9f8a13f0c18c4934bb579d5172026442/users/757ee31fb21643f0aea38dfc5aa9424a/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:42.514927 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c3af8-815d-4d4d-9ce8-eeb5d0a8d5c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8a13f0c18c4934bb579d5172026442, user_id=757ee31fb21643f0aea38dfc5aa9424a, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:42.517635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c3af8-815d-4d4d-9ce8-eeb5d0a8d5c5 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:42.532591 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1235/2464] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:36:42 2022] PUT /identity/v3/projects/9f8a13f0c18c4934bb579d5172026442/users/757ee31fb21643f0aea38dfc5aa9424a/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:36:42.536728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca337b-69bb-4d50-8013-2a393c435e5c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:42.547228 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca337b-69bb-4d50-8013-2a393c435e5c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:42.603304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89724b-8eac-4814-acbb-4b047f976ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:42.603996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89724b-8eac-4814-acbb-4b047f976ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:42.604272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89724b-8eac-4814-acbb-4b047f976ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:42.604543 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89724b-8eac-4814-acbb-4b047f976ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:42.605176 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89724b-8eac-4814-acbb-4b047f976ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:42.606990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89724b-8eac-4814-acbb-4b047f976ae9 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:42.616757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1230/2465] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:36:42.622925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c3af8-815d-4d4d-9ce8-eeb5d0a8d5c5 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:42.634231 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c3af8-815d-4d4d-9ce8-eeb5d0a8d5c5 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:42.640053 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bb087-da04-4ab5-850d-4455f9ed74cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:42.640704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bb087-da04-4ab5-850d-4455f9ed74cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:42.640981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bb087-da04-4ab5-850d-4455f9ed74cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:42.641259 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bb087-da04-4ab5-850d-4455f9ed74cd admin admin] PATH_INFO: `/v3/projects/9f8a13f0c18c4934bb579d5172026442/users/757ee31fb21643f0aea38dfc5aa9424a/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:42.643396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bb087-da04-4ab5-850d-4455f9ed74cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8a13f0c18c4934bb579d5172026442, user_id=757ee31fb21643f0aea38dfc5aa9424a, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:42.646056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bb087-da04-4ab5-850d-4455f9ed74cd admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:42.657324 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1236/2466] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:36:42 2022] PUT /identity/v3/projects/9f8a13f0c18c4934bb579d5172026442/users/757ee31fb21643f0aea38dfc5aa9424a/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:36:42.675180 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605419d2-2f2a-4486-9685-a5665196ff1c None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:42.675526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605419d2-2f2a-4486-9685-a5665196ff1c None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:42.675847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605419d2-2f2a-4486-9685-a5665196ff1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:42.711663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-605419d2-2f2a-4486-9685-a5665196ff1c None None] MFA Rules not processed for user `757ee31fb21643f0aea38dfc5aa9424a`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:36:42.713578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-605419d2-2f2a-4486-9685-a5665196ff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:42.769808 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:42.789673 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1231/2467] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:36:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:36:42.801297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bb087-da04-4ab5-850d-4455f9ed74cd admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:42.803362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-4e5bb087-da04-4ab5-850d-4455f9ed74cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:42.889681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bb087-da04-4ab5-850d-4455f9ed74cd admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:42.893793 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0874563-abf0-4695-b2fe-71025105d444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:42.894398 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0874563-abf0-4695-b2fe-71025105d444 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:42.894672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0874563-abf0-4695-b2fe-71025105d444 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:42.894972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0874563-abf0-4695-b2fe-71025105d444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:42.904466 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0874563-abf0-4695-b2fe-71025105d444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:42.905933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0874563-abf0-4695-b2fe-71025105d444 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:42.909838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:42.917677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1237/2468] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:36:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:36:43.003596 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605419d2-2f2a-4486-9685-a5665196ff1c None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:43.015364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605419d2-2f2a-4486-9685-a5665196ff1c None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:43.021262 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c8b6d-2c8d-4cae-88e9-7a7b7bafb1a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:43.022211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c8b6d-2c8d-4cae-88e9-7a7b7bafb1a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:43.022680 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c8b6d-2c8d-4cae-88e9-7a7b7bafb1a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:43.023184 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c8b6d-2c8d-4cae-88e9-7a7b7bafb1a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:43.093600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c8b6d-2c8d-4cae-88e9-7a7b7bafb1a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:43.095912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c8b6d-2c8d-4cae-88e9-7a7b7bafb1a7 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:43.106475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1232/2469] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:36:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:36:45.847695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f68809-5f39-4c77-b28f-c959edf79dc6 None None] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:45.850236 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f68809-5f39-4c77-b28f-c959edf79dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:45.850844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f68809-5f39-4c77-b28f-c959edf79dc6 None None] PATH_INFO: `/` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:45.853257 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1238/2470] 10.222.0.59 () {54 vars in 921 bytes} [Tue Aug 9 11:36:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:36:45.859071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1d142-6470-465b-82de-5a7dbc0009da None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:45.859613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1d142-6470-465b-82de-5a7dbc0009da None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:45.859613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1d142-6470-465b-82de-5a7dbc0009da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:45.904395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-91d1d142-6470-465b-82de-5a7dbc0009da None None] MFA Rules not processed for user `2136cf1160a64951ad780424cb28403b`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:36:45.905337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-91d1d142-6470-465b-82de-5a7dbc0009da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:46.062382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1233/2471] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Aug 9 11:36:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:36:46.079433 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f68809-5f39-4c77-b28f-c959edf79dc6 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:46.081780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-60f68809-5f39-4c77-b28f-c959edf79dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:46.212919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f68809-5f39-4c77-b28f-c959edf79dc6 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:46.217049 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99617239-d3be-4758-9a3e-18d351658832 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7f8976306ff477592c6c5b62af60f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:46.217990 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99617239-d3be-4758-9a3e-18d351658832 service glance] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:46.218494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99617239-d3be-4758-9a3e-18d351658832 service glance] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:46.218987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99617239-d3be-4758-9a3e-18d351658832 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:46.232015 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99617239-d3be-4758-9a3e-18d351658832 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:46.233534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99617239-d3be-4758-9a3e-18d351658832 service glance] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:46.245276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1239/2472] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:36:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:36:52.656003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f797ee-e183-4476-bf67-bc8294b894e5 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:52.656525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f797ee-e183-4476-bf67-bc8294b894e5 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:52.656755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f797ee-e183-4476-bf67-bc8294b894e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:52.677847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-53f797ee-e183-4476-bf67-bc8294b894e5 None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:36:52.679303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-53f797ee-e183-4476-bf67-bc8294b894e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:52.737137 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1234/2473] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:36:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:36:52.751967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99617239-d3be-4758-9a3e-18d351658832 service glance] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:52.754291 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-99617239-d3be-4758-9a3e-18d351658832 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:52.824618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99617239-d3be-4758-9a3e-18d351658832 service glance] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:52.829477 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4155bd-5047-4640-92cd-6d62aec085cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:52.830129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4155bd-5047-4640-92cd-6d62aec085cd service swift] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:52.830655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4155bd-5047-4640-92cd-6d62aec085cd service swift] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:52.830946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4155bd-5047-4640-92cd-6d62aec085cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:52.839699 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4155bd-5047-4640-92cd-6d62aec085cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:52.841306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4155bd-5047-4640-92cd-6d62aec085cd service swift] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:52.849920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1240/2474] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:36:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 11:36:53.903261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f797ee-e183-4476-bf67-bc8294b894e5 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:53.905461 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-53f797ee-e183-4476-bf67-bc8294b894e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:53.921701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:53.971728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f797ee-e183-4476-bf67-bc8294b894e5 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:53.976080 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85859250-af48-4123-8334-c922a2119992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:53.976698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85859250-af48-4123-8334-c922a2119992 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:53.976969 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85859250-af48-4123-8334-c922a2119992 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:53.977230 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85859250-af48-4123-8334-c922a2119992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:53.979418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-85859250-af48-4123-8334-c922a2119992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:54.050630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85859250-af48-4123-8334-c922a2119992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:54.052020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85859250-af48-4123-8334-c922a2119992 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:54.062009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1235/2475] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:36:57.861150 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4155bd-5047-4640-92cd-6d62aec085cd service swift] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:57.862870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ac4155bd-5047-4640-92cd-6d62aec085cd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:57.899272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4155bd-5047-4640-92cd-6d62aec085cd service swift] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:57.911605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1909c3-ade8-42a5-952a-cd47e827635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:57.913820 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1909c3-ade8-42a5-952a-cd47e827635a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:57.914319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1909c3-ade8-42a5-952a-cd47e827635a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:57.914799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1909c3-ade8-42a5-952a-cd47e827635a admin admin] PATH_INFO: `/v3/users/0f80c1f4f2d04a9b80ab0c315dfe180d` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:57.917789 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1909c3-ade8-42a5-952a-cd47e827635a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f80c1f4f2d04a9b80ab0c315dfe180d)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:57.920500 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1909c3-ade8-42a5-952a-cd47e827635a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:58.042184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-7f1909c3-ade8-42a5-952a-cd47e827635a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f80c1f4f2d04a9b80ab0c315dfe180d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:58.072469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-7f1909c3-ade8-42a5-952a-cd47e827635a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f80c1f4f2d04a9b80ab0c315dfe180d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:58.075125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:58.093519 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-7f1909c3-ade8-42a5-952a-cd47e827635a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f80c1f4f2d04a9b80ab0c315dfe180d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:58.094277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-7f1909c3-ade8-42a5-952a-cd47e827635a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f80c1f4f2d04a9b80ab0c315dfe180d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:58.095340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-7f1909c3-ade8-42a5-952a-cd47e827635a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f80c1f4f2d04a9b80ab0c315dfe180d'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:58.120286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1241/2476] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:36:57 2022] DELETE /identity/v3/users/0f80c1f4f2d04a9b80ab0c315dfe180d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:36:58.460664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85859250-af48-4123-8334-c922a2119992 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:58.471888 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85859250-af48-4123-8334-c922a2119992 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:58.613884 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60e740-47ff-43a5-acb7-e1c6034509fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:58.614911 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60e740-47ff-43a5-acb7-e1c6034509fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:58.615340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60e740-47ff-43a5-acb7-e1c6034509fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:58.615807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60e740-47ff-43a5-acb7-e1c6034509fc admin admin] PATH_INFO: `/v3/projects/001b779aebf8445eba01022c8c9abe19` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:58.617166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60e740-47ff-43a5-acb7-e1c6034509fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=001b779aebf8445eba01022c8c9abe19)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:58.619595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60e740-47ff-43a5-acb7-e1c6034509fc admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:58.674574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-bd60e740-47ff-43a5-acb7-e1c6034509fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '001b779aebf8445eba01022c8c9abe19', 'request_id': 'req-bd60e740-47ff-43a5-acb7-e1c6034509fc'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:58.683757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-bd60e740-47ff-43a5-acb7-e1c6034509fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '001b779aebf8445eba01022c8c9abe19', 'request_id': 'req-bd60e740-47ff-43a5-acb7-e1c6034509fc'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:58.691078 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-bd60e740-47ff-43a5-acb7-e1c6034509fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '001b779aebf8445eba01022c8c9abe19', 'request_id': 'req-bd60e740-47ff-43a5-acb7-e1c6034509fc'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:58.692580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:58.709276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-bd60e740-47ff-43a5-acb7-e1c6034509fc admin admin] The token cache is being invalidate because project 001b779aebf8445eba01022c8c9abe19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:36:58.709703 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-bd60e740-47ff-43a5-acb7-e1c6034509fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:58.710539 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-bd60e740-47ff-43a5-acb7-e1c6034509fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:36:58.713004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1236/2477] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:36:58 2022] DELETE /identity/v3/projects/001b779aebf8445eba01022c8c9abe19 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:36:58.717797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca3c15-0074-4e3c-92ed-51249ad69eed None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:58.718082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca3c15-0074-4e3c-92ed-51249ad69eed None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:58.718411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca3c15-0074-4e3c-92ed-51249ad69eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:58.738516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f1ca3c15-0074-4e3c-92ed-51249ad69eed None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:36:58.739750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f1ca3c15-0074-4e3c-92ed-51249ad69eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:58.827007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c312b-0265-425c-9bbb-72192edc449f None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:58.827007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c312b-0265-425c-9bbb-72192edc449f None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:58.827007 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c312b-0265-425c-9bbb-72192edc449f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:58.830180 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1242/2478] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:36:58.848490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-9a9c312b-0265-425c-9bbb-72192edc449f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:36:58.849706 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9a9c312b-0265-425c-9bbb-72192edc449f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:58.865875 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca3c15-0074-4e3c-92ed-51249ad69eed None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:58.873018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1237/2479] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:36:58.877390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca3c15-0074-4e3c-92ed-51249ad69eed None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:58.882637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cf781-448b-446d-bbf6-628bbc35918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:58.883697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cf781-448b-446d-bbf6-628bbc35918d admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:58.884203 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cf781-448b-446d-bbf6-628bbc35918d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:58.884652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cf781-448b-446d-bbf6-628bbc35918d admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:58.885610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cf781-448b-446d-bbf6-628bbc35918d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:36:58.886098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cf781-448b-446d-bbf6-628bbc35918d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:58.887950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cf781-448b-446d-bbf6-628bbc35918d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:58.902914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1243/2480] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:36:58.908092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c312b-0265-425c-9bbb-72192edc449f None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:58.918425 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c312b-0265-425c-9bbb-72192edc449f None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:58.924436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49280d68-2399-4fd1-bdb5-80c861e592c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:58.925090 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49280d68-2399-4fd1-bdb5-80c861e592c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:58.925403 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49280d68-2399-4fd1-bdb5-80c861e592c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:58.925676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49280d68-2399-4fd1-bdb5-80c861e592c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:58.926323 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49280d68-2399-4fd1-bdb5-80c861e592c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:58.928382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49280d68-2399-4fd1-bdb5-80c861e592c5 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:58.970338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1238/2481] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:36:58 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:36:58.974610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cf781-448b-446d-bbf6-628bbc35918d admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:58.987455 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cf781-448b-446d-bbf6-628bbc35918d admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:59.067658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa08f55-060a-4c3e-b475-b00f25099603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:59.068284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa08f55-060a-4c3e-b475-b00f25099603 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:59.068562 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa08f55-060a-4c3e-b475-b00f25099603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:59.068843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa08f55-060a-4c3e-b475-b00f25099603 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:59.069551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa08f55-060a-4c3e-b475-b00f25099603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:59.071685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa08f55-060a-4c3e-b475-b00f25099603 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:59.103446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1244/2482] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:36:58 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:36:59.104940 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49280d68-2399-4fd1-bdb5-80c861e592c5 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:59.116878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49280d68-2399-4fd1-bdb5-80c861e592c5 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:59.122420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154ee31-d2be-4525-b851-5c81693f67f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:59.123091 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154ee31-d2be-4525-b851-5c81693f67f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:59.123360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154ee31-d2be-4525-b851-5c81693f67f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:59.123634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154ee31-d2be-4525-b851-5c81693f67f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:59.124323 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154ee31-d2be-4525-b851-5c81693f67f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:59.126198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154ee31-d2be-4525-b851-5c81693f67f1 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:59.142118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa08f55-060a-4c3e-b475-b00f25099603 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:59.148691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1239/2483] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:36:59.153797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa08f55-060a-4c3e-b475-b00f25099603 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:59.159204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154f741-b786-48ba-b39c-e87ae2afd6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:59.159934 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154f741-b786-48ba-b39c-e87ae2afd6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:59.160242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154f741-b786-48ba-b39c-e87ae2afd6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:59.160631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154f741-b786-48ba-b39c-e87ae2afd6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:59.161782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154f741-b786-48ba-b39c-e87ae2afd6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:59.163569 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154f741-b786-48ba-b39c-e87ae2afd6c0 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:59.197073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154ee31-d2be-4525-b851-5c81693f67f1 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:59.197577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1245/2484] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:36:59.209454 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154ee31-d2be-4525-b851-5c81693f67f1 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:59.228560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c5fda-5f63-49cc-9c12-a8a899241b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:59.229331 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5fda-5f63-49cc-9c12-a8a899241b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:59.229634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5fda-5f63-49cc-9c12-a8a899241b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:59.229886 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5fda-5f63-49cc-9c12-a8a899241b88 admin admin] PATH_INFO: `/v3/projects/449941b49778401197111b936f941fb9/users/dce6b3a235e94026bd833181dd06a059/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:59.266431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c5fda-5f63-49cc-9c12-a8a899241b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449941b49778401197111b936f941fb9, user_id=dce6b3a235e94026bd833181dd06a059, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:59.269564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c5fda-5f63-49cc-9c12-a8a899241b88 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:59.305493 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b1942-d705-4498-a152-89d3bbce7baa None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:59.305756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b1942-d705-4498-a152-89d3bbce7baa None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:59.306412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b1942-d705-4498-a152-89d3bbce7baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:59.309248 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1240/2485] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:36:59 2022] PUT /identity/v3/projects/449941b49778401197111b936f941fb9/users/dce6b3a235e94026bd833181dd06a059/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:36:59.375919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-434b1942-d705-4498-a152-89d3bbce7baa None None] MFA Rules not processed for user `dce6b3a235e94026bd833181dd06a059`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:36:59.377225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-434b1942-d705-4498-a152-89d3bbce7baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:59.435358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:59.484955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c5fda-5f63-49cc-9c12-a8a899241b88 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:59.485522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1246/2486] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:36:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:36:59.585973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c5fda-5f63-49cc-9c12-a8a899241b88 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:59.591227 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc61ab6-01a6-4395-959a-2a2c9b79f9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:59.592252 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61ab6-01a6-4395-959a-2a2c9b79f9ca admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:59.592712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61ab6-01a6-4395-959a-2a2c9b79f9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:59.593131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61ab6-01a6-4395-959a-2a2c9b79f9ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:59.593924 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc61ab6-01a6-4395-959a-2a2c9b79f9ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:59.596035 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc61ab6-01a6-4395-959a-2a2c9b79f9ca admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:59.628313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1241/2487] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:36:59 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:36:59.632610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b1942-d705-4498-a152-89d3bbce7baa None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:59.643461 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b1942-d705-4498-a152-89d3bbce7baa None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:59.709264 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d9bba-bb09-43a3-b37c-fce2d2bc954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:59.709984 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d9bba-bb09-43a3-b37c-fce2d2bc954b admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:59.710253 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d9bba-bb09-43a3-b37c-fce2d2bc954b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:59.710535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d9bba-bb09-43a3-b37c-fce2d2bc954b admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:59.711199 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d9bba-bb09-43a3-b37c-fce2d2bc954b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:59.713332 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d9bba-bb09-43a3-b37c-fce2d2bc954b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:59.738092 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1247/2488] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:36:59 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:36:59.742288 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc61ab6-01a6-4395-959a-2a2c9b79f9ca admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:59.753687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc61ab6-01a6-4395-959a-2a2c9b79f9ca admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:59.758771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25e030-dea8-4bb6-8c26-6a07f18f2dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:59.759426 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25e030-dea8-4bb6-8c26-6a07f18f2dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:59.759708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25e030-dea8-4bb6-8c26-6a07f18f2dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:59.759958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25e030-dea8-4bb6-8c26-6a07f18f2dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:59.760605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25e030-dea8-4bb6-8c26-6a07f18f2dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:59.762287 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25e030-dea8-4bb6-8c26-6a07f18f2dc0 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:59.778862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1242/2489] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:36:59.785967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d9bba-bb09-43a3-b37c-fce2d2bc954b admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:59.796785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d9bba-bb09-43a3-b37c-fce2d2bc954b admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:59.801749 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b4e0c-8914-4943-a8a3-454bc5f64a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:59.802566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b4e0c-8914-4943-a8a3-454bc5f64a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:59.802870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b4e0c-8914-4943-a8a3-454bc5f64a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:59.803293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b4e0c-8914-4943-a8a3-454bc5f64a08 admin admin] PATH_INFO: `/v3/projects/b1edc722d72c4ce2a98c380ebf4895bd/users/77d8541594fc4446a91c2c2ab65f0b1c/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:59.825200 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b4e0c-8914-4943-a8a3-454bc5f64a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1edc722d72c4ce2a98c380ebf4895bd, user_id=77d8541594fc4446a91c2c2ab65f0b1c, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:59.827966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b4e0c-8914-4943-a8a3-454bc5f64a08 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:59.846358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1248/2490] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:36:59 2022] PUT /identity/v3/projects/b1edc722d72c4ce2a98c380ebf4895bd/users/77d8541594fc4446a91c2c2ab65f0b1c/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:36:59.850515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25e030-dea8-4bb6-8c26-6a07f18f2dc0 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:59.860834 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25e030-dea8-4bb6-8c26-6a07f18f2dc0 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:59.937865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bead87c-9bf3-4654-85b0-0b1b0cd28426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:59.952291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bead87c-9bf3-4654-85b0-0b1b0cd28426 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:59.952291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bead87c-9bf3-4654-85b0-0b1b0cd28426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:59.952291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bead87c-9bf3-4654-85b0-0b1b0cd28426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:59.952291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bead87c-9bf3-4654-85b0-0b1b0cd28426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:59.952291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bead87c-9bf3-4654-85b0-0b1b0cd28426 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:59.952291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:59.953973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1243/2491] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:36:59.956488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b4e0c-8914-4943-a8a3-454bc5f64a08 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:59.967885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b4e0c-8914-4943-a8a3-454bc5f64a08 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:59.990319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f0939-185d-4f22-a71f-2e8310e4d674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:59.991417 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f0939-185d-4f22-a71f-2e8310e4d674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:59.991840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f0939-185d-4f22-a71f-2e8310e4d674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:59.992114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f0939-185d-4f22-a71f-2e8310e4d674 admin admin] PATH_INFO: `/v3/projects/b1edc722d72c4ce2a98c380ebf4895bd/users/77d8541594fc4446a91c2c2ab65f0b1c/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:59.996688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f0939-185d-4f22-a71f-2e8310e4d674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1edc722d72c4ce2a98c380ebf4895bd, user_id=77d8541594fc4446a91c2c2ab65f0b1c, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:59.999478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f0939-185d-4f22-a71f-2e8310e4d674 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:00.012510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1249/2492] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:36:59 2022] PUT /identity/v3/projects/b1edc722d72c4ce2a98c380ebf4895bd/users/77d8541594fc4446a91c2c2ab65f0b1c/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:00.025037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab8b09-6ec0-49af-8040-567f9ab80448 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:00.025313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab8b09-6ec0-49af-8040-567f9ab80448 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:00.025585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab8b09-6ec0-49af-8040-567f9ab80448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:00.067966 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-8bab8b09-6ec0-49af-8040-567f9ab80448 None None] MFA Rules not processed for user `77d8541594fc4446a91c2c2ab65f0b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:00.069564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-8bab8b09-6ec0-49af-8040-567f9ab80448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:00.147397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1244/2493] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:00.159792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f0939-185d-4f22-a71f-2e8310e4d674 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:00.161655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ac8f0939-185d-4f22-a71f-2e8310e4d674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:00.230382 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f0939-185d-4f22-a71f-2e8310e4d674 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:00.234326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67034d9b-ac27-4b4a-bb25-0ad5fb37bac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:00.234978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67034d9b-ac27-4b4a-bb25-0ad5fb37bac8 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:00.235254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67034d9b-ac27-4b4a-bb25-0ad5fb37bac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:00.235523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67034d9b-ac27-4b4a-bb25-0ad5fb37bac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:00.246251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67034d9b-ac27-4b4a-bb25-0ad5fb37bac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:00.248354 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67034d9b-ac27-4b4a-bb25-0ad5fb37bac8 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:00.270202 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1250/2494] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:00.497347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab8b09-6ec0-49af-8040-567f9ab80448 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:00.519692 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab8b09-6ec0-49af-8040-567f9ab80448 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:00.523706 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8904194-9ed7-432a-a2ed-b906d7496a86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:00.524336 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8904194-9ed7-432a-a2ed-b906d7496a86 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:00.524610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8904194-9ed7-432a-a2ed-b906d7496a86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:00.524878 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8904194-9ed7-432a-a2ed-b906d7496a86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:00.607700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8904194-9ed7-432a-a2ed-b906d7496a86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:00.609175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8904194-9ed7-432a-a2ed-b906d7496a86 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:00.629994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1245/2495] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:08.840514 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67034d9b-ac27-4b4a-bb25-0ad5fb37bac8 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:08.842100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-67034d9b-ac27-4b4a-bb25-0ad5fb37bac8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:08.890006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:08.948270 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67034d9b-ac27-4b4a-bb25-0ad5fb37bac8 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:08.959483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1dfee-c4b1-402e-a7cf-9d37f720ea8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:08.960201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1dfee-c4b1-402e-a7cf-9d37f720ea8e service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:08.960541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1dfee-c4b1-402e-a7cf-9d37f720ea8e service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:08.960828 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1dfee-c4b1-402e-a7cf-9d37f720ea8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:08.963179 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c2f1dfee-c4b1-402e-a7cf-9d37f720ea8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:08.993547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1dfee-c4b1-402e-a7cf-9d37f720ea8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:08.996425 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1dfee-c4b1-402e-a7cf-9d37f720ea8e service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:09.014226 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1251/2496] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:10.618870 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=62 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:18.333912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8904194-9ed7-432a-a2ed-b906d7496a86 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:18.420774 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8904194-9ed7-432a-a2ed-b906d7496a86 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:18.425710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058cca2-76d2-401e-aa62-280ec740b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:18.426505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058cca2-76d2-401e-aa62-280ec740b157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:18.428859 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058cca2-76d2-401e-aa62-280ec740b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:18.428859 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058cca2-76d2-401e-aa62-280ec740b157 admin admin] PATH_INFO: `/v3/users/dce6b3a235e94026bd833181dd06a059` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:18.428859 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058cca2-76d2-401e-aa62-280ec740b157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce6b3a235e94026bd833181dd06a059)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:18.431034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058cca2-76d2-401e-aa62-280ec740b157 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:18.505275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4058cca2-76d2-401e-aa62-280ec740b157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce6b3a235e94026bd833181dd06a059'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:18.515434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4058cca2-76d2-401e-aa62-280ec740b157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce6b3a235e94026bd833181dd06a059'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:18.516771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4058cca2-76d2-401e-aa62-280ec740b157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce6b3a235e94026bd833181dd06a059'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:18.517396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4058cca2-76d2-401e-aa62-280ec740b157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce6b3a235e94026bd833181dd06a059'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:18.530627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-4058cca2-76d2-401e-aa62-280ec740b157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce6b3a235e94026bd833181dd06a059'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:18.544567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1246/2497] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:18 2022] DELETE /identity/v3/users/dce6b3a235e94026bd833181dd06a059 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:18.548768 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817427f-d6d9-45cc-b5c4-63b07a8d650f None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:18.549257 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817427f-d6d9-45cc-b5c4-63b07a8d650f None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:18.549361 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817427f-d6d9-45cc-b5c4-63b07a8d650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:18.568459 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-d817427f-d6d9-45cc-b5c4-63b07a8d650f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:18.569669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d817427f-d6d9-45cc-b5c4-63b07a8d650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:18.637309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1252/2498] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:18.647475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058cca2-76d2-401e-aa62-280ec740b157 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:18.649121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4058cca2-76d2-401e-aa62-280ec740b157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:18.724945 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058cca2-76d2-401e-aa62-280ec740b157 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:18.729436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a123c-fcc2-4771-89d6-93f58bfd92f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:18.730149 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a123c-fcc2-4771-89d6-93f58bfd92f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:18.730431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a123c-fcc2-4771-89d6-93f58bfd92f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:18.730720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a123c-fcc2-4771-89d6-93f58bfd92f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:18.742606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a123c-fcc2-4771-89d6-93f58bfd92f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:18.744245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a123c-fcc2-4771-89d6-93f58bfd92f3 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:18.755961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1247/2499] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:19.069650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817427f-d6d9-45cc-b5c4-63b07a8d650f None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:19.072765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d817427f-d6d9-45cc-b5c4-63b07a8d650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:19.102490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817427f-d6d9-45cc-b5c4-63b07a8d650f None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:19.108211 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:19.108957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:19.109331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:19.109697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] PATH_INFO: `/v3/projects/449941b49778401197111b936f941fb9` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:19.110937 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=449941b49778401197111b936f941fb9)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:19.114486 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:19.165063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449941b49778401197111b936f941fb9', 'request_id': 'req-591a7c0a-34bc-429a-9143-784c9c264e4e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.172844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449941b49778401197111b936f941fb9', 'request_id': 'req-591a7c0a-34bc-429a-9143-784c9c264e4e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.184255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449941b49778401197111b936f941fb9', 'request_id': 'req-591a7c0a-34bc-429a-9143-784c9c264e4e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.196788 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] The token cache is being invalidate because project 449941b49778401197111b936f941fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:19.197166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.198612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.201060 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1253/2500] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:19 2022] DELETE /identity/v3/projects/449941b49778401197111b936f941fb9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:19.206665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a123c-fcc2-4771-89d6-93f58bfd92f3 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:19.217201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a123c-fcc2-4771-89d6-93f58bfd92f3 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:19.237307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:19.280944 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5418912-bb46-4b7a-8c04-f6c6bbebd777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:19.281656 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5418912-bb46-4b7a-8c04-f6c6bbebd777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:19.282058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5418912-bb46-4b7a-8c04-f6c6bbebd777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:19.282359 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5418912-bb46-4b7a-8c04-f6c6bbebd777 admin admin] PATH_INFO: `/v3/users/77d8541594fc4446a91c2c2ab65f0b1c` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:19.283590 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5418912-bb46-4b7a-8c04-f6c6bbebd777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d8541594fc4446a91c2c2ab65f0b1c)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:19.285588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5418912-bb46-4b7a-8c04-f6c6bbebd777 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:19.342504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e5418912-bb46-4b7a-8c04-f6c6bbebd777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d8541594fc4446a91c2c2ab65f0b1c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.350632 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e5418912-bb46-4b7a-8c04-f6c6bbebd777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d8541594fc4446a91c2c2ab65f0b1c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.351293 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e5418912-bb46-4b7a-8c04-f6c6bbebd777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d8541594fc4446a91c2c2ab65f0b1c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.351905 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e5418912-bb46-4b7a-8c04-f6c6bbebd777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d8541594fc4446a91c2c2ab65f0b1c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.363898 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e5418912-bb46-4b7a-8c04-f6c6bbebd777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d8541594fc4446a91c2c2ab65f0b1c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.375653 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1248/2501] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:19 2022] DELETE /identity/v3/users/77d8541594fc4446a91c2c2ab65f0b1c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:37:19.666970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:19.668606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:19.682674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a7c0a-34bc-429a-9143-784c9c264e4e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:19.768173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:19.808237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942783b3-fd28-4cd5-947b-850e56d30d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:19.809401 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942783b3-fd28-4cd5-947b-850e56d30d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:19.809756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942783b3-fd28-4cd5-947b-850e56d30d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:19.810094 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942783b3-fd28-4cd5-947b-850e56d30d96 admin admin] PATH_INFO: `/v3/projects/b1edc722d72c4ce2a98c380ebf4895bd` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:19.811569 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942783b3-fd28-4cd5-947b-850e56d30d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1edc722d72c4ce2a98c380ebf4895bd)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:19.813738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942783b3-fd28-4cd5-947b-850e56d30d96 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:19.885000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-942783b3-fd28-4cd5-947b-850e56d30d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1edc722d72c4ce2a98c380ebf4895bd', 'request_id': 'req-942783b3-fd28-4cd5-947b-850e56d30d96'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.892814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-942783b3-fd28-4cd5-947b-850e56d30d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1edc722d72c4ce2a98c380ebf4895bd', 'request_id': 'req-942783b3-fd28-4cd5-947b-850e56d30d96'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.903744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-942783b3-fd28-4cd5-947b-850e56d30d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1edc722d72c4ce2a98c380ebf4895bd', 'request_id': 'req-942783b3-fd28-4cd5-947b-850e56d30d96'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.920158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-942783b3-fd28-4cd5-947b-850e56d30d96 admin admin] The token cache is being invalidate because project b1edc722d72c4ce2a98c380ebf4895bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:19.920467 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-942783b3-fd28-4cd5-947b-850e56d30d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.921190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-942783b3-fd28-4cd5-947b-850e56d30d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:19.923675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1254/2502] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:19 2022] DELETE /identity/v3/projects/b1edc722d72c4ce2a98c380ebf4895bd => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:19.928494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f45585-44e0-4338-ade7-03b0d3d54a07 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:19.928781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f45585-44e0-4338-ade7-03b0d3d54a07 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:19.929059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f45585-44e0-4338-ade7-03b0d3d54a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:19.952819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-43f45585-44e0-4338-ade7-03b0d3d54a07 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:19.954344 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-43f45585-44e0-4338-ade7-03b0d3d54a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:20.047391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1249/2503] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:20.055849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04811a1-7778-4ce2-9779-b7cdb9b0355d None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:20.056324 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04811a1-7778-4ce2-9779-b7cdb9b0355d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:20.056465 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04811a1-7778-4ce2-9779-b7cdb9b0355d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:20.090026 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a04811a1-7778-4ce2-9779-b7cdb9b0355d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:20.091636 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a04811a1-7778-4ce2-9779-b7cdb9b0355d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:20.111254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1255/2504] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:20.115864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f45585-44e0-4338-ade7-03b0d3d54a07 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:20.127251 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f45585-44e0-4338-ade7-03b0d3d54a07 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:20.135585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece9c24-551c-44d4-a2b6-f4fd9a891d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:20.136211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9c24-551c-44d4-a2b6-f4fd9a891d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:20.136606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9c24-551c-44d4-a2b6-f4fd9a891d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:20.136880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9c24-551c-44d4-a2b6-f4fd9a891d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:20.138460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece9c24-551c-44d4-a2b6-f4fd9a891d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:37:20.142080 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece9c24-551c-44d4-a2b6-f4fd9a891d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:20.143968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece9c24-551c-44d4-a2b6-f4fd9a891d9a admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:20.161356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1250/2505] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:37:20.166049 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04811a1-7778-4ce2-9779-b7cdb9b0355d None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:20.177754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04811a1-7778-4ce2-9779-b7cdb9b0355d None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:20.182545 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271dab3-d6ca-4e17-85e1-9aee63a4ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:20.183268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271dab3-d6ca-4e17-85e1-9aee63a4ce05 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:20.183512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271dab3-d6ca-4e17-85e1-9aee63a4ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:20.183782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271dab3-d6ca-4e17-85e1-9aee63a4ce05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:20.184422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271dab3-d6ca-4e17-85e1-9aee63a4ce05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:20.186344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271dab3-d6ca-4e17-85e1-9aee63a4ce05 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:20.230540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1256/2506] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:20 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:37:20.231821 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece9c24-551c-44d4-a2b6-f4fd9a891d9a admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:20.242215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece9c24-551c-44d4-a2b6-f4fd9a891d9a admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:20.274862 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:20.308349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15189acb-630b-410f-8017-b4ccc0b3a115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:20.308980 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189acb-630b-410f-8017-b4ccc0b3a115 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:20.309259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189acb-630b-410f-8017-b4ccc0b3a115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:20.309526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189acb-630b-410f-8017-b4ccc0b3a115 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:20.310148 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15189acb-630b-410f-8017-b4ccc0b3a115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:20.312077 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15189acb-630b-410f-8017-b4ccc0b3a115 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:20.346250 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1251/2507] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:20 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:37:20.350530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271dab3-d6ca-4e17-85e1-9aee63a4ce05 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:20.365127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271dab3-d6ca-4e17-85e1-9aee63a4ce05 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:20.374450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d1298-accf-46a5-ab98-63a9c18d9046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:20.375272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d1298-accf-46a5-ab98-63a9c18d9046 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:20.375668 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d1298-accf-46a5-ab98-63a9c18d9046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:20.376037 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d1298-accf-46a5-ab98-63a9c18d9046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:20.376949 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d1298-accf-46a5-ab98-63a9c18d9046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:20.379497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d1298-accf-46a5-ab98-63a9c18d9046 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:20.399433 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1257/2508] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:20.403232 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15189acb-630b-410f-8017-b4ccc0b3a115 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:20.428414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15189acb-630b-410f-8017-b4ccc0b3a115 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:20.433302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ce753-6a09-4845-b41b-c8976743d48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:20.433998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ce753-6a09-4845-b41b-c8976743d48d admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:20.434276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ce753-6a09-4845-b41b-c8976743d48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:20.434547 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ce753-6a09-4845-b41b-c8976743d48d admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:20.435241 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ce753-6a09-4845-b41b-c8976743d48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:20.436843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ce753-6a09-4845-b41b-c8976743d48d admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:20.447880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1252/2509] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:20.451969 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d1298-accf-46a5-ab98-63a9c18d9046 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:20.462430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d1298-accf-46a5-ab98-63a9c18d9046 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:20.468582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898ad0c-2d28-45a0-bb47-716f0a40ebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:20.469383 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898ad0c-2d28-45a0-bb47-716f0a40ebaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:20.469879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898ad0c-2d28-45a0-bb47-716f0a40ebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:20.470237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898ad0c-2d28-45a0-bb47-716f0a40ebaa admin admin] PATH_INFO: `/v3/projects/698c515a0f434cc097620e28c2b216c6/users/3c966185e3574af3ae925c386fa41f64/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:20.495654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898ad0c-2d28-45a0-bb47-716f0a40ebaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=698c515a0f434cc097620e28c2b216c6, user_id=3c966185e3574af3ae925c386fa41f64, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:20.499133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898ad0c-2d28-45a0-bb47-716f0a40ebaa admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:20.513770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1258/2510] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:20 2022] PUT /identity/v3/projects/698c515a0f434cc097620e28c2b216c6/users/3c966185e3574af3ae925c386fa41f64/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:20.524475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51382cdc-7756-4fea-a26b-344d29fe5d9b None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:20.524820 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51382cdc-7756-4fea-a26b-344d29fe5d9b None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:20.525084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51382cdc-7756-4fea-a26b-344d29fe5d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:20.556549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-51382cdc-7756-4fea-a26b-344d29fe5d9b None None] MFA Rules not processed for user `3c966185e3574af3ae925c386fa41f64`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:20.558180 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-51382cdc-7756-4fea-a26b-344d29fe5d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:20.639894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1253/2511] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:20.645814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898ad0c-2d28-45a0-bb47-716f0a40ebaa admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:20.712662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898ad0c-2d28-45a0-bb47-716f0a40ebaa admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:20.717495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37748ad9-c7cc-4e7e-b1e4-3778c6c49836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:20.718142 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37748ad9-c7cc-4e7e-b1e4-3778c6c49836 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:20.718415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37748ad9-c7cc-4e7e-b1e4-3778c6c49836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:20.718678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37748ad9-c7cc-4e7e-b1e4-3778c6c49836 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:20.719343 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37748ad9-c7cc-4e7e-b1e4-3778c6c49836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:20.721278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37748ad9-c7cc-4e7e-b1e4-3778c6c49836 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:20.735221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:20.749982 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1259/2512] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:20 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:20.754195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51382cdc-7756-4fea-a26b-344d29fe5d9b None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:20.765831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51382cdc-7756-4fea-a26b-344d29fe5d9b None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:20.823237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb667e4-150b-41f6-9788-5916f98e1169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:20.824251 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb667e4-150b-41f6-9788-5916f98e1169 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:20.824677 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb667e4-150b-41f6-9788-5916f98e1169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:20.824957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb667e4-150b-41f6-9788-5916f98e1169 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:20.825600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb667e4-150b-41f6-9788-5916f98e1169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:20.827684 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb667e4-150b-41f6-9788-5916f98e1169 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:20.853849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1254/2513] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:20 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:20.855412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37748ad9-c7cc-4e7e-b1e4-3778c6c49836 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:20.866301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37748ad9-c7cc-4e7e-b1e4-3778c6c49836 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:20.871618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a7d61-e3f4-4809-86c5-52b627442e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:20.872209 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a7d61-e3f4-4809-86c5-52b627442e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:20.872541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a7d61-e3f4-4809-86c5-52b627442e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:20.872860 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a7d61-e3f4-4809-86c5-52b627442e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:20.873510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a7d61-e3f4-4809-86c5-52b627442e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:20.875217 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a7d61-e3f4-4809-86c5-52b627442e76 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:20.885939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1260/2514] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:20.890578 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb667e4-150b-41f6-9788-5916f98e1169 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:20.901722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb667e4-150b-41f6-9788-5916f98e1169 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:20.907809 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f085def-45eb-4ad3-b4bb-1cd16e60be31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:20.908560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f085def-45eb-4ad3-b4bb-1cd16e60be31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:20.908735 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f085def-45eb-4ad3-b4bb-1cd16e60be31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:20.908998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f085def-45eb-4ad3-b4bb-1cd16e60be31 admin admin] PATH_INFO: `/v3/projects/bfe0cca4a16d4bcbb49aae0598242f37/users/17356938f2134701b23d1121c1a5eeca/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:20.925238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f085def-45eb-4ad3-b4bb-1cd16e60be31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe0cca4a16d4bcbb49aae0598242f37, user_id=17356938f2134701b23d1121c1a5eeca, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:20.928591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f085def-45eb-4ad3-b4bb-1cd16e60be31 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:20.943533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1255/2515] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:20 2022] PUT /identity/v3/projects/bfe0cca4a16d4bcbb49aae0598242f37/users/17356938f2134701b23d1121c1a5eeca/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:20.947709 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a7d61-e3f4-4809-86c5-52b627442e76 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:20.958496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a7d61-e3f4-4809-86c5-52b627442e76 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:21.020653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e0e6e-4a79-41e4-a425-226952238404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:21.021320 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e0e6e-4a79-41e4-a425-226952238404 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:21.021592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e0e6e-4a79-41e4-a425-226952238404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:21.021856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e0e6e-4a79-41e4-a425-226952238404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:21.022502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e0e6e-4a79-41e4-a425-226952238404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:21.024181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e0e6e-4a79-41e4-a425-226952238404 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:21.034919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1261/2516] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:21.039281 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f085def-45eb-4ad3-b4bb-1cd16e60be31 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:21.045086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:21.050688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f085def-45eb-4ad3-b4bb-1cd16e60be31 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:21.057842 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6df4d-4a28-4e65-9912-c095a9b1b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:21.058556 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6df4d-4a28-4e65-9912-c095a9b1b2a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:21.058841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6df4d-4a28-4e65-9912-c095a9b1b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:21.059278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6df4d-4a28-4e65-9912-c095a9b1b2a4 admin admin] PATH_INFO: `/v3/projects/bfe0cca4a16d4bcbb49aae0598242f37/users/17356938f2134701b23d1121c1a5eeca/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:21.061205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6df4d-4a28-4e65-9912-c095a9b1b2a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe0cca4a16d4bcbb49aae0598242f37, user_id=17356938f2134701b23d1121c1a5eeca, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:21.063946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6df4d-4a28-4e65-9912-c095a9b1b2a4 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:21.075191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1256/2517] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:21 2022] PUT /identity/v3/projects/bfe0cca4a16d4bcbb49aae0598242f37/users/17356938f2134701b23d1121c1a5eeca/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:21.087366 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54781a-c0fa-499f-81b3-39abbc9715ed None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:21.087641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54781a-c0fa-499f-81b3-39abbc9715ed None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:21.087900 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54781a-c0fa-499f-81b3-39abbc9715ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:21.117781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-2c54781a-c0fa-499f-81b3-39abbc9715ed None None] MFA Rules not processed for user `17356938f2134701b23d1121c1a5eeca`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:21.118803 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-2c54781a-c0fa-499f-81b3-39abbc9715ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:21.194743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1262/2518] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:37:21.207361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6df4d-4a28-4e65-9912-c095a9b1b2a4 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:21.208721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-09d6df4d-4a28-4e65-9912-c095a9b1b2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:21.271869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6df4d-4a28-4e65-9912-c095a9b1b2a4 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:21.275729 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7029432-b90d-456c-a7ce-b84b1bc53447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:21.276335 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7029432-b90d-456c-a7ce-b84b1bc53447 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:21.276608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7029432-b90d-456c-a7ce-b84b1bc53447 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:21.277035 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7029432-b90d-456c-a7ce-b84b1bc53447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:21.286105 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7029432-b90d-456c-a7ce-b84b1bc53447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:21.287616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7029432-b90d-456c-a7ce-b84b1bc53447 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:21.301192 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1257/2519] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:21.368775 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54781a-c0fa-499f-81b3-39abbc9715ed None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:21.436989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54781a-c0fa-499f-81b3-39abbc9715ed None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:21.442322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7087d62-1862-4077-9f61-a553cb523ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:21.443078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7087d62-1862-4077-9f61-a553cb523ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:21.443459 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7087d62-1862-4077-9f61-a553cb523ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:21.443798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7087d62-1862-4077-9f61-a553cb523ef1 admin admin] PATH_INFO: `/v3/users/3c966185e3574af3ae925c386fa41f64` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:21.445125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7087d62-1862-4077-9f61-a553cb523ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c966185e3574af3ae925c386fa41f64)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:21.447250 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7087d62-1862-4077-9f61-a553cb523ef1 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:21.453658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:21.512153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-f7087d62-1862-4077-9f61-a553cb523ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c966185e3574af3ae925c386fa41f64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:21.531468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-f7087d62-1862-4077-9f61-a553cb523ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c966185e3574af3ae925c386fa41f64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:21.543065 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-f7087d62-1862-4077-9f61-a553cb523ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c966185e3574af3ae925c386fa41f64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:21.544098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-f7087d62-1862-4077-9f61-a553cb523ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c966185e3574af3ae925c386fa41f64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:21.545170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-f7087d62-1862-4077-9f61-a553cb523ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c966185e3574af3ae925c386fa41f64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:21.561541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1263/2520] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:21 2022] DELETE /identity/v3/users/3c966185e3574af3ae925c386fa41f64 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:21.566419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc8cf2-e952-4e6b-9934-0f64578bec4e None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:21.567004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc8cf2-e952-4e6b-9934-0f64578bec4e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:21.567184 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc8cf2-e952-4e6b-9934-0f64578bec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:21.590394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-b5fc8cf2-e952-4e6b-9934-0f64578bec4e None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:21.591758 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b5fc8cf2-e952-4e6b-9934-0f64578bec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:21.670946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1258/2521] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:21.679795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7087d62-1862-4077-9f61-a553cb523ef1 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:21.681365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f7087d62-1862-4077-9f61-a553cb523ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:21.750924 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc8cf2-e952-4e6b-9934-0f64578bec4e None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:21.752363 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b5fc8cf2-e952-4e6b-9934-0f64578bec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:21.772386 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7087d62-1862-4077-9f61-a553cb523ef1 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:21.777564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3c6e8-7fdb-4d1f-b8f8-ec2819a31604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:21.778216 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3c6e8-7fdb-4d1f-b8f8-ec2819a31604 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:21.778511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3c6e8-7fdb-4d1f-b8f8-ec2819a31604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:21.778721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3c6e8-7fdb-4d1f-b8f8-ec2819a31604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:21.789027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3c6e8-7fdb-4d1f-b8f8-ec2819a31604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:21.790474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3c6e8-7fdb-4d1f-b8f8-ec2819a31604 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:21.800313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1264/2522] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:21.813097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc8cf2-e952-4e6b-9934-0f64578bec4e None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:21.816765 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27845408-296e-4b63-a4c6-50a335c1d978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:21.817376 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27845408-296e-4b63-a4c6-50a335c1d978 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:21.817655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27845408-296e-4b63-a4c6-50a335c1d978 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:21.817928 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27845408-296e-4b63-a4c6-50a335c1d978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:21.819870 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-27845408-296e-4b63-a4c6-50a335c1d978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:21.832489 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27845408-296e-4b63-a4c6-50a335c1d978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:21.833949 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27845408-296e-4b63-a4c6-50a335c1d978 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:21.844486 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1259/2523] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:37:22.241030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3c6e8-7fdb-4d1f-b8f8-ec2819a31604 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:22.242681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0bc3c6e8-7fdb-4d1f-b8f8-ec2819a31604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:22.267690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3c6e8-7fdb-4d1f-b8f8-ec2819a31604 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:22.274098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:22.274740 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:22.275052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:22.275319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] PATH_INFO: `/v3/projects/698c515a0f434cc097620e28c2b216c6` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:22.276561 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698c515a0f434cc097620e28c2b216c6)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:22.278629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:22.327938 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698c515a0f434cc097620e28c2b216c6', 'request_id': 'req-93a96f57-c62e-438f-b020-50ad2bf7b632'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:22.334531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698c515a0f434cc097620e28c2b216c6', 'request_id': 'req-93a96f57-c62e-438f-b020-50ad2bf7b632'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:22.343868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698c515a0f434cc097620e28c2b216c6', 'request_id': 'req-93a96f57-c62e-438f-b020-50ad2bf7b632'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:22.354898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] The token cache is being invalidate because project 698c515a0f434cc097620e28c2b216c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:22.355251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:22.355935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:22.357439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1265/2524] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:22 2022] DELETE /identity/v3/projects/698c515a0f434cc097620e28c2b216c6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:22.361585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27845408-296e-4b63-a4c6-50a335c1d978 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:22.372116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27845408-296e-4b63-a4c6-50a335c1d978 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:22.408769 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:22.435222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ae53a-9aa9-47e3-a5de-b2c157f534aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:22.435843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ae53a-9aa9-47e3-a5de-b2c157f534aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:22.436114 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ae53a-9aa9-47e3-a5de-b2c157f534aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:22.436380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ae53a-9aa9-47e3-a5de-b2c157f534aa admin admin] PATH_INFO: `/v3/users/17356938f2134701b23d1121c1a5eeca` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:22.437491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ae53a-9aa9-47e3-a5de-b2c157f534aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=17356938f2134701b23d1121c1a5eeca)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:22.439488 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ae53a-9aa9-47e3-a5de-b2c157f534aa admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:22.495163 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-987ae53a-9aa9-47e3-a5de-b2c157f534aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17356938f2134701b23d1121c1a5eeca'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:22.503357 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-987ae53a-9aa9-47e3-a5de-b2c157f534aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17356938f2134701b23d1121c1a5eeca'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:22.503983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-987ae53a-9aa9-47e3-a5de-b2c157f534aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17356938f2134701b23d1121c1a5eeca'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:22.504597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-987ae53a-9aa9-47e3-a5de-b2c157f534aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17356938f2134701b23d1121c1a5eeca'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:22.517941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-987ae53a-9aa9-47e3-a5de-b2c157f534aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17356938f2134701b23d1121c1a5eeca'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:22.532832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1260/2525] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:22 2022] DELETE /identity/v3/users/17356938f2134701b23d1121c1a5eeca => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:22.999612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:23.002348 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:23.025349 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a96f57-c62e-438f-b020-50ad2bf7b632 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:23.031580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:23.103110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7052510-a366-4bcd-bd1a-e6b36280eca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:23.104309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7052510-a366-4bcd-bd1a-e6b36280eca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:23.104892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7052510-a366-4bcd-bd1a-e6b36280eca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:23.105453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7052510-a366-4bcd-bd1a-e6b36280eca1 admin admin] PATH_INFO: `/v3/projects/bfe0cca4a16d4bcbb49aae0598242f37` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:23.107110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7052510-a366-4bcd-bd1a-e6b36280eca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe0cca4a16d4bcbb49aae0598242f37)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:23.109591 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7052510-a366-4bcd-bd1a-e6b36280eca1 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:23.186797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d7052510-a366-4bcd-bd1a-e6b36280eca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe0cca4a16d4bcbb49aae0598242f37', 'request_id': 'req-d7052510-a366-4bcd-bd1a-e6b36280eca1'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:23.195844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d7052510-a366-4bcd-bd1a-e6b36280eca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe0cca4a16d4bcbb49aae0598242f37', 'request_id': 'req-d7052510-a366-4bcd-bd1a-e6b36280eca1'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:23.207303 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d7052510-a366-4bcd-bd1a-e6b36280eca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe0cca4a16d4bcbb49aae0598242f37', 'request_id': 'req-d7052510-a366-4bcd-bd1a-e6b36280eca1'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:23.218580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d7052510-a366-4bcd-bd1a-e6b36280eca1 admin admin] The token cache is being invalidate because project bfe0cca4a16d4bcbb49aae0598242f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:23.219028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d7052510-a366-4bcd-bd1a-e6b36280eca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:23.219726 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d7052510-a366-4bcd-bd1a-e6b36280eca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:23.221688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1266/2526] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:22 2022] DELETE /identity/v3/projects/bfe0cca4a16d4bcbb49aae0598242f37 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:23.226417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee686b-059f-4d6a-928e-56824b8d1202 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:23.226917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee686b-059f-4d6a-928e-56824b8d1202 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:23.227255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee686b-059f-4d6a-928e-56824b8d1202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:23.249237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-d1ee686b-059f-4d6a-928e-56824b8d1202 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:23.250444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d1ee686b-059f-4d6a-928e-56824b8d1202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:23.310652 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1261/2527] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:23.318588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e95b8-f426-4f79-b8ec-0f6f7776d5f2 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:23.318914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e95b8-f426-4f79-b8ec-0f6f7776d5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:23.319218 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e95b8-f426-4f79-b8ec-0f6f7776d5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:23.341563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b54e95b8-f426-4f79-b8ec-0f6f7776d5f2 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:23.342787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b54e95b8-f426-4f79-b8ec-0f6f7776d5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:23.351129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1267/2528] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:37:23.355586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee686b-059f-4d6a-928e-56824b8d1202 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:23.365360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee686b-059f-4d6a-928e-56824b8d1202 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:23.370083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ec248-05d7-4551-bc4b-1f8e8ab0cddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:23.370868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ec248-05d7-4551-bc4b-1f8e8ab0cddf admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:23.371150 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ec248-05d7-4551-bc4b-1f8e8ab0cddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:23.371417 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ec248-05d7-4551-bc4b-1f8e8ab0cddf admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:23.372140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ec248-05d7-4551-bc4b-1f8e8ab0cddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:37:23.372442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ec248-05d7-4551-bc4b-1f8e8ab0cddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:23.377690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ec248-05d7-4551-bc4b-1f8e8ab0cddf admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:23.391138 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1262/2529] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:37:23.395865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e95b8-f426-4f79-b8ec-0f6f7776d5f2 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:23.407873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e95b8-f426-4f79-b8ec-0f6f7776d5f2 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:23.414996 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e76a8-be30-41dd-be55-2818885380cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:23.415647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e76a8-be30-41dd-be55-2818885380cd admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:23.415894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e76a8-be30-41dd-be55-2818885380cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:23.416152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e76a8-be30-41dd-be55-2818885380cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:23.416794 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e76a8-be30-41dd-be55-2818885380cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:23.418840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e76a8-be30-41dd-be55-2818885380cd admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:23.449958 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1268/2530] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:23 2022] POST /identity/v3/projects => generated 401 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:23.454150 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ec248-05d7-4551-bc4b-1f8e8ab0cddf admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:23.465597 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ec248-05d7-4551-bc4b-1f8e8ab0cddf admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:23.512682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:23.532351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e7fd0-ba3b-4655-83b9-f1a802aea929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:23.532965 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e7fd0-ba3b-4655-83b9-f1a802aea929 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:23.533242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e7fd0-ba3b-4655-83b9-f1a802aea929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:23.533512 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e7fd0-ba3b-4655-83b9-f1a802aea929 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:23.534158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e7fd0-ba3b-4655-83b9-f1a802aea929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:23.536118 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e7fd0-ba3b-4655-83b9-f1a802aea929 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:23.562865 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1263/2531] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:23 2022] POST /identity/v3/users => generated 301 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:23.564147 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e76a8-be30-41dd-be55-2818885380cd admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:23.575278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e76a8-be30-41dd-be55-2818885380cd admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:23.579984 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21a427-fea8-4742-a4f6-8ad73d36eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:23.580910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21a427-fea8-4742-a4f6-8ad73d36eb84 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:23.581186 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21a427-fea8-4742-a4f6-8ad73d36eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:23.581463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21a427-fea8-4742-a4f6-8ad73d36eb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:23.582105 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21a427-fea8-4742-a4f6-8ad73d36eb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:23.583767 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21a427-fea8-4742-a4f6-8ad73d36eb84 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:23.597912 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1269/2532] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:37:23.599180 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e7fd0-ba3b-4655-83b9-f1a802aea929 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:23.609875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e7fd0-ba3b-4655-83b9-f1a802aea929 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:23.614952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd31b08-9de9-4be5-90a2-707b57bd2aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:23.615563 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd31b08-9de9-4be5-90a2-707b57bd2aab admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:23.615838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd31b08-9de9-4be5-90a2-707b57bd2aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:23.616111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd31b08-9de9-4be5-90a2-707b57bd2aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:23.616904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd31b08-9de9-4be5-90a2-707b57bd2aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:23.618545 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd31b08-9de9-4be5-90a2-707b57bd2aab admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:23.633302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1264/2533] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:23.634673 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21a427-fea8-4742-a4f6-8ad73d36eb84 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:23.645815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21a427-fea8-4742-a4f6-8ad73d36eb84 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:23.651497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe2b1c-8888-451a-946b-95a754ca0af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:23.652313 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe2b1c-8888-451a-946b-95a754ca0af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:23.652589 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe2b1c-8888-451a-946b-95a754ca0af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:23.652880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe2b1c-8888-451a-946b-95a754ca0af8 admin admin] PATH_INFO: `/v3/projects/28568538262d417dbd3f2bb5e4df27b1/users/dd36ee501d0f4af58fceb2a9da98c386/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:23.669282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe2b1c-8888-451a-946b-95a754ca0af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28568538262d417dbd3f2bb5e4df27b1, user_id=dd36ee501d0f4af58fceb2a9da98c386, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:23.672244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe2b1c-8888-451a-946b-95a754ca0af8 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:23.687419 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1270/2534] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:23 2022] PUT /identity/v3/projects/28568538262d417dbd3f2bb5e4df27b1/users/dd36ee501d0f4af58fceb2a9da98c386/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:23.697915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e52c7-270a-4d7c-9b9c-3e2eeb2faeac None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:23.698211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e52c7-270a-4d7c-9b9c-3e2eeb2faeac None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:23.698473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e52c7-270a-4d7c-9b9c-3e2eeb2faeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:23.732924 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-714e52c7-270a-4d7c-9b9c-3e2eeb2faeac None None] MFA Rules not processed for user `dd36ee501d0f4af58fceb2a9da98c386`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:23.734681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-714e52c7-270a-4d7c-9b9c-3e2eeb2faeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:23.806723 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1265/2535] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:23 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:23.811614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe2b1c-8888-451a-946b-95a754ca0af8 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:23.855612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:23.887861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe2b1c-8888-451a-946b-95a754ca0af8 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:23.892854 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391a337-996d-4f7c-911a-243bf3ea8e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:23.893471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391a337-996d-4f7c-911a-243bf3ea8e89 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:23.893747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391a337-996d-4f7c-911a-243bf3ea8e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:23.894018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391a337-996d-4f7c-911a-243bf3ea8e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:23.894672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391a337-996d-4f7c-911a-243bf3ea8e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:23.896778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391a337-996d-4f7c-911a-243bf3ea8e89 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:23.934643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1271/2536] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:23 2022] POST /identity/v3/projects => generated 399 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:23.935688 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e52c7-270a-4d7c-9b9c-3e2eeb2faeac None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:23.947825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e52c7-270a-4d7c-9b9c-3e2eeb2faeac None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:24.017476 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487ba2a-c7b3-4a6a-ac7d-16edb12cbece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:24.018399 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487ba2a-c7b3-4a6a-ac7d-16edb12cbece admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:24.018771 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487ba2a-c7b3-4a6a-ac7d-16edb12cbece admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:24.019154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487ba2a-c7b3-4a6a-ac7d-16edb12cbece admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:24.020060 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487ba2a-c7b3-4a6a-ac7d-16edb12cbece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:24.022110 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487ba2a-c7b3-4a6a-ac7d-16edb12cbece admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:24.050608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1266/2537] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:23 2022] POST /identity/v3/users => generated 306 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:37:24.054496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391a337-996d-4f7c-911a-243bf3ea8e89 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:24.068748 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391a337-996d-4f7c-911a-243bf3ea8e89 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:24.075379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e0e25-0466-4f90-acfe-dbe0d82c6ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:24.077481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e0e25-0466-4f90-acfe-dbe0d82c6ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:24.077824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e0e25-0466-4f90-acfe-dbe0d82c6ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:24.078154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e0e25-0466-4f90-acfe-dbe0d82c6ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:24.078916 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e0e25-0466-4f90-acfe-dbe0d82c6ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:24.081145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e0e25-0466-4f90-acfe-dbe0d82c6ea8 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:24.096159 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1272/2538] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:24.100300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487ba2a-c7b3-4a6a-ac7d-16edb12cbece admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:24.112710 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487ba2a-c7b3-4a6a-ac7d-16edb12cbece admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:24.118787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b719eb-91c3-491f-a95e-1f6b3bf636a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:24.119626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b719eb-91c3-491f-a95e-1f6b3bf636a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:24.120003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b719eb-91c3-491f-a95e-1f6b3bf636a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:24.120360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b719eb-91c3-491f-a95e-1f6b3bf636a0 admin admin] PATH_INFO: `/v3/projects/fbd083f52e1943218a53b73cf785cd0e/users/c5c6ce15aad149fea10d7ae161f0489f/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:24.143615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b719eb-91c3-491f-a95e-1f6b3bf636a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd083f52e1943218a53b73cf785cd0e, user_id=c5c6ce15aad149fea10d7ae161f0489f, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:24.146374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b719eb-91c3-491f-a95e-1f6b3bf636a0 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:24.170140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1267/2539] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:24 2022] PUT /identity/v3/projects/fbd083f52e1943218a53b73cf785cd0e/users/c5c6ce15aad149fea10d7ae161f0489f/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:24.170354 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e0e25-0466-4f90-acfe-dbe0d82c6ea8 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:24.183420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e0e25-0466-4f90-acfe-dbe0d82c6ea8 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:24.283374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205161f-5815-4523-9f10-f59b4ef8173a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:24.284036 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205161f-5815-4523-9f10-f59b4ef8173a admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:24.284316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205161f-5815-4523-9f10-f59b4ef8173a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:24.284710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205161f-5815-4523-9f10-f59b4ef8173a admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:24.285395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205161f-5815-4523-9f10-f59b4ef8173a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:24.287395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205161f-5815-4523-9f10-f59b4ef8173a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:24.302870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1273/2540] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:37:24.304301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b719eb-91c3-491f-a95e-1f6b3bf636a0 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:24.318962 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b719eb-91c3-491f-a95e-1f6b3bf636a0 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:24.324874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a2630-06ad-496d-a662-30551cd62671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:24.325760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2630-06ad-496d-a662-30551cd62671 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:24.326193 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2630-06ad-496d-a662-30551cd62671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:24.326620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2630-06ad-496d-a662-30551cd62671 admin admin] PATH_INFO: `/v3/projects/fbd083f52e1943218a53b73cf785cd0e/users/c5c6ce15aad149fea10d7ae161f0489f/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:24.328767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a2630-06ad-496d-a662-30551cd62671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd083f52e1943218a53b73cf785cd0e, user_id=c5c6ce15aad149fea10d7ae161f0489f, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:24.332266 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a2630-06ad-496d-a662-30551cd62671 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:24.362864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1268/2541] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:24 2022] PUT /identity/v3/projects/fbd083f52e1943218a53b73cf785cd0e/users/c5c6ce15aad149fea10d7ae161f0489f/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:24.372335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23b76a-7d9c-481e-b333-5967bf253579 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:24.372335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23b76a-7d9c-481e-b333-5967bf253579 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:24.372335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23b76a-7d9c-481e-b333-5967bf253579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:24.413259 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-ac23b76a-7d9c-481e-b333-5967bf253579 None None] MFA Rules not processed for user `c5c6ce15aad149fea10d7ae161f0489f`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:24.415182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ac23b76a-7d9c-481e-b333-5967bf253579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:24.519168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1274/2542] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:24 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:24.532183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a2630-06ad-496d-a662-30551cd62671 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:24.537073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-1e9a2630-06ad-496d-a662-30551cd62671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:24.542505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:24.602291 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a2630-06ad-496d-a662-30551cd62671 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:24.606667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b8da9-f45b-47f6-b2db-d740b6017725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:24.607321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b8da9-f45b-47f6-b2db-d740b6017725 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:24.607603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b8da9-f45b-47f6-b2db-d740b6017725 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:24.607869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b8da9-f45b-47f6-b2db-d740b6017725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:24.619450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b8da9-f45b-47f6-b2db-d740b6017725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:24.621488 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b8da9-f45b-47f6-b2db-d740b6017725 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:24.632602 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1269/2543] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:24 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:24.716268 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23b76a-7d9c-481e-b333-5967bf253579 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:24.726035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23b76a-7d9c-481e-b333-5967bf253579 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:24.729866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc5de1-e7b6-4f0c-9684-236b7fac14ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:24.730528 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5de1-e7b6-4f0c-9684-236b7fac14ef service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:24.730792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5de1-e7b6-4f0c-9684-236b7fac14ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:24.731098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5de1-e7b6-4f0c-9684-236b7fac14ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:24.762335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:24.791661 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc5de1-e7b6-4f0c-9684-236b7fac14ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:24.793382 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc5de1-e7b6-4f0c-9684-236b7fac14ef service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:24.802743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1275/2544] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:24 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:28.869936 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b8da9-f45b-47f6-b2db-d740b6017725 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:28.873039 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-582b8da9-f45b-47f6-b2db-d740b6017725 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:28.966103 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b8da9-f45b-47f6-b2db-d740b6017725 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:28.970211 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46a3de-ade4-4846-9be8-818183742763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:28.970844 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46a3de-ade4-4846-9be8-818183742763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:28.971645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46a3de-ade4-4846-9be8-818183742763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:28.971645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46a3de-ade4-4846-9be8-818183742763 admin admin] PATH_INFO: `/v3/users/b477645d5d814644aa77e11066f0489d` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:28.972702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46a3de-ade4-4846-9be8-818183742763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b477645d5d814644aa77e11066f0489d)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:28.974713 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46a3de-ade4-4846-9be8-818183742763 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:29.041669 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fd46a3de-ade4-4846-9be8-818183742763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b477645d5d814644aa77e11066f0489d'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.051995 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fd46a3de-ade4-4846-9be8-818183742763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b477645d5d814644aa77e11066f0489d'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.052998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fd46a3de-ade4-4846-9be8-818183742763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b477645d5d814644aa77e11066f0489d'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.054105 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fd46a3de-ade4-4846-9be8-818183742763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b477645d5d814644aa77e11066f0489d'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.074089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fd46a3de-ade4-4846-9be8-818183742763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b477645d5d814644aa77e11066f0489d'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.088591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1270/2545] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:28 2022] DELETE /identity/v3/users/b477645d5d814644aa77e11066f0489d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:29.279338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc5de1-e7b6-4f0c-9684-236b7fac14ef service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:29.290464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc5de1-e7b6-4f0c-9684-236b7fac14ef service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:29.364769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:29.365836 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:29.366294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:29.366769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] PATH_INFO: `/v3/projects/d5b4feb5fe1746a2b54b81e61558d4c0` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:29.368690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b4feb5fe1746a2b54b81e61558d4c0)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:29.371483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:29.427679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'request_id': 'req-a1dd964c-7013-4514-8cda-ec38746bd40a'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.434163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'request_id': 'req-a1dd964c-7013-4514-8cda-ec38746bd40a'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.455021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'request_id': 'req-a1dd964c-7013-4514-8cda-ec38746bd40a'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.455021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] The token cache is being invalidate because project d5b4feb5fe1746a2b54b81e61558d4c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:29.455021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.455772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.457260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1276/2546] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:29 2022] DELETE /identity/v3/projects/d5b4feb5fe1746a2b54b81e61558d4c0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:29.461766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46a3de-ade4-4846-9be8-818183742763 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:29.463294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-fd46a3de-ade4-4846-9be8-818183742763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:29.477432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46a3de-ade4-4846-9be8-818183742763 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:29.500584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:29.541290 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82938b94-fddf-493b-aaf1-ca097dba00e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:29.541916 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938b94-fddf-493b-aaf1-ca097dba00e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:29.542183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938b94-fddf-493b-aaf1-ca097dba00e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:29.542451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938b94-fddf-493b-aaf1-ca097dba00e4 admin admin] PATH_INFO: `/v3/users/86edbf3c7e644fb79abc3244486fb484` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:29.543645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82938b94-fddf-493b-aaf1-ca097dba00e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86edbf3c7e644fb79abc3244486fb484)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:29.545573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82938b94-fddf-493b-aaf1-ca097dba00e4 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:29.595843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-82938b94-fddf-493b-aaf1-ca097dba00e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86edbf3c7e644fb79abc3244486fb484'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.603673 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-82938b94-fddf-493b-aaf1-ca097dba00e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86edbf3c7e644fb79abc3244486fb484'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.604360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-82938b94-fddf-493b-aaf1-ca097dba00e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86edbf3c7e644fb79abc3244486fb484'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.605020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-82938b94-fddf-493b-aaf1-ca097dba00e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86edbf3c7e644fb79abc3244486fb484'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.617054 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-82938b94-fddf-493b-aaf1-ca097dba00e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86edbf3c7e644fb79abc3244486fb484'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.629544 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1271/2547] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:29 2022] DELETE /identity/v3/users/86edbf3c7e644fb79abc3244486fb484 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:29.819815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:29.821285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:29.842415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd964c-7013-4514-8cda-ec38746bd40a admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:29.904988 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:29.905538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:29.905812 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:29.906100 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] PATH_INFO: `/v3/projects/da836df55bdc4a008fcb46c26d36adb3` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:29.907286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da836df55bdc4a008fcb46c26d36adb3)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:29.909202 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:29.910626 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:29.960250 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da836df55bdc4a008fcb46c26d36adb3', 'request_id': 'req-66efd6f7-9343-48c1-bd47-d6e46fd04036'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.967471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da836df55bdc4a008fcb46c26d36adb3', 'request_id': 'req-66efd6f7-9343-48c1-bd47-d6e46fd04036'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.977032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da836df55bdc4a008fcb46c26d36adb3', 'request_id': 'req-66efd6f7-9343-48c1-bd47-d6e46fd04036'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.988522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] The token cache is being invalidate because project da836df55bdc4a008fcb46c26d36adb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:29.988799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.989423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:29.990971 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1277/2548] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:29 2022] DELETE /identity/v3/projects/da836df55bdc4a008fcb46c26d36adb3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:37:32.028553 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82938b94-fddf-493b-aaf1-ca097dba00e4 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:32.030215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-82938b94-fddf-493b-aaf1-ca097dba00e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:32.044000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82938b94-fddf-493b-aaf1-ca097dba00e4 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:32.110201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e55478-e080-4dfd-834d-7bcc32346d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:32.110861 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e55478-e080-4dfd-834d-7bcc32346d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:32.111143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e55478-e080-4dfd-834d-7bcc32346d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:32.111410 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e55478-e080-4dfd-834d-7bcc32346d03 admin admin] PATH_INFO: `/v3/users/a67a964a727f4a35b3b57e3a7d8c09a1` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:32.112586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e55478-e080-4dfd-834d-7bcc32346d03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67a964a727f4a35b3b57e3a7d8c09a1)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:32.114482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e55478-e080-4dfd-834d-7bcc32346d03 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:32.163196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:32.165123 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-54e55478-e080-4dfd-834d-7bcc32346d03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67a964a727f4a35b3b57e3a7d8c09a1'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.170086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:32.171623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:32.176025 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-54e55478-e080-4dfd-834d-7bcc32346d03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67a964a727f4a35b3b57e3a7d8c09a1'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.176930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-54e55478-e080-4dfd-834d-7bcc32346d03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67a964a727f4a35b3b57e3a7d8c09a1'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.177737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-54e55478-e080-4dfd-834d-7bcc32346d03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67a964a727f4a35b3b57e3a7d8c09a1'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.185901 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efd6f7-9343-48c1-bd47-d6e46fd04036 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:32.190681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d7c2e-ef08-4334-88de-261db5edac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:32.191133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-54e55478-e080-4dfd-834d-7bcc32346d03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67a964a727f4a35b3b57e3a7d8c09a1'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.191448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d7c2e-ef08-4334-88de-261db5edac54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:32.191783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d7c2e-ef08-4334-88de-261db5edac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:32.192116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d7c2e-ef08-4334-88de-261db5edac54 admin admin] PATH_INFO: `/v3/users/dd36ee501d0f4af58fceb2a9da98c386` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:32.193309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d7c2e-ef08-4334-88de-261db5edac54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd36ee501d0f4af58fceb2a9da98c386)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:32.195392 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d7c2e-ef08-4334-88de-261db5edac54 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:32.204707 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1272/2549] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:32 2022] DELETE /identity/v3/users/a67a964a727f4a35b3b57e3a7d8c09a1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:32.209933 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdda44-b49c-42cf-b40a-ac476de621b1 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:32.210216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdda44-b49c-42cf-b40a-ac476de621b1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:32.210634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdda44-b49c-42cf-b40a-ac476de621b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:32.230472 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-aebdda44-b49c-42cf-b40a-ac476de621b1 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:32.231789 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-aebdda44-b49c-42cf-b40a-ac476de621b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:32.250502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-676d7c2e-ef08-4334-88de-261db5edac54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd36ee501d0f4af58fceb2a9da98c386'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.265977 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-676d7c2e-ef08-4334-88de-261db5edac54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd36ee501d0f4af58fceb2a9da98c386'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.276217 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-676d7c2e-ef08-4334-88de-261db5edac54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd36ee501d0f4af58fceb2a9da98c386'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.276959 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-676d7c2e-ef08-4334-88de-261db5edac54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd36ee501d0f4af58fceb2a9da98c386'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.277569 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-676d7c2e-ef08-4334-88de-261db5edac54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd36ee501d0f4af58fceb2a9da98c386'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.291437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1278/2550] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:32 2022] DELETE /identity/v3/users/dd36ee501d0f4af58fceb2a9da98c386 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:32.293106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1273/2551] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:32.296152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0577c22-e047-4aad-b3ed-dae4e4875794 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:32.296458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0577c22-e047-4aad-b3ed-dae4e4875794 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:32.296800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0577c22-e047-4aad-b3ed-dae4e4875794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:32.303272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdda44-b49c-42cf-b40a-ac476de621b1 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:32.304627 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-aebdda44-b49c-42cf-b40a-ac476de621b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:32.316169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c0577c22-e047-4aad-b3ed-dae4e4875794 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:32.317347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c0577c22-e047-4aad-b3ed-dae4e4875794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:32.362141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdda44-b49c-42cf-b40a-ac476de621b1 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:32.374224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1279/2552] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:37:32.385721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0577c22-e047-4aad-b3ed-dae4e4875794 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:32.387120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c0577c22-e047-4aad-b3ed-dae4e4875794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:32.392094 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:32.415595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872358d-8500-44f4-ba43-61f945bc08de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:32.416235 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872358d-8500-44f4-ba43-61f945bc08de service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:32.416636 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872358d-8500-44f4-ba43-61f945bc08de service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:32.416915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872358d-8500-44f4-ba43-61f945bc08de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:32.426535 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872358d-8500-44f4-ba43-61f945bc08de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:32.428041 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872358d-8500-44f4-ba43-61f945bc08de service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:32.437693 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1274/2553] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:32.451077 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0577c22-e047-4aad-b3ed-dae4e4875794 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:32.459318 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ca15d-8fe6-4577-a83a-1334063f18df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:32.459916 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ca15d-8fe6-4577-a83a-1334063f18df service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:32.460256 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ca15d-8fe6-4577-a83a-1334063f18df service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:32.460485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ca15d-8fe6-4577-a83a-1334063f18df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:32.470625 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ca15d-8fe6-4577-a83a-1334063f18df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:32.472139 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ca15d-8fe6-4577-a83a-1334063f18df service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:32.482633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1280/2554] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:37:32.741138 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487d836-f8d2-477d-b987-129b31250756 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:32.741635 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487d836-f8d2-477d-b987-129b31250756 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:32.742066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487d836-f8d2-477d-b987-129b31250756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:32.761603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-2487d836-f8d2-477d-b987-129b31250756 None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:32.763350 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2487d836-f8d2-477d-b987-129b31250756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:32.783382 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ca15d-8fe6-4577-a83a-1334063f18df service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:32.785051 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-543ca15d-8fe6-4577-a83a-1334063f18df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:32.800275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:32.816164 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ca15d-8fe6-4577-a83a-1334063f18df service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:32.825467 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:32.826403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:32.826780 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:32.827761 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] PATH_INFO: `/v3/projects/8ed2980eafa94168af9b4bf61b1f8ff9` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:32.828629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed2980eafa94168af9b4bf61b1f8ff9)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:32.830967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:32.849988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1275/2555] 10.222.0.59 () {58 vars in 967 bytes} [Tue Aug 9 11:37:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:32.869574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487d836-f8d2-477d-b987-129b31250756 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:32.871043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2487d836-f8d2-477d-b987-129b31250756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:32.903684 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed2980eafa94168af9b4bf61b1f8ff9', 'request_id': 'req-302f1e9b-c564-434e-a46a-0e8138df708f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.911816 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed2980eafa94168af9b4bf61b1f8ff9', 'request_id': 'req-302f1e9b-c564-434e-a46a-0e8138df708f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.923330 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed2980eafa94168af9b4bf61b1f8ff9', 'request_id': 'req-302f1e9b-c564-434e-a46a-0e8138df708f'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.936759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] The token cache is being invalidate because project 8ed2980eafa94168af9b4bf61b1f8ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:32.937271 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.937911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:32.939476 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1281/2556] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:32 2022] DELETE /identity/v3/projects/8ed2980eafa94168af9b4bf61b1f8ff9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:37:32.940257 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:32.941554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:32.953959 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487d836-f8d2-477d-b987-129b31250756 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:33.007067 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f1e9b-c564-434e-a46a-0e8138df708f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:33.011999 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:33.012638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:33.012912 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:33.013188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] PATH_INFO: `/v3/projects/28568538262d417dbd3f2bb5e4df27b1` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:33.014393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] RBAC: Authorizing `identity:delete_project(project_id=28568538262d417dbd3f2bb5e4df27b1)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:33.016345 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:33.018482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca27357-cede-44f3-acdf-75a6fcd7776a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:33.019158 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca27357-cede-44f3-acdf-75a6fcd7776a service swift] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:33.019432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca27357-cede-44f3-acdf-75a6fcd7776a service swift] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:33.019719 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca27357-cede-44f3-acdf-75a6fcd7776a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:33.021481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-cca27357-cede-44f3-acdf-75a6fcd7776a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:33.053158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:33.067387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28568538262d417dbd3f2bb5e4df27b1', 'request_id': 'req-aeed4985-95f6-41fc-90d0-f85fa43a209e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.073598 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28568538262d417dbd3f2bb5e4df27b1', 'request_id': 'req-aeed4985-95f6-41fc-90d0-f85fa43a209e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.082603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28568538262d417dbd3f2bb5e4df27b1', 'request_id': 'req-aeed4985-95f6-41fc-90d0-f85fa43a209e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.087278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca27357-cede-44f3-acdf-75a6fcd7776a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:33.088880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca27357-cede-44f3-acdf-75a6fcd7776a service swift] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:33.093502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] The token cache is being invalidate because project 28568538262d417dbd3f2bb5e4df27b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:33.093790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.094454 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.096126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1282/2557] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:32 2022] DELETE /identity/v3/projects/28568538262d417dbd3f2bb5e4df27b1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:33.096896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:33.097527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1276/2558] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:37:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 11:37:33.098331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:33.100147 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca27357-cede-44f3-acdf-75a6fcd7776a service swift] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:33.110223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca27357-cede-44f3-acdf-75a6fcd7776a service swift] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:33.120341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:33.178007 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed4985-95f6-41fc-90d0-f85fa43a209e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:33.182401 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07447e0-6e18-4815-9842-db936535e73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:33.183148 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07447e0-6e18-4815-9842-db936535e73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:33.183333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07447e0-6e18-4815-9842-db936535e73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:33.183663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07447e0-6e18-4815-9842-db936535e73f admin admin] PATH_INFO: `/v3/users/757ee31fb21643f0aea38dfc5aa9424a` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:33.183803 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849e188-c245-43d1-87fd-284fce8d17d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:33.184611 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849e188-c245-43d1-87fd-284fce8d17d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:33.184742 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07447e0-6e18-4815-9842-db936535e73f admin admin] RBAC: Authorizing `identity:delete_user(user_id=757ee31fb21643f0aea38dfc5aa9424a)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:33.184896 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849e188-c245-43d1-87fd-284fce8d17d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:33.185244 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849e188-c245-43d1-87fd-284fce8d17d4 admin admin] PATH_INFO: `/v3/users/c5c6ce15aad149fea10d7ae161f0489f` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:33.186489 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849e188-c245-43d1-87fd-284fce8d17d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c6ce15aad149fea10d7ae161f0489f)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:33.186725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07447e0-6e18-4815-9842-db936535e73f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:33.188324 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849e188-c245-43d1-87fd-284fce8d17d4 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:33.246329 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3849e188-c245-43d1-87fd-284fce8d17d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c6ce15aad149fea10d7ae161f0489f'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.248282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-f07447e0-6e18-4815-9842-db936535e73f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757ee31fb21643f0aea38dfc5aa9424a'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.256316 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3849e188-c245-43d1-87fd-284fce8d17d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c6ce15aad149fea10d7ae161f0489f'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.257071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3849e188-c245-43d1-87fd-284fce8d17d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c6ce15aad149fea10d7ae161f0489f'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.257826 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3849e188-c245-43d1-87fd-284fce8d17d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c6ce15aad149fea10d7ae161f0489f'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.263298 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-f07447e0-6e18-4815-9842-db936535e73f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757ee31fb21643f0aea38dfc5aa9424a'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.272334 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-f07447e0-6e18-4815-9842-db936535e73f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757ee31fb21643f0aea38dfc5aa9424a'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.273095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-f07447e0-6e18-4815-9842-db936535e73f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757ee31fb21643f0aea38dfc5aa9424a'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.273541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3849e188-c245-43d1-87fd-284fce8d17d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c6ce15aad149fea10d7ae161f0489f'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.273665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-f07447e0-6e18-4815-9842-db936535e73f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757ee31fb21643f0aea38dfc5aa9424a'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.288473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1283/2559] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:33 2022] DELETE /identity/v3/users/757ee31fb21643f0aea38dfc5aa9424a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:33.290457 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1277/2560] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:33 2022] DELETE /identity/v3/users/c5c6ce15aad149fea10d7ae161f0489f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:33.617248 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07447e0-6e18-4815-9842-db936535e73f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:33.625305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f07447e0-6e18-4815-9842-db936535e73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:33.627516 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849e188-c245-43d1-87fd-284fce8d17d4 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:33.633605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-3849e188-c245-43d1-87fd-284fce8d17d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:33.691428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:33.729140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07447e0-6e18-4815-9842-db936535e73f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:33.742686 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849e188-c245-43d1-87fd-284fce8d17d4 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:33.747397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3bc2f-c076-4c36-a1c8-642953b1fc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:33.748396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3bc2f-c076-4c36-a1c8-642953b1fc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:33.748396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3bc2f-c076-4c36-a1c8-642953b1fc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:33.748617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3bc2f-c076-4c36-a1c8-642953b1fc48 admin admin] PATH_INFO: `/v3/projects/9f8a13f0c18c4934bb579d5172026442` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:33.750108 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3bc2f-c076-4c36-a1c8-642953b1fc48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f8a13f0c18c4934bb579d5172026442)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:33.752118 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3bc2f-c076-4c36-a1c8-642953b1fc48 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:33.793122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:33.798555 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc7c2c-d2fa-4b19-836d-cdef38112668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:33.799224 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc7c2c-d2fa-4b19-836d-cdef38112668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:33.799501 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc7c2c-d2fa-4b19-836d-cdef38112668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:33.799819 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc7c2c-d2fa-4b19-836d-cdef38112668 admin admin] PATH_INFO: `/v3/projects/fbd083f52e1943218a53b73cf785cd0e` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:33.801030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc7c2c-d2fa-4b19-836d-cdef38112668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd083f52e1943218a53b73cf785cd0e)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:33.803084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc7c2c-d2fa-4b19-836d-cdef38112668 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:33.809594 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-67a3bc2f-c076-4c36-a1c8-642953b1fc48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f8a13f0c18c4934bb579d5172026442', 'request_id': 'req-67a3bc2f-c076-4c36-a1c8-642953b1fc48'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.818227 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-67a3bc2f-c076-4c36-a1c8-642953b1fc48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f8a13f0c18c4934bb579d5172026442', 'request_id': 'req-67a3bc2f-c076-4c36-a1c8-642953b1fc48'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.824839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-67a3bc2f-c076-4c36-a1c8-642953b1fc48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f8a13f0c18c4934bb579d5172026442', 'request_id': 'req-67a3bc2f-c076-4c36-a1c8-642953b1fc48'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.838406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-67a3bc2f-c076-4c36-a1c8-642953b1fc48 admin admin] The token cache is being invalidate because project 9f8a13f0c18c4934bb579d5172026442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:33.838790 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-67a3bc2f-c076-4c36-a1c8-642953b1fc48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.839568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-67a3bc2f-c076-4c36-a1c8-642953b1fc48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.841141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1278/2561] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:33 2022] DELETE /identity/v3/projects/9f8a13f0c18c4934bb579d5172026442 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:33.846864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ab939-11c8-4cb3-a73e-2c9ddbc7448c None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:33.847276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ab939-11c8-4cb3-a73e-2c9ddbc7448c None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:33.848267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ab939-11c8-4cb3-a73e-2c9ddbc7448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:33.864110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6ebc7c2c-d2fa-4b19-836d-cdef38112668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd083f52e1943218a53b73cf785cd0e', 'request_id': 'req-6ebc7c2c-d2fa-4b19-836d-cdef38112668'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.867745 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-055ab939-11c8-4cb3-a73e-2c9ddbc7448c None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:33.869036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-055ab939-11c8-4cb3-a73e-2c9ddbc7448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:33.871014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6ebc7c2c-d2fa-4b19-836d-cdef38112668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd083f52e1943218a53b73cf785cd0e', 'request_id': 'req-6ebc7c2c-d2fa-4b19-836d-cdef38112668'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.883078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6ebc7c2c-d2fa-4b19-836d-cdef38112668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd083f52e1943218a53b73cf785cd0e', 'request_id': 'req-6ebc7c2c-d2fa-4b19-836d-cdef38112668'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.897294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6ebc7c2c-d2fa-4b19-836d-cdef38112668 admin admin] The token cache is being invalidate because project fbd083f52e1943218a53b73cf785cd0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:33.897600 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6ebc7c2c-d2fa-4b19-836d-cdef38112668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.898258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6ebc7c2c-d2fa-4b19-836d-cdef38112668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:33.900037 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1284/2562] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:33 2022] DELETE /identity/v3/projects/fbd083f52e1943218a53b73cf785cd0e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:37:33.905353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32860f-cd78-4a3c-bfa8-3ae8f95fde96 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:33.905638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32860f-cd78-4a3c-bfa8-3ae8f95fde96 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:33.905919 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32860f-cd78-4a3c-bfa8-3ae8f95fde96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:33.928336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-6e32860f-cd78-4a3c-bfa8-3ae8f95fde96 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:33.929680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6e32860f-cd78-4a3c-bfa8-3ae8f95fde96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:33.939484 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1279/2563] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:33.941836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66dd5b-dceb-4e62-bca3-cc9563c360a3 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:33.942182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66dd5b-dceb-4e62-bca3-cc9563c360a3 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:33.942522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66dd5b-dceb-4e62-bca3-cc9563c360a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:33.945286 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1285/2564] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:33.952998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c7e96-4d80-4b47-8c30-91df1424ac7d None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:33.953280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c7e96-4d80-4b47-8c30-91df1424ac7d None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:33.953553 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c7e96-4d80-4b47-8c30-91df1424ac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:33.968527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-8d66dd5b-dceb-4e62-bca3-cc9563c360a3 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:33.969720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-8d66dd5b-dceb-4e62-bca3-cc9563c360a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:33.977326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-cb8c7e96-4d80-4b47-8c30-91df1424ac7d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:33.978861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cb8c7e96-4d80-4b47-8c30-91df1424ac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:33.981019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1280/2565] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:37:33.985663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66dd5b-dceb-4e62-bca3-cc9563c360a3 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:33.986652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1286/2566] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:33.990873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c7e96-4d80-4b47-8c30-91df1424ac7d None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:33.997881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66dd5b-dceb-4e62-bca3-cc9563c360a3 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.000958 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c7e96-4d80-4b47-8c30-91df1424ac7d None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.009253 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb61ec1-dd24-4615-bd81-abd7077f2b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.009920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb61ec1-dd24-4615-bd81-abd7077f2b73 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.010241 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435dc77-84de-45f0-bfec-d1d782cf9d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.010390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb61ec1-dd24-4615-bd81-abd7077f2b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.010636 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb61ec1-dd24-4615-bd81-abd7077f2b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.011207 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435dc77-84de-45f0-bfec-d1d782cf9d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.011450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb61ec1-dd24-4615-bd81-abd7077f2b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:37:34.011610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435dc77-84de-45f0-bfec-d1d782cf9d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.011873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb61ec1-dd24-4615-bd81-abd7077f2b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.012008 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435dc77-84de-45f0-bfec-d1d782cf9d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.012712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435dc77-84de-45f0-bfec-d1d782cf9d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:37:34.013082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435dc77-84de-45f0-bfec-d1d782cf9d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.013765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb61ec1-dd24-4615-bd81-abd7077f2b73 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.014930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435dc77-84de-45f0-bfec-d1d782cf9d37 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.025620 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1287/2567] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:37:34.028979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1281/2568] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:37:34.030206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb61ec1-dd24-4615-bd81-abd7077f2b73 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.033071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435dc77-84de-45f0-bfec-d1d782cf9d37 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.040061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb61ec1-dd24-4615-bd81-abd7077f2b73 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.042557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435dc77-84de-45f0-bfec-d1d782cf9d37 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.044647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16a9a7-6bdb-49aa-8043-19edc3b79ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.045249 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a9a7-6bdb-49aa-8043-19edc3b79ebc admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.045509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a9a7-6bdb-49aa-8043-19edc3b79ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.045776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a9a7-6bdb-49aa-8043-19edc3b79ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.046414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16a9a7-6bdb-49aa-8043-19edc3b79ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.047370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b445e-9a38-4cd2-92d8-796b5e5cf16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.047950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b445e-9a38-4cd2-92d8-796b5e5cf16d admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.048221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b445e-9a38-4cd2-92d8-796b5e5cf16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.048335 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16a9a7-6bdb-49aa-8043-19edc3b79ebc admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.048485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b445e-9a38-4cd2-92d8-796b5e5cf16d admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.049092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b445e-9a38-4cd2-92d8-796b5e5cf16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.051001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b445e-9a38-4cd2-92d8-796b5e5cf16d admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.076276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1288/2569] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:34 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:34.081782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1282/2570] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:34 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:34.082012 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16a9a7-6bdb-49aa-8043-19edc3b79ebc admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.083881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b445e-9a38-4cd2-92d8-796b5e5cf16d admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.115945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:34.149855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b445e-9a38-4cd2-92d8-796b5e5cf16d admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.151770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16a9a7-6bdb-49aa-8043-19edc3b79ebc admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.155280 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641b37f-c382-4313-b41c-86a957f610a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.155893 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641b37f-c382-4313-b41c-86a957f610a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.156172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641b37f-c382-4313-b41c-86a957f610a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.156483 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641b37f-c382-4313-b41c-86a957f610a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.156705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa46fbc-74f7-4d7d-848c-48017ca97609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.157102 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641b37f-c382-4313-b41c-86a957f610a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.157282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa46fbc-74f7-4d7d-848c-48017ca97609 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.157568 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa46fbc-74f7-4d7d-848c-48017ca97609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.157834 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa46fbc-74f7-4d7d-848c-48017ca97609 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.158452 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa46fbc-74f7-4d7d-848c-48017ca97609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.159085 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641b37f-c382-4313-b41c-86a957f610a3 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.160413 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa46fbc-74f7-4d7d-848c-48017ca97609 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.182963 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1283/2571] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:34 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:34.183353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1289/2572] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:34 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:37:34.187324 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa46fbc-74f7-4d7d-848c-48017ca97609 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.187670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641b37f-c382-4313-b41c-86a957f610a3 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.197615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641b37f-c382-4313-b41c-86a957f610a3 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.197848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa46fbc-74f7-4d7d-848c-48017ca97609 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.203220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd87061-9faf-4107-ace6-3e26cd0a3504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.203797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838f165-4215-4e34-b5a2-7d8ed67e1d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.203950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd87061-9faf-4107-ace6-3e26cd0a3504 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.204138 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd87061-9faf-4107-ace6-3e26cd0a3504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.204418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838f165-4215-4e34-b5a2-7d8ed67e1d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.204568 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd87061-9faf-4107-ace6-3e26cd0a3504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.204805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838f165-4215-4e34-b5a2-7d8ed67e1d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.205028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838f165-4215-4e34-b5a2-7d8ed67e1d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.205275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd87061-9faf-4107-ace6-3e26cd0a3504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.206074 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838f165-4215-4e34-b5a2-7d8ed67e1d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.207386 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd87061-9faf-4107-ace6-3e26cd0a3504 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.208032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838f165-4215-4e34-b5a2-7d8ed67e1d6c admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.209754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:34.222145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1290/2573] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:34.222348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1284/2574] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:37:34.223371 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838f165-4215-4e34-b5a2-7d8ed67e1d6c admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.224009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd87061-9faf-4107-ace6-3e26cd0a3504 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.234548 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838f165-4215-4e34-b5a2-7d8ed67e1d6c admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.234838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd87061-9faf-4107-ace6-3e26cd0a3504 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.239364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6b13e-ea61-4482-9e0c-5b3e14896c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.239651 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ed6ca-0e54-4065-9bca-47e71284441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.240136 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b13e-ea61-4482-9e0c-5b3e14896c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.240258 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ed6ca-0e54-4065-9bca-47e71284441f admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.240416 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b13e-ea61-4482-9e0c-5b3e14896c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.240514 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ed6ca-0e54-4065-9bca-47e71284441f admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.240681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b13e-ea61-4482-9e0c-5b3e14896c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.240792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ed6ca-0e54-4065-9bca-47e71284441f admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.241324 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6b13e-ea61-4482-9e0c-5b3e14896c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.241430 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ed6ca-0e54-4065-9bca-47e71284441f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.242949 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6b13e-ea61-4482-9e0c-5b3e14896c8d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.243061 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ed6ca-0e54-4065-9bca-47e71284441f admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.254062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1285/2575] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:34.254663 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1291/2576] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:34.258387 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ed6ca-0e54-4065-9bca-47e71284441f admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.258547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6b13e-ea61-4482-9e0c-5b3e14896c8d admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.268758 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6b13e-ea61-4482-9e0c-5b3e14896c8d admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.268979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ed6ca-0e54-4065-9bca-47e71284441f admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.273689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957a235-1e6e-4f6d-b3a8-5e7eefe94ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.274032 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca3bf0-6ce8-41cb-9fbf-a04218b9e2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.274333 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957a235-1e6e-4f6d-b3a8-5e7eefe94ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.274626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957a235-1e6e-4f6d-b3a8-5e7eefe94ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.274747 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca3bf0-6ce8-41cb-9fbf-a04218b9e2f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.274968 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca3bf0-6ce8-41cb-9fbf-a04218b9e2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.275092 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957a235-1e6e-4f6d-b3a8-5e7eefe94ab5 admin admin] PATH_INFO: `/v3/projects/097144a125d8441c8cd19d666b087912/users/f7e2a15ec46947fcaa1234cfa3eb77c7/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.275237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca3bf0-6ce8-41cb-9fbf-a04218b9e2f3 admin admin] PATH_INFO: `/v3/projects/8477713bd00049829f5f230a2fb16f21/users/6ff56c605c594055af15df832e201801/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.290391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca3bf0-6ce8-41cb-9fbf-a04218b9e2f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8477713bd00049829f5f230a2fb16f21, user_id=6ff56c605c594055af15df832e201801, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.290623 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957a235-1e6e-4f6d-b3a8-5e7eefe94ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=097144a125d8441c8cd19d666b087912, user_id=f7e2a15ec46947fcaa1234cfa3eb77c7, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.293169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca3bf0-6ce8-41cb-9fbf-a04218b9e2f3 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.293341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957a235-1e6e-4f6d-b3a8-5e7eefe94ab5 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.308704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1292/2578] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:34 2022] PUT /identity/v3/projects/8477713bd00049829f5f230a2fb16f21/users/6ff56c605c594055af15df832e201801/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:37:34.308886 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1286/2578] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:34 2022] PUT /identity/v3/projects/097144a125d8441c8cd19d666b087912/users/f7e2a15ec46947fcaa1234cfa3eb77c7/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:34.319750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbba87-00d3-423f-9e71-2436a6414368 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.320041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbba87-00d3-423f-9e71-2436a6414368 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.320207 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4926401-13fb-4c1d-8ed7-aecbae91a2f2 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.320325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbba87-00d3-423f-9e71-2436a6414368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.320426 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4926401-13fb-4c1d-8ed7-aecbae91a2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.320699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4926401-13fb-4c1d-8ed7-aecbae91a2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.348858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-b4926401-13fb-4c1d-8ed7-aecbae91a2f2 None None] MFA Rules not processed for user `f7e2a15ec46947fcaa1234cfa3eb77c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:34.349097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-8ccbba87-00d3-423f-9e71-2436a6414368 None None] MFA Rules not processed for user `6ff56c605c594055af15df832e201801`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:34.350126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b4926401-13fb-4c1d-8ed7-aecbae91a2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:34.350305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-8ccbba87-00d3-423f-9e71-2436a6414368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:34.417909 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1293/2579] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:34.422585 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1287/2580] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:37:34.422741 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbba87-00d3-423f-9e71-2436a6414368 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.423570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4926401-13fb-4c1d-8ed7-aecbae91a2f2 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.485007 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbba87-00d3-423f-9e71-2436a6414368 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.488232 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4926401-13fb-4c1d-8ed7-aecbae91a2f2 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.489665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5a572-8379-4dbe-b7d6-bd9fa824a4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.490277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5a572-8379-4dbe-b7d6-bd9fa824a4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.490549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5a572-8379-4dbe-b7d6-bd9fa824a4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.490866 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5a572-8379-4dbe-b7d6-bd9fa824a4f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.491499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5a572-8379-4dbe-b7d6-bd9fa824a4f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.492825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b295ae-b0df-4c10-9dda-01a96be76040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.493399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5a572-8379-4dbe-b7d6-bd9fa824a4f7 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.493500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b295ae-b0df-4c10-9dda-01a96be76040 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.493687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b295ae-b0df-4c10-9dda-01a96be76040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.493955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b295ae-b0df-4c10-9dda-01a96be76040 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.494612 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b295ae-b0df-4c10-9dda-01a96be76040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.496542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b295ae-b0df-4c10-9dda-01a96be76040 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.497975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:34.525874 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1294/2581] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:34 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:34.530313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1288/2582] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:34 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:37:34.530453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5a572-8379-4dbe-b7d6-bd9fa824a4f7 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.531336 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b295ae-b0df-4c10-9dda-01a96be76040 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.572657 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:34.594457 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5a572-8379-4dbe-b7d6-bd9fa824a4f7 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.594705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b295ae-b0df-4c10-9dda-01a96be76040 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.599363 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab86e7-6f71-4288-9fdc-978849fe4806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.599868 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb92737-b74a-40d3-a537-72f5a0fcb2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.599999 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab86e7-6f71-4288-9fdc-978849fe4806 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.600229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab86e7-6f71-4288-9fdc-978849fe4806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.600495 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab86e7-6f71-4288-9fdc-978849fe4806 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.600720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb92737-b74a-40d3-a537-72f5a0fcb2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.601062 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb92737-b74a-40d3-a537-72f5a0fcb2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.601202 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab86e7-6f71-4288-9fdc-978849fe4806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.601466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb92737-b74a-40d3-a537-72f5a0fcb2a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.602177 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb92737-b74a-40d3-a537-72f5a0fcb2a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.603065 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab86e7-6f71-4288-9fdc-978849fe4806 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.604307 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb92737-b74a-40d3-a537-72f5a0fcb2a7 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.629281 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1295/2583] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:34 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:34.629493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1289/2584] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:34 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:37:34.630530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab86e7-6f71-4288-9fdc-978849fe4806 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.630651 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb92737-b74a-40d3-a537-72f5a0fcb2a7 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.640626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb92737-b74a-40d3-a537-72f5a0fcb2a7 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.641425 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab86e7-6f71-4288-9fdc-978849fe4806 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.645287 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c084cf-426c-435e-a6d0-1780cb469892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.645883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c084cf-426c-435e-a6d0-1780cb469892 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.646154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c084cf-426c-435e-a6d0-1780cb469892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.646420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c084cf-426c-435e-a6d0-1780cb469892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.647090 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b2cce-0734-4434-9b33-0092d5dc0068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.647222 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c084cf-426c-435e-a6d0-1780cb469892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.647690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2cce-0734-4434-9b33-0092d5dc0068 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.647993 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2cce-0734-4434-9b33-0092d5dc0068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.648253 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2cce-0734-4434-9b33-0092d5dc0068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.648708 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c084cf-426c-435e-a6d0-1780cb469892 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.648889 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b2cce-0734-4434-9b33-0092d5dc0068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.650564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b2cce-0734-4434-9b33-0092d5dc0068 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.658967 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1290/2585] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:34.662440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1296/2586] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:37:34.663754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c084cf-426c-435e-a6d0-1780cb469892 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.664688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b2cce-0734-4434-9b33-0092d5dc0068 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.674261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c084cf-426c-435e-a6d0-1780cb469892 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.675320 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b2cce-0734-4434-9b33-0092d5dc0068 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.679453 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee70cf-f6f3-4f4b-b514-64a813cdb7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.680094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee70cf-f6f3-4f4b-b514-64a813cdb7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.680510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee70cf-f6f3-4f4b-b514-64a813cdb7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.680750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a870317-4caa-4b20-a232-c0a3cde2ef76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.680875 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee70cf-f6f3-4f4b-b514-64a813cdb7e0 admin admin] PATH_INFO: `/v3/projects/8ce520227017484da08bd8acc6040c2f/users/fa63dfff9f3d4ff7b2401a20d7e23073/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.681576 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a870317-4caa-4b20-a232-c0a3cde2ef76 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.681913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a870317-4caa-4b20-a232-c0a3cde2ef76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.682240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a870317-4caa-4b20-a232-c0a3cde2ef76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.683178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a870317-4caa-4b20-a232-c0a3cde2ef76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.685628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a870317-4caa-4b20-a232-c0a3cde2ef76 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.697154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1297/2587] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:37:34.698952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee70cf-f6f3-4f4b-b514-64a813cdb7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce520227017484da08bd8acc6040c2f, user_id=fa63dfff9f3d4ff7b2401a20d7e23073, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.701507 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a870317-4caa-4b20-a232-c0a3cde2ef76 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.701642 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee70cf-f6f3-4f4b-b514-64a813cdb7e0 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.712336 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a870317-4caa-4b20-a232-c0a3cde2ef76 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.715987 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1291/2588] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:34 2022] PUT /identity/v3/projects/8ce520227017484da08bd8acc6040c2f/users/fa63dfff9f3d4ff7b2401a20d7e23073/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:34.719922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee70cf-f6f3-4f4b-b514-64a813cdb7e0 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.770477 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84392951-b34f-41a7-a5d4-5ba237731152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.771146 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84392951-b34f-41a7-a5d4-5ba237731152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.771504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84392951-b34f-41a7-a5d4-5ba237731152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.771781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84392951-b34f-41a7-a5d4-5ba237731152 admin admin] PATH_INFO: `/v3/projects/19a10fbeaf0245bca9f0aff7f55941f9/users/d5f14609ab9d4f5b94d47c43df9f4f01/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.786526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee70cf-f6f3-4f4b-b514-64a813cdb7e0 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.789089 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84392951-b34f-41a7-a5d4-5ba237731152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a10fbeaf0245bca9f0aff7f55941f9, user_id=d5f14609ab9d4f5b94d47c43df9f4f01, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.791325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b5281-175f-4d51-aef2-59840dbd3828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.791893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84392951-b34f-41a7-a5d4-5ba237731152 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.792025 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b5281-175f-4d51-aef2-59840dbd3828 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.792183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b5281-175f-4d51-aef2-59840dbd3828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.792468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b5281-175f-4d51-aef2-59840dbd3828 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.793126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b5281-175f-4d51-aef2-59840dbd3828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.795206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b5281-175f-4d51-aef2-59840dbd3828 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.805105 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1298/2589] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:34 2022] PUT /identity/v3/projects/19a10fbeaf0245bca9f0aff7f55941f9/users/d5f14609ab9d4f5b94d47c43df9f4f01/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:34.808928 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1292/2590] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:34.811819 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84392951-b34f-41a7-a5d4-5ba237731152 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.815442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226543d-6bee-4e78-bc7d-43047d13eff2 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.815729 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226543d-6bee-4e78-bc7d-43047d13eff2 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.816001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226543d-6bee-4e78-bc7d-43047d13eff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.845754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-6226543d-6bee-4e78-bc7d-43047d13eff2 None None] MFA Rules not processed for user `d5f14609ab9d4f5b94d47c43df9f4f01`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:34.847132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6226543d-6bee-4e78-bc7d-43047d13eff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:34.850949 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:34.875913 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84392951-b34f-41a7-a5d4-5ba237731152 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.880755 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff2942-a553-4a7f-88fb-2bd15579f4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.881421 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff2942-a553-4a7f-88fb-2bd15579f4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.881696 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff2942-a553-4a7f-88fb-2bd15579f4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.881968 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff2942-a553-4a7f-88fb-2bd15579f4c9 admin admin] PATH_INFO: `/v3/projects/8ce520227017484da08bd8acc6040c2f/users/fa63dfff9f3d4ff7b2401a20d7e23073/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.883946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff2942-a553-4a7f-88fb-2bd15579f4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce520227017484da08bd8acc6040c2f, user_id=fa63dfff9f3d4ff7b2401a20d7e23073, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.886603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff2942-a553-4a7f-88fb-2bd15579f4c9 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:34.897208 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1299/2591] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:34 2022] PUT /identity/v3/projects/8ce520227017484da08bd8acc6040c2f/users/fa63dfff9f3d4ff7b2401a20d7e23073/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:34.907574 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85b709-60e5-4657-b3fc-0b2ff703c05f None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.908094 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85b709-60e5-4657-b3fc-0b2ff703c05f None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.908378 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85b709-60e5-4657-b3fc-0b2ff703c05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.917817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1293/2592] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:37:34.922376 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226543d-6bee-4e78-bc7d-43047d13eff2 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:34.932843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226543d-6bee-4e78-bc7d-43047d13eff2 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:34.938151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-cb85b709-60e5-4657-b3fc-0b2ff703c05f None None] MFA Rules not processed for user `fa63dfff9f3d4ff7b2401a20d7e23073`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:34.939374 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cb85b709-60e5-4657-b3fc-0b2ff703c05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:34.945095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:34.991991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82b03f-3bea-44a3-b83d-3a82db01ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:34.992748 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82b03f-3bea-44a3-b83d-3a82db01ee56 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:34.993030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82b03f-3bea-44a3-b83d-3a82db01ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:34.993343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82b03f-3bea-44a3-b83d-3a82db01ee56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:34.993971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82b03f-3bea-44a3-b83d-3a82db01ee56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:34.995919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82b03f-3bea-44a3-b83d-3a82db01ee56 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:35.010241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1300/2593] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:37:35.022093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85b709-60e5-4657-b3fc-0b2ff703c05f None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:35.023601 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cb85b709-60e5-4657-b3fc-0b2ff703c05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:35.024226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1294/2594] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:34 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:37:35.028643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82b03f-3bea-44a3-b83d-3a82db01ee56 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:35.084839 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85b709-60e5-4657-b3fc-0b2ff703c05f None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:35.100794 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82b03f-3bea-44a3-b83d-3a82db01ee56 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:35.105649 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef85a0-da31-42d2-a116-3832226bcac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:35.106261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef85a0-da31-42d2-a116-3832226bcac3 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:35.106682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef85a0-da31-42d2-a116-3832226bcac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:35.107183 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef85a0-da31-42d2-a116-3832226bcac3 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:35.108065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef85a0-da31-42d2-a116-3832226bcac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:35.110053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef85a0-da31-42d2-a116-3832226bcac3 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:35.135281 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1295/2595] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:35 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:37:35.136380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef85a0-da31-42d2-a116-3832226bcac3 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:35.146509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c6545-3395-4cf4-935e-4d5690001aaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:35.146912 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef85a0-da31-42d2-a116-3832226bcac3 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:35.147156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c6545-3395-4cf4-935e-4d5690001aaf service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:35.147428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c6545-3395-4cf4-935e-4d5690001aaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:35.147719 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c6545-3395-4cf4-935e-4d5690001aaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:35.151558 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802afb86-3fdb-4c8b-9cd0-f8c37d078098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:35.152143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802afb86-3fdb-4c8b-9cd0-f8c37d078098 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:35.152427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802afb86-3fdb-4c8b-9cd0-f8c37d078098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:35.152698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802afb86-3fdb-4c8b-9cd0-f8c37d078098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:35.153339 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802afb86-3fdb-4c8b-9cd0-f8c37d078098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:35.155015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802afb86-3fdb-4c8b-9cd0-f8c37d078098 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:35.165221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1296/2596] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:37:35.171930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802afb86-3fdb-4c8b-9cd0-f8c37d078098 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:35.173408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:35.183137 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802afb86-3fdb-4c8b-9cd0-f8c37d078098 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:35.188151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeb88d-9baf-47e3-8fc7-28213fac2409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:35.188825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeb88d-9baf-47e3-8fc7-28213fac2409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:35.189096 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeb88d-9baf-47e3-8fc7-28213fac2409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:35.189362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeb88d-9baf-47e3-8fc7-28213fac2409 admin admin] PATH_INFO: `/v3/projects/c110b4b8a25b476ba66612490e54f33c/users/a101b85629de463a8f56297a2e5a2d06/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:35.206089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeeb88d-9baf-47e3-8fc7-28213fac2409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c110b4b8a25b476ba66612490e54f33c, user_id=a101b85629de463a8f56297a2e5a2d06, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:35.208854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeeb88d-9baf-47e3-8fc7-28213fac2409 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:35.214070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c6545-3395-4cf4-935e-4d5690001aaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:35.215790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c6545-3395-4cf4-935e-4d5690001aaf service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:35.222137 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1297/2597] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:35 2022] PUT /identity/v3/projects/c110b4b8a25b476ba66612490e54f33c/users/a101b85629de463a8f56297a2e5a2d06/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:35.226208 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeb88d-9baf-47e3-8fc7-28213fac2409 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:35.228533 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1301/2598] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:37:35.288961 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:35.293462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeb88d-9baf-47e3-8fc7-28213fac2409 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:35.299965 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b52c8-015a-4258-86ec-69f2841775e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:35.305728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b52c8-015a-4258-86ec-69f2841775e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:35.305728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b52c8-015a-4258-86ec-69f2841775e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:35.305728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b52c8-015a-4258-86ec-69f2841775e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:35.305728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b52c8-015a-4258-86ec-69f2841775e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:35.305728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b52c8-015a-4258-86ec-69f2841775e6 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:35.316823 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1298/2599] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:37:35.318597 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c6545-3395-4cf4-935e-4d5690001aaf service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:35.329937 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c6545-3395-4cf4-935e-4d5690001aaf service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:35.335241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd56b26-b2c2-4df0-8507-91cd5f7726b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:35.341841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd56b26-b2c2-4df0-8507-91cd5f7726b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:35.341841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd56b26-b2c2-4df0-8507-91cd5f7726b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:35.341841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd56b26-b2c2-4df0-8507-91cd5f7726b6 admin admin] PATH_INFO: `/v3/projects/c110b4b8a25b476ba66612490e54f33c/users/a101b85629de463a8f56297a2e5a2d06/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:35.341841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd56b26-b2c2-4df0-8507-91cd5f7726b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c110b4b8a25b476ba66612490e54f33c, user_id=a101b85629de463a8f56297a2e5a2d06, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:35.341841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd56b26-b2c2-4df0-8507-91cd5f7726b6 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:35.352812 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1302/2600] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:35 2022] PUT /identity/v3/projects/c110b4b8a25b476ba66612490e54f33c/users/a101b85629de463a8f56297a2e5a2d06/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:37:35.363628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be73a31-1517-45bd-a71b-bac9fccc1401 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:35.363917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be73a31-1517-45bd-a71b-bac9fccc1401 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:35.364268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be73a31-1517-45bd-a71b-bac9fccc1401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:35.396204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-1be73a31-1517-45bd-a71b-bac9fccc1401 None None] MFA Rules not processed for user `a101b85629de463a8f56297a2e5a2d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:35.397415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-1be73a31-1517-45bd-a71b-bac9fccc1401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:35.472608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1299/2601] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:37:35.491909 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd56b26-b2c2-4df0-8507-91cd5f7726b6 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:35.550338 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd56b26-b2c2-4df0-8507-91cd5f7726b6 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:35.553932 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19cb82-e97f-48f2-8e1a-33f9150f2ca8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:35.554526 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19cb82-e97f-48f2-8e1a-33f9150f2ca8 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:35.554798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19cb82-e97f-48f2-8e1a-33f9150f2ca8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:35.555098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19cb82-e97f-48f2-8e1a-33f9150f2ca8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:35.564851 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19cb82-e97f-48f2-8e1a-33f9150f2ca8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:35.566293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19cb82-e97f-48f2-8e1a-33f9150f2ca8 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:35.576713 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1303/2602] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:35.622474 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be73a31-1517-45bd-a71b-bac9fccc1401 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:35.632866 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be73a31-1517-45bd-a71b-bac9fccc1401 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:35.636801 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262efd0-edf4-4111-b943-95e177e0d1dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:35.637482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262efd0-edf4-4111-b943-95e177e0d1dd service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:35.637824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262efd0-edf4-4111-b943-95e177e0d1dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:35.638296 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262efd0-edf4-4111-b943-95e177e0d1dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:35.701527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262efd0-edf4-4111-b943-95e177e0d1dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:35.703043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262efd0-edf4-4111-b943-95e177e0d1dd service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:35.713415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1300/2603] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:36.680272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19cb82-e97f-48f2-8e1a-33f9150f2ca8 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:36.752108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19cb82-e97f-48f2-8e1a-33f9150f2ca8 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:36.757056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800243f3-3461-4235-a5c2-a1869ce5d2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:36.757681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800243f3-3461-4235-a5c2-a1869ce5d2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:36.757964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800243f3-3461-4235-a5c2-a1869ce5d2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:36.758240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800243f3-3461-4235-a5c2-a1869ce5d2cb admin admin] PATH_INFO: `/v3/users/6ff56c605c594055af15df832e201801` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:36.759434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800243f3-3461-4235-a5c2-a1869ce5d2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ff56c605c594055af15df832e201801)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:36.761373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800243f3-3461-4235-a5c2-a1869ce5d2cb admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:36.809879 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-800243f3-3461-4235-a5c2-a1869ce5d2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ff56c605c594055af15df832e201801'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:36.814181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:36.823642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-800243f3-3461-4235-a5c2-a1869ce5d2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ff56c605c594055af15df832e201801'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:36.832444 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-800243f3-3461-4235-a5c2-a1869ce5d2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ff56c605c594055af15df832e201801'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:36.833105 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-800243f3-3461-4235-a5c2-a1869ce5d2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ff56c605c594055af15df832e201801'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:36.833701 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-800243f3-3461-4235-a5c2-a1869ce5d2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ff56c605c594055af15df832e201801'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:36.845830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1304/2604] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:36 2022] DELETE /identity/v3/users/6ff56c605c594055af15df832e201801 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:36.850440 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf6013-7506-445e-9c4d-33c6ce258a15 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:36.850949 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf6013-7506-445e-9c4d-33c6ce258a15 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:36.851067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf6013-7506-445e-9c4d-33c6ce258a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:36.871511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-33bf6013-7506-445e-9c4d-33c6ce258a15 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:36.872719 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-33bf6013-7506-445e-9c4d-33c6ce258a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:36.942373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1301/2605] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:36.952437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800243f3-3461-4235-a5c2-a1869ce5d2cb admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:36.953901 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-800243f3-3461-4235-a5c2-a1869ce5d2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:37.017543 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800243f3-3461-4235-a5c2-a1869ce5d2cb admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:37.021454 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0ca90-1939-4b78-9805-403241056054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:37.022129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0ca90-1939-4b78-9805-403241056054 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:37.022406 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0ca90-1939-4b78-9805-403241056054 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:37.022679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0ca90-1939-4b78-9805-403241056054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:37.032528 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0ca90-1939-4b78-9805-403241056054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:37.033983 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0ca90-1939-4b78-9805-403241056054 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:37.044323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1305/2606] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:37.340590 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf6013-7506-445e-9c4d-33c6ce258a15 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:37.342046 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-33bf6013-7506-445e-9c4d-33c6ce258a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:37.355072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf6013-7506-445e-9c4d-33c6ce258a15 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:37.365804 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:37.366453 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:37.366731 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:37.367036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] PATH_INFO: `/v3/projects/8477713bd00049829f5f230a2fb16f21` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:37.368172 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8477713bd00049829f5f230a2fb16f21)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:37.370140 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:37.382714 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=100 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:37.435306 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8477713bd00049829f5f230a2fb16f21', 'request_id': 'req-3bf4f351-2f17-4a17-8fdb-7eb457754d29'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:37.443715 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8477713bd00049829f5f230a2fb16f21', 'request_id': 'req-3bf4f351-2f17-4a17-8fdb-7eb457754d29'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:37.449964 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8477713bd00049829f5f230a2fb16f21', 'request_id': 'req-3bf4f351-2f17-4a17-8fdb-7eb457754d29'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:37.467122 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] The token cache is being invalidate because project 8477713bd00049829f5f230a2fb16f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:37.467455 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:37.468170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:37.469927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1302/2607] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:37 2022] DELETE /identity/v3/projects/8477713bd00049829f5f230a2fb16f21 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:37.473978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0ca90-1939-4b78-9805-403241056054 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:37.483967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0ca90-1939-4b78-9805-403241056054 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:37.546587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6a977-7d6f-4613-b66b-4a7ce5198090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:37.547579 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6a977-7d6f-4613-b66b-4a7ce5198090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:37.547723 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6a977-7d6f-4613-b66b-4a7ce5198090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:37.547975 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6a977-7d6f-4613-b66b-4a7ce5198090 admin admin] PATH_INFO: `/v3/users/fa63dfff9f3d4ff7b2401a20d7e23073` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:37.549460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6a977-7d6f-4613-b66b-4a7ce5198090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa63dfff9f3d4ff7b2401a20d7e23073)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:37.551485 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6a977-7d6f-4613-b66b-4a7ce5198090 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:37.600272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-dfb6a977-7d6f-4613-b66b-4a7ce5198090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa63dfff9f3d4ff7b2401a20d7e23073'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:37.612418 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-dfb6a977-7d6f-4613-b66b-4a7ce5198090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa63dfff9f3d4ff7b2401a20d7e23073'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:37.621970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-dfb6a977-7d6f-4613-b66b-4a7ce5198090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa63dfff9f3d4ff7b2401a20d7e23073'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:37.622609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-dfb6a977-7d6f-4613-b66b-4a7ce5198090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa63dfff9f3d4ff7b2401a20d7e23073'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:37.623261 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-dfb6a977-7d6f-4613-b66b-4a7ce5198090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa63dfff9f3d4ff7b2401a20d7e23073'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:37.625267 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:37.636772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1306/2608] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:37 2022] DELETE /identity/v3/users/fa63dfff9f3d4ff7b2401a20d7e23073 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:37.936019 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:37.937503 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:37.954109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4f351-2f17-4a17-8fdb-7eb457754d29 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:38.020383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cdbd7-c056-4c95-95f0-52a2a9626551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:38.021022 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cdbd7-c056-4c95-95f0-52a2a9626551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:38.021348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cdbd7-c056-4c95-95f0-52a2a9626551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:38.021624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cdbd7-c056-4c95-95f0-52a2a9626551 admin admin] PATH_INFO: `/v3/projects/8ce520227017484da08bd8acc6040c2f` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:38.022752 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cdbd7-c056-4c95-95f0-52a2a9626551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce520227017484da08bd8acc6040c2f)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:38.024738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cdbd7-c056-4c95-95f0-52a2a9626551 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:38.081342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fe1cdbd7-c056-4c95-95f0-52a2a9626551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce520227017484da08bd8acc6040c2f', 'request_id': 'req-fe1cdbd7-c056-4c95-95f0-52a2a9626551'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:38.091034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fe1cdbd7-c056-4c95-95f0-52a2a9626551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce520227017484da08bd8acc6040c2f', 'request_id': 'req-fe1cdbd7-c056-4c95-95f0-52a2a9626551'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:38.097973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fe1cdbd7-c056-4c95-95f0-52a2a9626551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce520227017484da08bd8acc6040c2f', 'request_id': 'req-fe1cdbd7-c056-4c95-95f0-52a2a9626551'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:38.111301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fe1cdbd7-c056-4c95-95f0-52a2a9626551 admin admin] The token cache is being invalidate because project 8ce520227017484da08bd8acc6040c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:38.111611 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fe1cdbd7-c056-4c95-95f0-52a2a9626551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:38.112337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-fe1cdbd7-c056-4c95-95f0-52a2a9626551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:38.113977 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1303/2609] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:37 2022] DELETE /identity/v3/projects/8ce520227017484da08bd8acc6040c2f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:38.119385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c792f-e819-4f29-b7c6-097f2ff4fa90 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:38.119952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c792f-e819-4f29-b7c6-097f2ff4fa90 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:38.119952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c792f-e819-4f29-b7c6-097f2ff4fa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:38.140120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-fb3c792f-e819-4f29-b7c6-097f2ff4fa90 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:38.141314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-fb3c792f-e819-4f29-b7c6-097f2ff4fa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:38.215766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1307/2610] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:38.227556 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03120717-fe83-45ab-9118-de3b1dc38ff3 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:38.227889 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03120717-fe83-45ab-9118-de3b1dc38ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:38.228253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03120717-fe83-45ab-9118-de3b1dc38ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:38.251107 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-03120717-fe83-45ab-9118-de3b1dc38ff3 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:38.252331 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-03120717-fe83-45ab-9118-de3b1dc38ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:38.261707 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1304/2611] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:38.266557 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c792f-e819-4f29-b7c6-097f2ff4fa90 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:38.276994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c792f-e819-4f29-b7c6-097f2ff4fa90 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:38.282317 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c931e17-2480-4bd1-8b60-d24adac7c679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:38.282957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c931e17-2480-4bd1-8b60-d24adac7c679 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:38.283298 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c931e17-2480-4bd1-8b60-d24adac7c679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:38.283560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c931e17-2480-4bd1-8b60-d24adac7c679 admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:38.284212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c931e17-2480-4bd1-8b60-d24adac7c679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:37:38.284489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c931e17-2480-4bd1-8b60-d24adac7c679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:38.286124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c931e17-2480-4bd1-8b60-d24adac7c679 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:38.298662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1308/2612] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:37:38.303110 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03120717-fe83-45ab-9118-de3b1dc38ff3 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:38.316110 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03120717-fe83-45ab-9118-de3b1dc38ff3 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:38.322666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899f22-0c7f-4e8c-b047-a768ca25e045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:38.323458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899f22-0c7f-4e8c-b047-a768ca25e045 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:38.323738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899f22-0c7f-4e8c-b047-a768ca25e045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:38.324061 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899f22-0c7f-4e8c-b047-a768ca25e045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:38.324843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10899f22-0c7f-4e8c-b047-a768ca25e045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:38.327313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10899f22-0c7f-4e8c-b047-a768ca25e045 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:38.358877 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1305/2613] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:38 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:38.363266 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c931e17-2480-4bd1-8b60-d24adac7c679 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:38.373881 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c931e17-2480-4bd1-8b60-d24adac7c679 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:38.432914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f7901-4b55-4eff-bc29-8ea353a2ab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:38.433550 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7901-4b55-4eff-bc29-8ea353a2ab95 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:38.433831 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7901-4b55-4eff-bc29-8ea353a2ab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:38.434099 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7901-4b55-4eff-bc29-8ea353a2ab95 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:38.434725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f7901-4b55-4eff-bc29-8ea353a2ab95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:38.436788 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f7901-4b55-4eff-bc29-8ea353a2ab95 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:38.459535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1309/2614] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:38 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:37:38.464427 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899f22-0c7f-4e8c-b047-a768ca25e045 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:38.470492 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:38.480588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899f22-0c7f-4e8c-b047-a768ca25e045 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:38.489963 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898692d-06bd-4232-896f-8c07934e2926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:38.490636 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898692d-06bd-4232-896f-8c07934e2926 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:38.491036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898692d-06bd-4232-896f-8c07934e2926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:38.491468 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898692d-06bd-4232-896f-8c07934e2926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:38.492317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898692d-06bd-4232-896f-8c07934e2926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:38.494874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898692d-06bd-4232-896f-8c07934e2926 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:38.507707 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1306/2615] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:38.511910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f7901-4b55-4eff-bc29-8ea353a2ab95 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:38.523304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f7901-4b55-4eff-bc29-8ea353a2ab95 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:38.529013 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb592a69-9216-40ae-8f7a-657907c1c3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:38.529607 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb592a69-9216-40ae-8f7a-657907c1c3bf admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:38.529921 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb592a69-9216-40ae-8f7a-657907c1c3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:38.530221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb592a69-9216-40ae-8f7a-657907c1c3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:38.530859 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb592a69-9216-40ae-8f7a-657907c1c3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:38.532482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb592a69-9216-40ae-8f7a-657907c1c3bf admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:38.544677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1310/2616] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:38.549401 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898692d-06bd-4232-896f-8c07934e2926 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:38.561600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898692d-06bd-4232-896f-8c07934e2926 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:38.566989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a1a0-96c4-4f4f-bd47-2a575efeaba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:38.567633 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a1a0-96c4-4f4f-bd47-2a575efeaba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:38.567913 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a1a0-96c4-4f4f-bd47-2a575efeaba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:38.568179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a1a0-96c4-4f4f-bd47-2a575efeaba9 admin admin] PATH_INFO: `/v3/projects/441873cc6bc34bb4816a7555f84d5a7e/users/a861774e826343ffbbf416c831056967/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:38.584970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310a1a0-96c4-4f4f-bd47-2a575efeaba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=441873cc6bc34bb4816a7555f84d5a7e, user_id=a861774e826343ffbbf416c831056967, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:38.587685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310a1a0-96c4-4f4f-bd47-2a575efeaba9 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:38.602580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1307/2617] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:38 2022] PUT /identity/v3/projects/441873cc6bc34bb4816a7555f84d5a7e/users/a861774e826343ffbbf416c831056967/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:38.614688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aea010-b87b-4efb-bcdc-89e56a66bb33 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:38.614999 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aea010-b87b-4efb-bcdc-89e56a66bb33 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:38.615297 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aea010-b87b-4efb-bcdc-89e56a66bb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:38.644154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-02aea010-b87b-4efb-bcdc-89e56a66bb33 None None] MFA Rules not processed for user `a861774e826343ffbbf416c831056967`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:38.645966 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-02aea010-b87b-4efb-bcdc-89e56a66bb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:38.676177 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a1a0-96c4-4f4f-bd47-2a575efeaba9 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:38.677891 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-5310a1a0-96c4-4f4f-bd47-2a575efeaba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:38.693665 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:38.714893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1311/2618] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:38.719850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aea010-b87b-4efb-bcdc-89e56a66bb33 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:38.748784 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a1a0-96c4-4f4f-bd47-2a575efeaba9 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:38.753755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882b6a6-f6d2-4260-8c3e-990983d112d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:38.754391 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882b6a6-f6d2-4260-8c3e-990983d112d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:38.754666 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882b6a6-f6d2-4260-8c3e-990983d112d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:38.755045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882b6a6-f6d2-4260-8c3e-990983d112d5 admin admin] PATH_INFO: `/v3/users/f7e2a15ec46947fcaa1234cfa3eb77c7` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:38.756249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882b6a6-f6d2-4260-8c3e-990983d112d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e2a15ec46947fcaa1234cfa3eb77c7)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:38.758259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882b6a6-f6d2-4260-8c3e-990983d112d5 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:38.781869 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aea010-b87b-4efb-bcdc-89e56a66bb33 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:38.788425 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d746a-c853-479b-9f68-888fcbd96e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:38.789546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d746a-c853-479b-9f68-888fcbd96e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:38.789808 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d746a-c853-479b-9f68-888fcbd96e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:38.790118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d746a-c853-479b-9f68-888fcbd96e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:38.790773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d746a-c853-479b-9f68-888fcbd96e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:38.792828 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d746a-c853-479b-9f68-888fcbd96e07 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:38.805295 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-1882b6a6-f6d2-4260-8c3e-990983d112d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e2a15ec46947fcaa1234cfa3eb77c7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:38.814231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-1882b6a6-f6d2-4260-8c3e-990983d112d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e2a15ec46947fcaa1234cfa3eb77c7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:38.814920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-1882b6a6-f6d2-4260-8c3e-990983d112d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e2a15ec46947fcaa1234cfa3eb77c7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:38.815590 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-1882b6a6-f6d2-4260-8c3e-990983d112d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e2a15ec46947fcaa1234cfa3eb77c7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:38.823137 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1312/2619] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:38 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:37:38.827689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d746a-c853-479b-9f68-888fcbd96e07 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:38.828463 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-1882b6a6-f6d2-4260-8c3e-990983d112d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e2a15ec46947fcaa1234cfa3eb77c7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:38.829411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0a6d746a-c853-479b-9f68-888fcbd96e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:38.841356 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1308/2620] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:38 2022] DELETE /identity/v3/users/f7e2a15ec46947fcaa1234cfa3eb77c7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:38.845852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a00069-0d9a-4f1a-812c-586c389bc015 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:38.846135 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a00069-0d9a-4f1a-812c-586c389bc015 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:38.846409 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a00069-0d9a-4f1a-812c-586c389bc015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:38.865694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-59a00069-0d9a-4f1a-812c-586c389bc015 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:38.866922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-59a00069-0d9a-4f1a-812c-586c389bc015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:38.902686 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d746a-c853-479b-9f68-888fcbd96e07 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:38.909055 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:38.929202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1309/2621] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:37:38.938760 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a00069-0d9a-4f1a-812c-586c389bc015 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:38.940308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-59a00069-0d9a-4f1a-812c-586c389bc015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:38.963377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f9e66-2738-49e3-8a52-5275db892815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:38.964017 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f9e66-2738-49e3-8a52-5275db892815 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:38.964294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f9e66-2738-49e3-8a52-5275db892815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:38.964559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f9e66-2738-49e3-8a52-5275db892815 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:38.965180 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f9e66-2738-49e3-8a52-5275db892815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:38.967195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f9e66-2738-49e3-8a52-5275db892815 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:38.992468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1313/2622] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:38 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:37:38.996202 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f9e66-2738-49e3-8a52-5275db892815 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:38.999802 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a00069-0d9a-4f1a-812c-586c389bc015 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:39.003367 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79595233-9fc9-444d-be0f-777b5c94f9fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:39.003953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79595233-9fc9-444d-be0f-777b5c94f9fe service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:39.004221 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79595233-9fc9-444d-be0f-777b5c94f9fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:39.004499 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79595233-9fc9-444d-be0f-777b5c94f9fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:39.007243 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f9e66-2738-49e3-8a52-5275db892815 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:39.012079 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529415f-20d1-427a-b461-5bd8a935b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:39.012672 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529415f-20d1-427a-b461-5bd8a935b5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:39.012950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529415f-20d1-427a-b461-5bd8a935b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:39.013220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529415f-20d1-427a-b461-5bd8a935b5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:39.013781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79595233-9fc9-444d-be0f-777b5c94f9fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:39.013887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529415f-20d1-427a-b461-5bd8a935b5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:39.015372 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79595233-9fc9-444d-be0f-777b5c94f9fe service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:39.015606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529415f-20d1-427a-b461-5bd8a935b5e6 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:39.017937 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:39.025147 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1310/2623] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:37:39.030325 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1314/2624] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:39.031429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79595233-9fc9-444d-be0f-777b5c94f9fe service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:39.041236 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79595233-9fc9-444d-be0f-777b5c94f9fe service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:39.046364 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819c93c-15ad-4f64-af02-40f39ac6f881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:39.046993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819c93c-15ad-4f64-af02-40f39ac6f881 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:39.047265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819c93c-15ad-4f64-af02-40f39ac6f881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:39.047529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819c93c-15ad-4f64-af02-40f39ac6f881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:39.048160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819c93c-15ad-4f64-af02-40f39ac6f881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:39.049747 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819c93c-15ad-4f64-af02-40f39ac6f881 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:39.060042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1311/2625] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:39.064283 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529415f-20d1-427a-b461-5bd8a935b5e6 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:39.074710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529415f-20d1-427a-b461-5bd8a935b5e6 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:39.080056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5099e-abe0-4fbc-a5fc-00b0113dc513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:39.080236 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5099e-abe0-4fbc-a5fc-00b0113dc513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:39.080793 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5099e-abe0-4fbc-a5fc-00b0113dc513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:39.081063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5099e-abe0-4fbc-a5fc-00b0113dc513 admin admin] PATH_INFO: `/v3/projects/cec901a29a36490a9fcaf0f27dd44171/users/7c42d86ff98247fea9c19e199dea41bf/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:39.097257 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5099e-abe0-4fbc-a5fc-00b0113dc513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec901a29a36490a9fcaf0f27dd44171, user_id=7c42d86ff98247fea9c19e199dea41bf, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:39.099935 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5099e-abe0-4fbc-a5fc-00b0113dc513 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:39.122590 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1315/2626] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:39 2022] PUT /identity/v3/projects/cec901a29a36490a9fcaf0f27dd44171/users/7c42d86ff98247fea9c19e199dea41bf/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:39.134460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16888d-76f7-4122-a66e-573059dab1d7 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:39.135826 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16888d-76f7-4122-a66e-573059dab1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:39.135826 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16888d-76f7-4122-a66e-573059dab1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:39.164839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-6a16888d-76f7-4122-a66e-573059dab1d7 None None] MFA Rules not processed for user `7c42d86ff98247fea9c19e199dea41bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:39.166004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6a16888d-76f7-4122-a66e-573059dab1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:39.239481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1312/2627] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:37:39.244133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5099e-abe0-4fbc-a5fc-00b0113dc513 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:39.315046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5099e-abe0-4fbc-a5fc-00b0113dc513 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:39.322731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f938e-a0df-41eb-a170-4ff3b251e185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:39.323664 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f938e-a0df-41eb-a170-4ff3b251e185 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:39.324091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f938e-a0df-41eb-a170-4ff3b251e185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:39.324488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f938e-a0df-41eb-a170-4ff3b251e185 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:39.325302 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f938e-a0df-41eb-a170-4ff3b251e185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:39.327611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f938e-a0df-41eb-a170-4ff3b251e185 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:39.333812 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16888d-76f7-4122-a66e-573059dab1d7 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:39.335304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6a16888d-76f7-4122-a66e-573059dab1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:39.356539 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16888d-76f7-4122-a66e-573059dab1d7 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:39.363243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:39.364084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:39.364340 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:39.364623 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] PATH_INFO: `/v3/projects/097144a125d8441c8cd19d666b087912` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:39.365872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=097144a125d8441c8cd19d666b087912)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:39.369331 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1316/2628] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:39 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:37:39.369479 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:39.370312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f938e-a0df-41eb-a170-4ff3b251e185 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:39.425752 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097144a125d8441c8cd19d666b087912', 'request_id': 'req-61297547-88fb-4c02-a010-71ecf120b703'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:39.434368 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097144a125d8441c8cd19d666b087912', 'request_id': 'req-61297547-88fb-4c02-a010-71ecf120b703'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:39.437168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f938e-a0df-41eb-a170-4ff3b251e185 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:39.439635 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:39.440787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097144a125d8441c8cd19d666b087912', 'request_id': 'req-61297547-88fb-4c02-a010-71ecf120b703'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:39.454463 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] The token cache is being invalidate because project 097144a125d8441c8cd19d666b087912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:39.454751 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:39.455852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:39.457410 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1313/2629] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:39 2022] DELETE /identity/v3/projects/097144a125d8441c8cd19d666b087912 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:37:39.468825 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:39.470426 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:39.495956 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bd243-cf5d-4580-a149-37986d1ae0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:39.496568 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bd243-cf5d-4580-a149-37986d1ae0cd admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:39.496845 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bd243-cf5d-4580-a149-37986d1ae0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:39.497195 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bd243-cf5d-4580-a149-37986d1ae0cd admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:39.497807 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bd243-cf5d-4580-a149-37986d1ae0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:39.499876 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bd243-cf5d-4580-a149-37986d1ae0cd admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:39.511275 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:39.522951 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1317/2630] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:39 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:39.526723 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bd243-cf5d-4580-a149-37986d1ae0cd admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:39.528494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-2b3bd243-cf5d-4580-a149-37986d1ae0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:39.537679 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61297547-88fb-4c02-a010-71ecf120b703 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:39.540157 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bd243-cf5d-4580-a149-37986d1ae0cd admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:39.542261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cef1c-7487-4fa2-8542-f4fd784b4308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:39.542917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cef1c-7487-4fa2-8542-f4fd784b4308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:39.543191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cef1c-7487-4fa2-8542-f4fd784b4308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:39.543459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cef1c-7487-4fa2-8542-f4fd784b4308 admin admin] PATH_INFO: `/v3/users/d5f14609ab9d4f5b94d47c43df9f4f01` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:39.544870 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cef1c-7487-4fa2-8542-f4fd784b4308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f14609ab9d4f5b94d47c43df9f4f01)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:39.545534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bbeb3-99f0-478d-b4b4-ec7e87db8ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:39.546122 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bbeb3-99f0-478d-b4b4-ec7e87db8ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:39.546395 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bbeb3-99f0-478d-b4b4-ec7e87db8ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:39.546659 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bbeb3-99f0-478d-b4b4-ec7e87db8ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:39.546985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cef1c-7487-4fa2-8542-f4fd784b4308 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:39.547333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bbeb3-99f0-478d-b4b4-ec7e87db8ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:39.548936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bbeb3-99f0-478d-b4b4-ec7e87db8ca8 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:39.562046 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1318/2631] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:39.563142 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bbeb3-99f0-478d-b4b4-ec7e87db8ca8 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:39.574499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bbeb3-99f0-478d-b4b4-ec7e87db8ca8 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:39.579314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28948d7-7041-41c9-8c07-05d953283e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:39.579960 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28948d7-7041-41c9-8c07-05d953283e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:39.580241 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28948d7-7041-41c9-8c07-05d953283e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:39.580925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28948d7-7041-41c9-8c07-05d953283e7d admin admin] PATH_INFO: `/v3/projects/0296cabf90274a50947bda793dc22821/users/0e2a90e2798740f68752e0dc25db17e8/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:39.595974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28948d7-7041-41c9-8c07-05d953283e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0296cabf90274a50947bda793dc22821, user_id=0e2a90e2798740f68752e0dc25db17e8, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:39.596846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-599cef1c-7487-4fa2-8542-f4fd784b4308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f14609ab9d4f5b94d47c43df9f4f01'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:39.598642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28948d7-7041-41c9-8c07-05d953283e7d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:39.605664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-599cef1c-7487-4fa2-8542-f4fd784b4308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f14609ab9d4f5b94d47c43df9f4f01'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:39.606343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-599cef1c-7487-4fa2-8542-f4fd784b4308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f14609ab9d4f5b94d47c43df9f4f01'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:39.607045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-599cef1c-7487-4fa2-8542-f4fd784b4308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f14609ab9d4f5b94d47c43df9f4f01'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:39.612594 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1319/2632] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:39 2022] PUT /identity/v3/projects/0296cabf90274a50947bda793dc22821/users/0e2a90e2798740f68752e0dc25db17e8/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:37:39.616419 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28948d7-7041-41c9-8c07-05d953283e7d admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:39.618155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f28948d7-7041-41c9-8c07-05d953283e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:39.622017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-599cef1c-7487-4fa2-8542-f4fd784b4308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f14609ab9d4f5b94d47c43df9f4f01'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:39.634923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1314/2633] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:39 2022] DELETE /identity/v3/users/d5f14609ab9d4f5b94d47c43df9f4f01 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:37:39.687285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28948d7-7041-41c9-8c07-05d953283e7d admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:39.746898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f160da-61e8-4498-a3d7-fb8a845fa5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:39.747511 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f160da-61e8-4498-a3d7-fb8a845fa5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:39.747787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f160da-61e8-4498-a3d7-fb8a845fa5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:39.748056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f160da-61e8-4498-a3d7-fb8a845fa5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:39.748759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f160da-61e8-4498-a3d7-fb8a845fa5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:39.750468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f160da-61e8-4498-a3d7-fb8a845fa5a0 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:39.762961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1320/2634] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:37:39.767301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cef1c-7487-4fa2-8542-f4fd784b4308 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:39.777795 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cef1c-7487-4fa2-8542-f4fd784b4308 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:39.782692 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4112f3-607b-4415-8fc4-b1604ef1431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:39.783429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4112f3-607b-4415-8fc4-b1604ef1431f admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:39.783709 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4112f3-607b-4415-8fc4-b1604ef1431f admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:39.783982 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4112f3-607b-4415-8fc4-b1604ef1431f admin admin] PATH_INFO: `/v3/projects/0296cabf90274a50947bda793dc22821/users/0e2a90e2798740f68752e0dc25db17e8/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:39.785982 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4112f3-607b-4415-8fc4-b1604ef1431f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0296cabf90274a50947bda793dc22821, user_id=0e2a90e2798740f68752e0dc25db17e8, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:39.789349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4112f3-607b-4415-8fc4-b1604ef1431f admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:39.801794 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1315/2635] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:39 2022] PUT /identity/v3/projects/0296cabf90274a50947bda793dc22821/users/0e2a90e2798740f68752e0dc25db17e8/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:39.812310 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345f087-88bd-42a9-9bba-5005b5126482 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:39.812588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345f087-88bd-42a9-9bba-5005b5126482 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:39.812863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345f087-88bd-42a9-9bba-5005b5126482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:39.841848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-e345f087-88bd-42a9-9bba-5005b5126482 None None] MFA Rules not processed for user `0e2a90e2798740f68752e0dc25db17e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:39.843188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e345f087-88bd-42a9-9bba-5005b5126482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:39.894776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:39.917675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4112f3-607b-4415-8fc4-b1604ef1431f admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:39.920298 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1321/2636] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:39.920804 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-5c4112f3-607b-4415-8fc4-b1604ef1431f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:39.932974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345f087-88bd-42a9-9bba-5005b5126482 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:39.934710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e345f087-88bd-42a9-9bba-5005b5126482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:39.995608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:39.997556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345f087-88bd-42a9-9bba-5005b5126482 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:39.999737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4112f3-607b-4415-8fc4-b1604ef1431f admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:40.002254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeedf6-60fd-4e5a-834a-604ebf79912c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:40.002974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeedf6-60fd-4e5a-834a-604ebf79912c service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:40.003430 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeedf6-60fd-4e5a-834a-604ebf79912c service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:40.003710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeedf6-60fd-4e5a-834a-604ebf79912c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:40.005655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:40.006755 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:40.007318 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:40.007645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] PATH_INFO: `/v3/projects/19a10fbeaf0245bca9f0aff7f55941f9` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:40.009064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a10fbeaf0245bca9f0aff7f55941f9)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:40.011921 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:40.013560 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aeedf6-60fd-4e5a-834a-604ebf79912c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:40.015050 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aeedf6-60fd-4e5a-834a-604ebf79912c service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:40.025038 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1322/2637] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:40.071555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a10fbeaf0245bca9f0aff7f55941f9', 'request_id': 'req-c8900aae-fcbd-4db2-b336-2784fce04a74'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.081288 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a10fbeaf0245bca9f0aff7f55941f9', 'request_id': 'req-c8900aae-fcbd-4db2-b336-2784fce04a74'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.087941 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a10fbeaf0245bca9f0aff7f55941f9', 'request_id': 'req-c8900aae-fcbd-4db2-b336-2784fce04a74'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.100690 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] The token cache is being invalidate because project 19a10fbeaf0245bca9f0aff7f55941f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:40.100986 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.101662 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.103184 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1316/2638] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:39 2022] DELETE /identity/v3/projects/19a10fbeaf0245bca9f0aff7f55941f9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:40.107134 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeedf6-60fd-4e5a-834a-604ebf79912c service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:40.119230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeedf6-60fd-4e5a-834a-604ebf79912c service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:40.187894 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df52907-e9b1-41d3-84e4-3087e24bd726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:40.188540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df52907-e9b1-41d3-84e4-3087e24bd726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:40.188817 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df52907-e9b1-41d3-84e4-3087e24bd726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:40.189085 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df52907-e9b1-41d3-84e4-3087e24bd726 admin admin] PATH_INFO: `/v3/users/a101b85629de463a8f56297a2e5a2d06` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:40.190656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df52907-e9b1-41d3-84e4-3087e24bd726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a101b85629de463a8f56297a2e5a2d06)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:40.193154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df52907-e9b1-41d3-84e4-3087e24bd726 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:40.245786 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6df52907-e9b1-41d3-84e4-3087e24bd726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a101b85629de463a8f56297a2e5a2d06'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.258326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6df52907-e9b1-41d3-84e4-3087e24bd726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a101b85629de463a8f56297a2e5a2d06'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.267488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6df52907-e9b1-41d3-84e4-3087e24bd726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a101b85629de463a8f56297a2e5a2d06'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.268147 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6df52907-e9b1-41d3-84e4-3087e24bd726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a101b85629de463a8f56297a2e5a2d06'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.268801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-6df52907-e9b1-41d3-84e4-3087e24bd726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a101b85629de463a8f56297a2e5a2d06'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.281521 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1323/2639] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:40 2022] DELETE /identity/v3/users/a101b85629de463a8f56297a2e5a2d06 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:40.561536 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:40.562996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:40.581021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df52907-e9b1-41d3-84e4-3087e24bd726 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:40.582623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6df52907-e9b1-41d3-84e4-3087e24bd726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:40.600259 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:40.631362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8900aae-fcbd-4db2-b336-2784fce04a74 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:40.661809 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df52907-e9b1-41d3-84e4-3087e24bd726 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:40.667238 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:40.667888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:40.668158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:40.668424 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3 admin admin] PATH_INFO: `/v3/projects/c110b4b8a25b476ba66612490e54f33c` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:40.669586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c110b4b8a25b476ba66612490e54f33c)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:40.671546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:40.680003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b1731-5ea3-4e37-90b2-8004072ff2e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:40.680667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b1731-5ea3-4e37-90b2-8004072ff2e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:40.680984 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b1731-5ea3-4e37-90b2-8004072ff2e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:40.681216 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b1731-5ea3-4e37-90b2-8004072ff2e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:40.683297 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9a7b1731-5ea3-4e37-90b2-8004072ff2e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:40.719669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c110b4b8a25b476ba66612490e54f33c', 'request_id': 'req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.726120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c110b4b8a25b476ba66612490e54f33c', 'request_id': 'req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.735795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c110b4b8a25b476ba66612490e54f33c', 'request_id': 'req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.744014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b1731-5ea3-4e37-90b2-8004072ff2e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:40.745486 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b1731-5ea3-4e37-90b2-8004072ff2e5 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:40.748677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3 admin admin] The token cache is being invalidate because project c110b4b8a25b476ba66612490e54f33c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:40.748968 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.749317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:40.749796 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-2e02c067-5b9f-4c5c-93e7-7bca3015dae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:40.751481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1324/2640] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:40 2022] DELETE /identity/v3/projects/c110b4b8a25b476ba66612490e54f33c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:40.756193 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1317/2641] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:40.759089 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731c7c-47fe-401e-a7f5-ed0541bf2af0 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:40.759391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731c7c-47fe-401e-a7f5-ed0541bf2af0 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:40.759666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731c7c-47fe-401e-a7f5-ed0541bf2af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:40.779767 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-1f731c7c-47fe-401e-a7f5-ed0541bf2af0 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:40.780985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1f731c7c-47fe-401e-a7f5-ed0541bf2af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:40.841613 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1325/2642] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:37:40.912138 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341df4-8f1c-4fb4-b854-db2b118b78fb None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:40.912505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341df4-8f1c-4fb4-b854-db2b118b78fb None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:40.912855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341df4-8f1c-4fb4-b854-db2b118b78fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:40.934601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-58341df4-8f1c-4fb4-b854-db2b118b78fb None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:40.936052 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-58341df4-8f1c-4fb4-b854-db2b118b78fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:40.945131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1318/2643] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:37:40.949686 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f731c7c-47fe-401e-a7f5-ed0541bf2af0 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:40.959953 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f731c7c-47fe-401e-a7f5-ed0541bf2af0 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:40.965616 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad75481-d574-4ac4-aae8-6264223f49fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:40.966220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad75481-d574-4ac4-aae8-6264223f49fa admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:40.966488 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad75481-d574-4ac4-aae8-6264223f49fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:40.966757 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad75481-d574-4ac4-aae8-6264223f49fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:40.967554 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad75481-d574-4ac4-aae8-6264223f49fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:37:40.967870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad75481-d574-4ac4-aae8-6264223f49fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:40.969587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad75481-d574-4ac4-aae8-6264223f49fa admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:40.982248 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1326/2644] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:37:40.987557 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58341df4-8f1c-4fb4-b854-db2b118b78fb None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:41.005737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58341df4-8f1c-4fb4-b854-db2b118b78fb None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:41.016317 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e28f7c-d82a-4f8e-948a-9a8b4db0a896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:41.017334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e28f7c-d82a-4f8e-948a-9a8b4db0a896 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:41.018144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e28f7c-d82a-4f8e-948a-9a8b4db0a896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:41.019005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e28f7c-d82a-4f8e-948a-9a8b4db0a896 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:41.019730 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e28f7c-d82a-4f8e-948a-9a8b4db0a896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:41.021721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e28f7c-d82a-4f8e-948a-9a8b4db0a896 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:41.053622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1319/2645] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:40 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:41.058441 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad75481-d574-4ac4-aae8-6264223f49fa admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:41.069993 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad75481-d574-4ac4-aae8-6264223f49fa admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:41.099118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:41.132989 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e824bdc-34f2-44f9-a1fc-112a3e724b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:41.133626 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e824bdc-34f2-44f9-a1fc-112a3e724b77 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:41.133902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e824bdc-34f2-44f9-a1fc-112a3e724b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:41.134172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e824bdc-34f2-44f9-a1fc-112a3e724b77 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:41.134797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e824bdc-34f2-44f9-a1fc-112a3e724b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:41.136740 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e824bdc-34f2-44f9-a1fc-112a3e724b77 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:41.159386 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1327/2646] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:41 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:41.163798 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e28f7c-d82a-4f8e-948a-9a8b4db0a896 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:41.175243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e28f7c-d82a-4f8e-948a-9a8b4db0a896 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:41.181097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372b218-3774-4ba1-9af5-cddf15ab6ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:41.181729 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372b218-3774-4ba1-9af5-cddf15ab6ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:41.182002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372b218-3774-4ba1-9af5-cddf15ab6ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:41.182271 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372b218-3774-4ba1-9af5-cddf15ab6ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:41.182943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372b218-3774-4ba1-9af5-cddf15ab6ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:41.184550 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372b218-3774-4ba1-9af5-cddf15ab6ab4 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:41.194853 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1320/2647] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:41.199396 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e824bdc-34f2-44f9-a1fc-112a3e724b77 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:41.210393 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e824bdc-34f2-44f9-a1fc-112a3e724b77 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:41.215309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe341-bd79-4619-88c5-4b4960ad54b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:41.215903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe341-bd79-4619-88c5-4b4960ad54b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:41.216174 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe341-bd79-4619-88c5-4b4960ad54b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:41.216439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe341-bd79-4619-88c5-4b4960ad54b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:41.217070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fe341-bd79-4619-88c5-4b4960ad54b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:41.218692 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fe341-bd79-4619-88c5-4b4960ad54b0 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:41.229515 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1328/2648] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:41.234074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372b218-3774-4ba1-9af5-cddf15ab6ab4 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:41.244992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372b218-3774-4ba1-9af5-cddf15ab6ab4 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:41.250397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c5407-ed9c-4783-8d83-2b1358c85157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:41.251058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c5407-ed9c-4783-8d83-2b1358c85157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:41.251343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c5407-ed9c-4783-8d83-2b1358c85157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:41.251764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c5407-ed9c-4783-8d83-2b1358c85157 admin admin] PATH_INFO: `/v3/projects/30e50fb11cbe44fab72b2298c5e27eb5/users/de147a9de37b4cad98521a973e41effa/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:41.268343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c5407-ed9c-4783-8d83-2b1358c85157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e50fb11cbe44fab72b2298c5e27eb5, user_id=de147a9de37b4cad98521a973e41effa, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:41.271030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c5407-ed9c-4783-8d83-2b1358c85157 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:41.286079 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1321/2649] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:41 2022] PUT /identity/v3/projects/30e50fb11cbe44fab72b2298c5e27eb5/users/de147a9de37b4cad98521a973e41effa/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:41.297814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd3516-2072-4310-9ed1-d88a32ec24b3 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:41.298098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd3516-2072-4310-9ed1-d88a32ec24b3 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:41.298365 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd3516-2072-4310-9ed1-d88a32ec24b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:41.325712 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-83cd3516-2072-4310-9ed1-d88a32ec24b3 None None] MFA Rules not processed for user `de147a9de37b4cad98521a973e41effa`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:41.327044 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-83cd3516-2072-4310-9ed1-d88a32ec24b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:41.401318 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1329/2650] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:41.406067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c5407-ed9c-4783-8d83-2b1358c85157 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:41.469042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c5407-ed9c-4783-8d83-2b1358c85157 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:41.475111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a417f-0eb8-400a-85a5-6252ba4b787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:41.475716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a417f-0eb8-400a-85a5-6252ba4b787d admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:41.475993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a417f-0eb8-400a-85a5-6252ba4b787d admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:41.476259 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a417f-0eb8-400a-85a5-6252ba4b787d admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:41.476903 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a417f-0eb8-400a-85a5-6252ba4b787d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:41.478894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a417f-0eb8-400a-85a5-6252ba4b787d admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:41.509883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1322/2651] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:41 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:41.514050 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd3516-2072-4310-9ed1-d88a32ec24b3 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:41.525206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd3516-2072-4310-9ed1-d88a32ec24b3 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:41.591496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bfe8e-231b-4dd9-bfcf-28da2fac642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:41.592106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bfe8e-231b-4dd9-bfcf-28da2fac642f admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:41.592498 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bfe8e-231b-4dd9-bfcf-28da2fac642f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:41.592768 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bfe8e-231b-4dd9-bfcf-28da2fac642f admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:41.594987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bfe8e-231b-4dd9-bfcf-28da2fac642f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:41.595705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bfe8e-231b-4dd9-bfcf-28da2fac642f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:41.619263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1330/2652] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:41 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:41.624671 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a417f-0eb8-400a-85a5-6252ba4b787d admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:41.635834 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a417f-0eb8-400a-85a5-6252ba4b787d admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:41.640733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eb00b-3d80-4a44-b6e7-9e3b6e105991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:41.641330 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eb00b-3d80-4a44-b6e7-9e3b6e105991 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:41.641606 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eb00b-3d80-4a44-b6e7-9e3b6e105991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:41.641879 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eb00b-3d80-4a44-b6e7-9e3b6e105991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:41.642538 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952eb00b-3d80-4a44-b6e7-9e3b6e105991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:41.644192 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952eb00b-3d80-4a44-b6e7-9e3b6e105991 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:41.656164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1323/2653] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:41.660642 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bfe8e-231b-4dd9-bfcf-28da2fac642f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:41.670941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bfe8e-231b-4dd9-bfcf-28da2fac642f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:41.676437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fc4f9-eda0-4aef-8141-c9d348786eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:41.677086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fc4f9-eda0-4aef-8141-c9d348786eee admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:41.677361 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fc4f9-eda0-4aef-8141-c9d348786eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:41.677626 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fc4f9-eda0-4aef-8141-c9d348786eee admin admin] PATH_INFO: `/v3/projects/a63a1337aca949d3925405eac9c60e5c/users/705009b2b1a24cba8d307746184a72de/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:41.695296 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fc4f9-eda0-4aef-8141-c9d348786eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63a1337aca949d3925405eac9c60e5c, user_id=705009b2b1a24cba8d307746184a72de, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:41.699422 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fc4f9-eda0-4aef-8141-c9d348786eee admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:41.717851 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1331/2654] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:41 2022] PUT /identity/v3/projects/a63a1337aca949d3925405eac9c60e5c/users/705009b2b1a24cba8d307746184a72de/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:37:41.722135 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eb00b-3d80-4a44-b6e7-9e3b6e105991 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:41.732375 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eb00b-3d80-4a44-b6e7-9e3b6e105991 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:41.792740 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45543956-b6a1-4a84-aaa5-38d3081923b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:41.793342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45543956-b6a1-4a84-aaa5-38d3081923b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:41.793526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45543956-b6a1-4a84-aaa5-38d3081923b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:41.793792 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45543956-b6a1-4a84-aaa5-38d3081923b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:41.794439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45543956-b6a1-4a84-aaa5-38d3081923b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:41.796727 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45543956-b6a1-4a84-aaa5-38d3081923b9 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:41.807345 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1324/2655] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:41.811641 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fc4f9-eda0-4aef-8141-c9d348786eee admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:41.817271 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:41.824397 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fc4f9-eda0-4aef-8141-c9d348786eee admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:41.831402 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc595d-cc60-4927-9885-e8197d3c6eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:41.832087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc595d-cc60-4927-9885-e8197d3c6eba admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:41.832364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc595d-cc60-4927-9885-e8197d3c6eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:41.832638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc595d-cc60-4927-9885-e8197d3c6eba admin admin] PATH_INFO: `/v3/projects/a63a1337aca949d3925405eac9c60e5c/users/705009b2b1a24cba8d307746184a72de/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:41.834968 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc595d-cc60-4927-9885-e8197d3c6eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63a1337aca949d3925405eac9c60e5c, user_id=705009b2b1a24cba8d307746184a72de, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:41.837640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc595d-cc60-4927-9885-e8197d3c6eba admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:41.849498 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1332/2656] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:41 2022] PUT /identity/v3/projects/a63a1337aca949d3925405eac9c60e5c/users/705009b2b1a24cba8d307746184a72de/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:41.860116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85676fa4-48d0-4962-ac8a-b9a5ac94f5d1 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:41.860405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85676fa4-48d0-4962-ac8a-b9a5ac94f5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:41.860664 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85676fa4-48d0-4962-ac8a-b9a5ac94f5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:41.869194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:41.891063 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-85676fa4-48d0-4962-ac8a-b9a5ac94f5d1 None None] MFA Rules not processed for user `705009b2b1a24cba8d307746184a72de`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:41.892371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-85676fa4-48d0-4962-ac8a-b9a5ac94f5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:41.965800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1325/2657] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:41.979657 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc595d-cc60-4927-9885-e8197d3c6eba admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:41.982516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-2bdc595d-cc60-4927-9885-e8197d3c6eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:42.048272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc595d-cc60-4927-9885-e8197d3c6eba admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:42.052860 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d6618-a8b8-48f8-8055-caa3121d72a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:42.053470 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d6618-a8b8-48f8-8055-caa3121d72a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:42.053743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d6618-a8b8-48f8-8055-caa3121d72a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:42.054007 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d6618-a8b8-48f8-8055-caa3121d72a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:42.115301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d6618-a8b8-48f8-8055-caa3121d72a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:42.116768 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d6618-a8b8-48f8-8055-caa3121d72a3 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:42.126221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1333/2658] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:44.753505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85676fa4-48d0-4962-ac8a-b9a5ac94f5d1 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:44.819350 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85676fa4-48d0-4962-ac8a-b9a5ac94f5d1 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:44.823820 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76329d1b-90b1-4940-8d29-40c31d26b95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:44.824442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329d1b-90b1-4940-8d29-40c31d26b95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:44.824713 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329d1b-90b1-4940-8d29-40c31d26b95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:44.825014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329d1b-90b1-4940-8d29-40c31d26b95e admin admin] PATH_INFO: `/v3/users/de147a9de37b4cad98521a973e41effa` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:44.826089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76329d1b-90b1-4940-8d29-40c31d26b95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=de147a9de37b4cad98521a973e41effa)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:44.828074 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76329d1b-90b1-4940-8d29-40c31d26b95e admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:44.851863 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d6618-a8b8-48f8-8055-caa3121d72a3 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:44.853782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-bc8d6618-a8b8-48f8-8055-caa3121d72a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:44.867051 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d6618-a8b8-48f8-8055-caa3121d72a3 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:44.871502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ffcc1-f139-45f3-9b03-e89533f744c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:44.872156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ffcc1-f139-45f3-9b03-e89533f744c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:44.872428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ffcc1-f139-45f3-9b03-e89533f744c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:44.872695 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ffcc1-f139-45f3-9b03-e89533f744c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:44.874431 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ba4ffcc1-f139-45f3-9b03-e89533f744c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:44.875716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-76329d1b-90b1-4940-8d29-40c31d26b95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de147a9de37b4cad98521a973e41effa'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:44.883596 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-76329d1b-90b1-4940-8d29-40c31d26b95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de147a9de37b4cad98521a973e41effa'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:44.884301 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-76329d1b-90b1-4940-8d29-40c31d26b95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de147a9de37b4cad98521a973e41effa'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:44.885090 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-76329d1b-90b1-4940-8d29-40c31d26b95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de147a9de37b4cad98521a973e41effa'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:44.902804 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-76329d1b-90b1-4940-8d29-40c31d26b95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de147a9de37b4cad98521a973e41effa'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:44.916009 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1326/2659] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:44 2022] DELETE /identity/v3/users/de147a9de37b4cad98521a973e41effa => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:44.920529 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631fb81-d394-415c-bc86-9471ac45465f None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:44.920816 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631fb81-d394-415c-bc86-9471ac45465f None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:44.921083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631fb81-d394-415c-bc86-9471ac45465f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:44.935674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ffcc1-f139-45f3-9b03-e89533f744c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:44.937131 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ffcc1-f139-45f3-9b03-e89533f744c6 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:44.939703 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-b631fb81-d394-415c-bc86-9471ac45465f None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:44.940890 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b631fb81-d394-415c-bc86-9471ac45465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:44.944772 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:44.946108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1334/2660] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:37:45.005040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1327/2661] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:45.016012 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ffcc1-f139-45f3-9b03-e89533f744c6 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:45.017619 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ba4ffcc1-f139-45f3-9b03-e89533f744c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:45.072246 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:45.086762 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ffcc1-f139-45f3-9b03-e89533f744c6 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:45.139660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e971cff-1f52-4961-8624-626594218ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:45.140385 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e971cff-1f52-4961-8624-626594218ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:45.140693 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e971cff-1f52-4961-8624-626594218ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:45.140992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e971cff-1f52-4961-8624-626594218ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:45.150169 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e971cff-1f52-4961-8624-626594218ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:45.151628 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e971cff-1f52-4961-8624-626594218ae2 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:45.161710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1335/2662] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:45.447159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631fb81-d394-415c-bc86-9471ac45465f None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:45.454157 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b631fb81-d394-415c-bc86-9471ac45465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:45.468501 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631fb81-d394-415c-bc86-9471ac45465f None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:45.474713 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:45.476035 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:45.476341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:45.476600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] PATH_INFO: `/v3/projects/30e50fb11cbe44fab72b2298c5e27eb5` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:45.477761 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e50fb11cbe44fab72b2298c5e27eb5)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:45.486493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:45.536631 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e50fb11cbe44fab72b2298c5e27eb5', 'request_id': 'req-53531158-e2b7-4121-bda7-a1a492f2b7c2'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:45.546028 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e50fb11cbe44fab72b2298c5e27eb5', 'request_id': 'req-53531158-e2b7-4121-bda7-a1a492f2b7c2'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:45.552058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e50fb11cbe44fab72b2298c5e27eb5', 'request_id': 'req-53531158-e2b7-4121-bda7-a1a492f2b7c2'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:45.563841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] The token cache is being invalidate because project 30e50fb11cbe44fab72b2298c5e27eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:45.564129 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:45.564841 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:45.566283 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1328/2663] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:45 2022] DELETE /identity/v3/projects/30e50fb11cbe44fab72b2298c5e27eb5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:45.570523 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e971cff-1f52-4961-8624-626594218ae2 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:45.580887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e971cff-1f52-4961-8624-626594218ae2 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:45.644892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a31d48-d8aa-4d67-93d4-b7f4c085a620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:45.645595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a31d48-d8aa-4d67-93d4-b7f4c085a620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:45.645870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a31d48-d8aa-4d67-93d4-b7f4c085a620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:45.646138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a31d48-d8aa-4d67-93d4-b7f4c085a620 admin admin] PATH_INFO: `/v3/users/705009b2b1a24cba8d307746184a72de` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:45.647364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a31d48-d8aa-4d67-93d4-b7f4c085a620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=705009b2b1a24cba8d307746184a72de)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:45.649301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a31d48-d8aa-4d67-93d4-b7f4c085a620 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:45.706323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-51a31d48-d8aa-4d67-93d4-b7f4c085a620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705009b2b1a24cba8d307746184a72de'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:45.717910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-51a31d48-d8aa-4d67-93d4-b7f4c085a620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705009b2b1a24cba8d307746184a72de'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:45.726503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-51a31d48-d8aa-4d67-93d4-b7f4c085a620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705009b2b1a24cba8d307746184a72de'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:45.727215 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-51a31d48-d8aa-4d67-93d4-b7f4c085a620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705009b2b1a24cba8d307746184a72de'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:45.727865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-51a31d48-d8aa-4d67-93d4-b7f4c085a620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705009b2b1a24cba8d307746184a72de'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:45.740448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1336/2664] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:45 2022] DELETE /identity/v3/users/705009b2b1a24cba8d307746184a72de => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:46.023815 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:46.025443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:46.038965 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53531158-e2b7-4121-bda7-a1a492f2b7c2 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:46.100253 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:46.100923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:46.101251 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:46.101594 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8 admin admin] PATH_INFO: `/v3/projects/a63a1337aca949d3925405eac9c60e5c` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:46.103219 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63a1337aca949d3925405eac9c60e5c)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:46.106029 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:46.152341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:46.164461 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63a1337aca949d3925405eac9c60e5c', 'request_id': 'req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:46.171485 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63a1337aca949d3925405eac9c60e5c', 'request_id': 'req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:46.177103 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63a1337aca949d3925405eac9c60e5c', 'request_id': 'req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:46.187967 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8 admin admin] The token cache is being invalidate because project a63a1337aca949d3925405eac9c60e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:46.188249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:46.188924 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-18e9f18a-e7ee-4ac9-9b9c-08a5dd5e06c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:46.190404 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1329/2665] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:46 2022] DELETE /identity/v3/projects/a63a1337aca949d3925405eac9c60e5c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:46.195477 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01fe03-9c4a-4a99-9118-aa73aed71abd None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:46.195995 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01fe03-9c4a-4a99-9118-aa73aed71abd None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:46.196108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01fe03-9c4a-4a99-9118-aa73aed71abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:46.217640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-9d01fe03-9c4a-4a99-9118-aa73aed71abd None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:46.218800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9d01fe03-9c4a-4a99-9118-aa73aed71abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:46.232529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:46.285449 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1337/2666] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:46.293667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c66d4-b7e7-4df8-9204-02f7a27422cb None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:46.294061 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c66d4-b7e7-4df8-9204-02f7a27422cb None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:46.294342 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c66d4-b7e7-4df8-9204-02f7a27422cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:46.315904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-525c66d4-b7e7-4df8-9204-02f7a27422cb None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:46.317095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-525c66d4-b7e7-4df8-9204-02f7a27422cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:46.325587 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1330/2667] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:46.331850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01fe03-9c4a-4a99-9118-aa73aed71abd None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:46.342229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01fe03-9c4a-4a99-9118-aa73aed71abd None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:46.347843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8905e-0bab-4007-8ea9-5de46febd4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:46.348564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8905e-0bab-4007-8ea9-5de46febd4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:46.348873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8905e-0bab-4007-8ea9-5de46febd4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:46.349145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8905e-0bab-4007-8ea9-5de46febd4f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:46.349831 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8905e-0bab-4007-8ea9-5de46febd4f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:37:46.350129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8905e-0bab-4007-8ea9-5de46febd4f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:46.351786 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8905e-0bab-4007-8ea9-5de46febd4f8 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:46.364621 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1338/2668] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:37:46.369395 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c66d4-b7e7-4df8-9204-02f7a27422cb None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:46.380539 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c66d4-b7e7-4df8-9204-02f7a27422cb None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:46.388626 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa5ff5-bf35-4596-9d9a-33cb4bce0f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:46.389388 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5ff5-bf35-4596-9d9a-33cb4bce0f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:46.389659 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5ff5-bf35-4596-9d9a-33cb4bce0f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:46.389923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5ff5-bf35-4596-9d9a-33cb4bce0f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:46.390591 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa5ff5-bf35-4596-9d9a-33cb4bce0f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:46.393081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa5ff5-bf35-4596-9d9a-33cb4bce0f0b admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:46.426338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1331/2669] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:46 2022] POST /identity/v3/projects => generated 361 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:46.430606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8905e-0bab-4007-8ea9-5de46febd4f8 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:46.440809 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8905e-0bab-4007-8ea9-5de46febd4f8 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:46.508638 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34404e33-897f-4970-bd3c-60dc9638eac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:46.509158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34404e33-897f-4970-bd3c-60dc9638eac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:46.509434 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34404e33-897f-4970-bd3c-60dc9638eac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:46.509700 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34404e33-897f-4970-bd3c-60dc9638eac0 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:46.510328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34404e33-897f-4970-bd3c-60dc9638eac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:46.512283 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34404e33-897f-4970-bd3c-60dc9638eac0 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:46.534952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1339/2670] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:46 2022] POST /identity/v3/users => generated 281 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:46.539702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa5ff5-bf35-4596-9d9a-33cb4bce0f0b admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:46.550497 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa5ff5-bf35-4596-9d9a-33cb4bce0f0b admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:46.555566 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfcab2-8adc-4640-9b50-e86010841056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:46.556193 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfcab2-8adc-4640-9b50-e86010841056 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:46.556462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfcab2-8adc-4640-9b50-e86010841056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:46.556719 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfcab2-8adc-4640-9b50-e86010841056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:46.557372 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfcab2-8adc-4640-9b50-e86010841056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:46.559036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfcab2-8adc-4640-9b50-e86010841056 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:46.569652 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1332/2671] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:37:46.573998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34404e33-897f-4970-bd3c-60dc9638eac0 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:46.584946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34404e33-897f-4970-bd3c-60dc9638eac0 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:46.590042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848d4eb-c5e2-4964-9bd7-4ec3188b8e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:46.590631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848d4eb-c5e2-4964-9bd7-4ec3188b8e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:46.590929 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848d4eb-c5e2-4964-9bd7-4ec3188b8e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:46.591197 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848d4eb-c5e2-4964-9bd7-4ec3188b8e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:46.591824 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848d4eb-c5e2-4964-9bd7-4ec3188b8e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:46.593428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848d4eb-c5e2-4964-9bd7-4ec3188b8e8c admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:46.604556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1340/2672] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:46.610347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfcab2-8adc-4640-9b50-e86010841056 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:46.620872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfcab2-8adc-4640-9b50-e86010841056 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:46.625752 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050635e-a9d4-468c-85e5-1b0a68e2c367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:46.626494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050635e-a9d4-468c-85e5-1b0a68e2c367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:46.626762 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050635e-a9d4-468c-85e5-1b0a68e2c367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:46.627138 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050635e-a9d4-468c-85e5-1b0a68e2c367 admin admin] PATH_INFO: `/v3/projects/c286fbd36f6a419491732afc51146e2f/users/078a9e992d6742fbbe3624d846c9eb26/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:46.641667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050635e-a9d4-468c-85e5-1b0a68e2c367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c286fbd36f6a419491732afc51146e2f, user_id=078a9e992d6742fbbe3624d846c9eb26, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:46.644303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050635e-a9d4-468c-85e5-1b0a68e2c367 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:46.661560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1333/2673] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:46 2022] PUT /identity/v3/projects/c286fbd36f6a419491732afc51146e2f/users/078a9e992d6742fbbe3624d846c9eb26/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:46.672559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a86d6-988a-4dad-8512-77eac54d269b None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:46.673086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a86d6-988a-4dad-8512-77eac54d269b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:46.673540 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a86d6-988a-4dad-8512-77eac54d269b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:46.717506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-cc5a86d6-988a-4dad-8512-77eac54d269b None None] MFA Rules not processed for user `078a9e992d6742fbbe3624d846c9eb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:46.717506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cc5a86d6-988a-4dad-8512-77eac54d269b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:46.784228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1341/2674] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:46.797097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050635e-a9d4-468c-85e5-1b0a68e2c367 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:46.799926 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a050635e-a9d4-468c-85e5-1b0a68e2c367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:46.859513 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050635e-a9d4-468c-85e5-1b0a68e2c367 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:46.864040 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6f38b-7f82-4379-b18a-68def2aebf82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:46.864640 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6f38b-7f82-4379-b18a-68def2aebf82 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:46.864944 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6f38b-7f82-4379-b18a-68def2aebf82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:46.865180 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6f38b-7f82-4379-b18a-68def2aebf82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:46.875022 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6f38b-7f82-4379-b18a-68def2aebf82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:46.876601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6f38b-7f82-4379-b18a-68def2aebf82 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:46.886321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1334/2675] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:47.128674 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a86d6-988a-4dad-8512-77eac54d269b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:47.130243 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cc5a86d6-988a-4dad-8512-77eac54d269b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:47.152888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:47.221729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a86d6-988a-4dad-8512-77eac54d269b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:47.226759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f30f22-90b5-4013-9ecd-7b68c58a7033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:47.227513 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f30f22-90b5-4013-9ecd-7b68c58a7033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:47.227841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f30f22-90b5-4013-9ecd-7b68c58a7033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:47.228172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f30f22-90b5-4013-9ecd-7b68c58a7033 admin admin] PATH_INFO: `/v3/users/a861774e826343ffbbf416c831056967` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:47.229390 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f30f22-90b5-4013-9ecd-7b68c58a7033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a861774e826343ffbbf416c831056967)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:47.231332 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f30f22-90b5-4013-9ecd-7b68c58a7033 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:47.280379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-10f30f22-90b5-4013-9ecd-7b68c58a7033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a861774e826343ffbbf416c831056967'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:47.293634 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-10f30f22-90b5-4013-9ecd-7b68c58a7033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a861774e826343ffbbf416c831056967'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:47.302412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-10f30f22-90b5-4013-9ecd-7b68c58a7033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a861774e826343ffbbf416c831056967'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:47.303067 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-10f30f22-90b5-4013-9ecd-7b68c58a7033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a861774e826343ffbbf416c831056967'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:47.303978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-10f30f22-90b5-4013-9ecd-7b68c58a7033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a861774e826343ffbbf416c831056967'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:47.316494 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1342/2676] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:47 2022] DELETE /identity/v3/users/a861774e826343ffbbf416c831056967 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:47.320967 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec4363-dd10-484b-bae5-d8738924f342 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:47.321434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec4363-dd10-484b-bae5-d8738924f342 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:47.321572 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec4363-dd10-484b-bae5-d8738924f342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:47.340712 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-6aec4363-dd10-484b-bae5-d8738924f342 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:47.341908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6aec4363-dd10-484b-bae5-d8738924f342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:47.405505 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1335/2677] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:47.415563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f30f22-90b5-4013-9ecd-7b68c58a7033 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:47.417242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-10f30f22-90b5-4013-9ecd-7b68c58a7033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:47.477653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f30f22-90b5-4013-9ecd-7b68c58a7033 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:47.481981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5f89-86b1-4ff8-8e4c-78a9c860f695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:47.482594 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5f89-86b1-4ff8-8e4c-78a9c860f695 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:47.482892 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5f89-86b1-4ff8-8e4c-78a9c860f695 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:47.483185 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5f89-86b1-4ff8-8e4c-78a9c860f695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:47.492816 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d5f89-86b1-4ff8-8e4c-78a9c860f695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:47.494294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d5f89-86b1-4ff8-8e4c-78a9c860f695 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:47.503946 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1343/2678] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:47.806243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec4363-dd10-484b-bae5-d8738924f342 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:47.807739 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6aec4363-dd10-484b-bae5-d8738924f342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:47.815498 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:47.834118 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec4363-dd10-484b-bae5-d8738924f342 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:47.839922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:47.840574 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:47.840854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:47.841127 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] PATH_INFO: `/v3/projects/441873cc6bc34bb4816a7555f84d5a7e` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:47.842264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=441873cc6bc34bb4816a7555f84d5a7e)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:47.844212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:47.896303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '441873cc6bc34bb4816a7555f84d5a7e', 'request_id': 'req-034a7b4e-23df-4c3a-bcc4-2982d3c33807'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:47.905179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '441873cc6bc34bb4816a7555f84d5a7e', 'request_id': 'req-034a7b4e-23df-4c3a-bcc4-2982d3c33807'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:47.910893 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '441873cc6bc34bb4816a7555f84d5a7e', 'request_id': 'req-034a7b4e-23df-4c3a-bcc4-2982d3c33807'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:47.922139 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] The token cache is being invalidate because project 441873cc6bc34bb4816a7555f84d5a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:47.922420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:47.923546 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:47.925339 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1336/2679] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:47 2022] DELETE /identity/v3/projects/441873cc6bc34bb4816a7555f84d5a7e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:47.929443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5f89-86b1-4ff8-8e4c-78a9c860f695 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:47.939304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5f89-86b1-4ff8-8e4c-78a9c860f695 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:47.974110 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:47.998958 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793d234-206d-4c57-9c7e-1d1f61a55820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:47.999605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793d234-206d-4c57-9c7e-1d1f61a55820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:47.999896 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793d234-206d-4c57-9c7e-1d1f61a55820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:48.000277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793d234-206d-4c57-9c7e-1d1f61a55820 admin admin] PATH_INFO: `/v3/users/7c42d86ff98247fea9c19e199dea41bf` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:48.001472 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793d234-206d-4c57-9c7e-1d1f61a55820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c42d86ff98247fea9c19e199dea41bf)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:48.003453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793d234-206d-4c57-9c7e-1d1f61a55820 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:48.053428 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d793d234-206d-4c57-9c7e-1d1f61a55820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c42d86ff98247fea9c19e199dea41bf'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.066853 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d793d234-206d-4c57-9c7e-1d1f61a55820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c42d86ff98247fea9c19e199dea41bf'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.077170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d793d234-206d-4c57-9c7e-1d1f61a55820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c42d86ff98247fea9c19e199dea41bf'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.078198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d793d234-206d-4c57-9c7e-1d1f61a55820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c42d86ff98247fea9c19e199dea41bf'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.079272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d793d234-206d-4c57-9c7e-1d1f61a55820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c42d86ff98247fea9c19e199dea41bf'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.094841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1344/2680] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:47 2022] DELETE /identity/v3/users/7c42d86ff98247fea9c19e199dea41bf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:48.392826 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:48.394201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:48.409098 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a7b4e-23df-4c3a-bcc4-2982d3c33807 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:48.472757 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:48.473444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:48.473722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:48.473988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] PATH_INFO: `/v3/projects/cec901a29a36490a9fcaf0f27dd44171` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:48.475144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec901a29a36490a9fcaf0f27dd44171)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:48.477229 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:48.529447 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec901a29a36490a9fcaf0f27dd44171', 'request_id': 'req-976e7164-efb7-46be-9976-006a63129189'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.537697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec901a29a36490a9fcaf0f27dd44171', 'request_id': 'req-976e7164-efb7-46be-9976-006a63129189'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.544084 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec901a29a36490a9fcaf0f27dd44171', 'request_id': 'req-976e7164-efb7-46be-9976-006a63129189'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.558565 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] The token cache is being invalidate because project cec901a29a36490a9fcaf0f27dd44171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:48.558876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.559491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.560978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1337/2681] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:48 2022] DELETE /identity/v3/projects/cec901a29a36490a9fcaf0f27dd44171 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:48.565049 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793d234-206d-4c57-9c7e-1d1f61a55820 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:48.566630 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d793d234-206d-4c57-9c7e-1d1f61a55820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:48.580857 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793d234-206d-4c57-9c7e-1d1f61a55820 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:48.640361 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b5ae5-c353-4f31-916d-1b3ab401d40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:48.641502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b5ae5-c353-4f31-916d-1b3ab401d40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:48.641990 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b5ae5-c353-4f31-916d-1b3ab401d40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:48.642690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b5ae5-c353-4f31-916d-1b3ab401d40b admin admin] PATH_INFO: `/v3/users/0e2a90e2798740f68752e0dc25db17e8` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:48.644083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b5ae5-c353-4f31-916d-1b3ab401d40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2a90e2798740f68752e0dc25db17e8)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:48.646125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b5ae5-c353-4f31-916d-1b3ab401d40b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:48.696787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-680b5ae5-c353-4f31-916d-1b3ab401d40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2a90e2798740f68752e0dc25db17e8'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.706453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:48.711509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-680b5ae5-c353-4f31-916d-1b3ab401d40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2a90e2798740f68752e0dc25db17e8'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.720274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-680b5ae5-c353-4f31-916d-1b3ab401d40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2a90e2798740f68752e0dc25db17e8'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.720992 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-680b5ae5-c353-4f31-916d-1b3ab401d40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2a90e2798740f68752e0dc25db17e8'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.721718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-680b5ae5-c353-4f31-916d-1b3ab401d40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2a90e2798740f68752e0dc25db17e8'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:48.735413 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1345/2682] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:37:48 2022] DELETE /identity/v3/users/0e2a90e2798740f68752e0dc25db17e8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:49.023847 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:49.025460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:49.039609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e7164-efb7-46be-9976-006a63129189 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:49.052415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:49.102255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e868d0-980e-4738-b8a4-0b107a17d3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:49.102952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e868d0-980e-4738-b8a4-0b107a17d3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:49.103230 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e868d0-980e-4738-b8a4-0b107a17d3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:49.103501 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e868d0-980e-4738-b8a4-0b107a17d3be admin admin] PATH_INFO: `/v3/projects/0296cabf90274a50947bda793dc22821` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:49.104667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e868d0-980e-4738-b8a4-0b107a17d3be admin admin] RBAC: Authorizing `identity:delete_project(project_id=0296cabf90274a50947bda793dc22821)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:49.106584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e868d0-980e-4738-b8a4-0b107a17d3be admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:49.154727 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-22e868d0-980e-4738-b8a4-0b107a17d3be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0296cabf90274a50947bda793dc22821', 'request_id': 'req-22e868d0-980e-4738-b8a4-0b107a17d3be'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:49.164138 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-22e868d0-980e-4738-b8a4-0b107a17d3be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0296cabf90274a50947bda793dc22821', 'request_id': 'req-22e868d0-980e-4738-b8a4-0b107a17d3be'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:49.170018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-22e868d0-980e-4738-b8a4-0b107a17d3be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0296cabf90274a50947bda793dc22821', 'request_id': 'req-22e868d0-980e-4738-b8a4-0b107a17d3be'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:49.181554 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-22e868d0-980e-4738-b8a4-0b107a17d3be admin admin] The token cache is being invalidate because project 0296cabf90274a50947bda793dc22821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:37:49.181843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-22e868d0-980e-4738-b8a4-0b107a17d3be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:49.182516 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-22e868d0-980e-4738-b8a4-0b107a17d3be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:37:49.184086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1338/2683] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:37:49 2022] DELETE /identity/v3/projects/0296cabf90274a50947bda793dc22821 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:37:49.190351 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292f066-3a1a-4b3e-8f39-6924833317aa None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:49.190633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292f066-3a1a-4b3e-8f39-6924833317aa None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:49.190928 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292f066-3a1a-4b3e-8f39-6924833317aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:49.213102 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-5292f066-3a1a-4b3e-8f39-6924833317aa None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:49.214323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-5292f066-3a1a-4b3e-8f39-6924833317aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:49.283314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1346/2684] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:49.291917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb1c48-7070-4c97-9b69-f9ee0b7914f3 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:49.292206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb1c48-7070-4c97-9b69-f9ee0b7914f3 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:49.292473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb1c48-7070-4c97-9b69-f9ee0b7914f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:49.313511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-39cb1c48-7070-4c97-9b69-f9ee0b7914f3 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:49.314741 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-39cb1c48-7070-4c97-9b69-f9ee0b7914f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:49.324052 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1339/2685] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:49.328582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292f066-3a1a-4b3e-8f39-6924833317aa None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:49.338960 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292f066-3a1a-4b3e-8f39-6924833317aa None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:49.343787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf799190-812b-44b2-be13-285de9e25f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:49.344370 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf799190-812b-44b2-be13-285de9e25f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:49.344640 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf799190-812b-44b2-be13-285de9e25f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:49.344898 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf799190-812b-44b2-be13-285de9e25f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:49.345539 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf799190-812b-44b2-be13-285de9e25f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:37:49.345829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf799190-812b-44b2-be13-285de9e25f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:49.347443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf799190-812b-44b2-be13-285de9e25f77 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:49.358932 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1347/2686] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:37:49.363523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb1c48-7070-4c97-9b69-f9ee0b7914f3 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:49.373055 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb1c48-7070-4c97-9b69-f9ee0b7914f3 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:49.378978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ab3e4-9267-4d08-8978-a33d2d28ccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:49.379582 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ab3e4-9267-4d08-8978-a33d2d28ccef admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:49.379858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ab3e4-9267-4d08-8978-a33d2d28ccef admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:49.380125 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ab3e4-9267-4d08-8978-a33d2d28ccef admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:49.380759 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ab3e4-9267-4d08-8978-a33d2d28ccef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:49.382698 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ab3e4-9267-4d08-8978-a33d2d28ccef admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:49.412973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1340/2687] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:37:49 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:49.417914 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf799190-812b-44b2-be13-285de9e25f77 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:49.429873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf799190-812b-44b2-be13-285de9e25f77 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:49.492177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317822b-dd33-4a74-89b6-d4ccac34311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:49.492779 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317822b-dd33-4a74-89b6-d4ccac34311a admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:49.493051 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317822b-dd33-4a74-89b6-d4ccac34311a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:49.493319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317822b-dd33-4a74-89b6-d4ccac34311a admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:49.493952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317822b-dd33-4a74-89b6-d4ccac34311a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:49.495920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317822b-dd33-4a74-89b6-d4ccac34311a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:49.518865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1348/2688] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:37:49 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:37:49.523538 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ab3e4-9267-4d08-8978-a33d2d28ccef admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:49.534350 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ab3e4-9267-4d08-8978-a33d2d28ccef admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:49.540283 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411eb72-3e20-47b8-ba48-628444f108de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:49.540882 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411eb72-3e20-47b8-ba48-628444f108de admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:49.541160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411eb72-3e20-47b8-ba48-628444f108de admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:49.541423 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411eb72-3e20-47b8-ba48-628444f108de admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:49.542068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411eb72-3e20-47b8-ba48-628444f108de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:49.543722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411eb72-3e20-47b8-ba48-628444f108de admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:49.554132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1341/2689] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:37:49.559068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317822b-dd33-4a74-89b6-d4ccac34311a admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:49.570290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317822b-dd33-4a74-89b6-d4ccac34311a admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:49.575757 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6065e-d2c5-4b2a-bd8b-4537c21f6749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:49.576484 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6065e-d2c5-4b2a-bd8b-4537c21f6749 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:49.576826 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6065e-d2c5-4b2a-bd8b-4537c21f6749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:49.577112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6065e-d2c5-4b2a-bd8b-4537c21f6749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:49.577953 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6065e-d2c5-4b2a-bd8b-4537c21f6749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:49.579849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6065e-d2c5-4b2a-bd8b-4537c21f6749 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:49.590938 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1349/2690] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:37:49.595459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411eb72-3e20-47b8-ba48-628444f108de admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:49.605724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411eb72-3e20-47b8-ba48-628444f108de admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:49.611527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a830b6-5f0c-4be4-a3fb-ac23bad4b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:49.612171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a830b6-5f0c-4be4-a3fb-ac23bad4b1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:49.612445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a830b6-5f0c-4be4-a3fb-ac23bad4b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:49.612704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a830b6-5f0c-4be4-a3fb-ac23bad4b1c2 admin admin] PATH_INFO: `/v3/projects/0d8d9b8bee0a48c1a506b1a2b313b588/users/7f04ff91822849199f22970dbd037f64/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:49.628070 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a830b6-5f0c-4be4-a3fb-ac23bad4b1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8d9b8bee0a48c1a506b1a2b313b588, user_id=7f04ff91822849199f22970dbd037f64, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:49.630832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a830b6-5f0c-4be4-a3fb-ac23bad4b1c2 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:49.645184 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1342/2691] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:37:49 2022] PUT /identity/v3/projects/0d8d9b8bee0a48c1a506b1a2b313b588/users/7f04ff91822849199f22970dbd037f64/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:37:49.661967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81adeb2-3245-4fbb-be95-658e657b9bc3 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:49.662287 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81adeb2-3245-4fbb-be95-658e657b9bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:49.662556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81adeb2-3245-4fbb-be95-658e657b9bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:49.692770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f81adeb2-3245-4fbb-be95-658e657b9bc3 None None] MFA Rules not processed for user `7f04ff91822849199f22970dbd037f64`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:37:49.693997 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f81adeb2-3245-4fbb-be95-658e657b9bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:49.726838 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:49.765201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1350/2692] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:37:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:37:49.777116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a830b6-5f0c-4be4-a3fb-ac23bad4b1c2 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:49.779230 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-15a830b6-5f0c-4be4-a3fb-ac23bad4b1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:49.826681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:49.840526 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a830b6-5f0c-4be4-a3fb-ac23bad4b1c2 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:49.845579 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64567f3-a5b4-48bd-b823-1975df9739b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7f8976306ff477592c6c5b62af60f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:49.846194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64567f3-a5b4-48bd-b823-1975df9739b1 service glance] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:49.846471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64567f3-a5b4-48bd-b823-1975df9739b1 service glance] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:49.846743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64567f3-a5b4-48bd-b823-1975df9739b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:49.855450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64567f3-a5b4-48bd-b823-1975df9739b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:49.856888 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64567f3-a5b4-48bd-b823-1975df9739b1 service glance] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:49.866018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1343/2693] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:37:59.761885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=13 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:59.861918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=7 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:19.212230 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81adeb2-3245-4fbb-be95-658e657b9bc3 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:19.289699 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81adeb2-3245-4fbb-be95-658e657b9bc3 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:19.295070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704a9b5-d3ed-4d77-9d5b-253fb811f12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:19.295703 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704a9b5-d3ed-4d77-9d5b-253fb811f12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:19.295974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704a9b5-d3ed-4d77-9d5b-253fb811f12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:19.296255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704a9b5-d3ed-4d77-9d5b-253fb811f12b admin admin] PATH_INFO: `/v3/users/7f04ff91822849199f22970dbd037f64` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:19.297391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704a9b5-d3ed-4d77-9d5b-253fb811f12b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f04ff91822849199f22970dbd037f64)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:19.299347 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704a9b5-d3ed-4d77-9d5b-253fb811f12b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:19.347952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a704a9b5-d3ed-4d77-9d5b-253fb811f12b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f04ff91822849199f22970dbd037f64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:19.359850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a704a9b5-d3ed-4d77-9d5b-253fb811f12b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f04ff91822849199f22970dbd037f64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:19.368420 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a704a9b5-d3ed-4d77-9d5b-253fb811f12b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f04ff91822849199f22970dbd037f64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:19.369070 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a704a9b5-d3ed-4d77-9d5b-253fb811f12b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f04ff91822849199f22970dbd037f64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:19.369692 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a704a9b5-d3ed-4d77-9d5b-253fb811f12b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f04ff91822849199f22970dbd037f64'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:19.382439 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1351/2694] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:38:19 2022] DELETE /identity/v3/users/7f04ff91822849199f22970dbd037f64 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:19.387191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e75f5-99a2-4f07-9ef9-d08ff414b749 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:19.387611 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e75f5-99a2-4f07-9ef9-d08ff414b749 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:19.387764 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e75f5-99a2-4f07-9ef9-d08ff414b749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:19.408508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-cd4e75f5-99a2-4f07-9ef9-d08ff414b749 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:19.409532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-cd4e75f5-99a2-4f07-9ef9-d08ff414b749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:19.471080 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1344/2695] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:19.481872 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704a9b5-d3ed-4d77-9d5b-253fb811f12b admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:19.483598 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a704a9b5-d3ed-4d77-9d5b-253fb811f12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:19.548107 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704a9b5-d3ed-4d77-9d5b-253fb811f12b admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:19.552060 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315e670-42a3-403f-8ff0-6e76f25c60f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:19.552662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315e670-42a3-403f-8ff0-6e76f25c60f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:19.552943 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315e670-42a3-403f-8ff0-6e76f25c60f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:19.553206 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315e670-42a3-403f-8ff0-6e76f25c60f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:19.562701 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315e670-42a3-403f-8ff0-6e76f25c60f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:19.564164 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315e670-42a3-403f-8ff0-6e76f25c60f8 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:19.573791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1352/2696] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:38:19.872651 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e75f5-99a2-4f07-9ef9-d08ff414b749 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:19.874126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-cd4e75f5-99a2-4f07-9ef9-d08ff414b749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:19.890160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e75f5-99a2-4f07-9ef9-d08ff414b749 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:19.896566 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ab01f-02a7-4b58-8b19-61f06256ba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:19.897313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ab01f-02a7-4b58-8b19-61f06256ba6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:19.897477 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ab01f-02a7-4b58-8b19-61f06256ba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:19.897735 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ab01f-02a7-4b58-8b19-61f06256ba6e admin admin] PATH_INFO: `/v3/projects/0d8d9b8bee0a48c1a506b1a2b313b588` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:19.899147 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ab01f-02a7-4b58-8b19-61f06256ba6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8d9b8bee0a48c1a506b1a2b313b588)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:19.901120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ab01f-02a7-4b58-8b19-61f06256ba6e admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:19.953800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d44ab01f-02a7-4b58-8b19-61f06256ba6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8d9b8bee0a48c1a506b1a2b313b588', 'request_id': 'req-d44ab01f-02a7-4b58-8b19-61f06256ba6e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:19.963109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d44ab01f-02a7-4b58-8b19-61f06256ba6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8d9b8bee0a48c1a506b1a2b313b588', 'request_id': 'req-d44ab01f-02a7-4b58-8b19-61f06256ba6e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:19.968809 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d44ab01f-02a7-4b58-8b19-61f06256ba6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8d9b8bee0a48c1a506b1a2b313b588', 'request_id': 'req-d44ab01f-02a7-4b58-8b19-61f06256ba6e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:19.980328 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d44ab01f-02a7-4b58-8b19-61f06256ba6e admin admin] The token cache is being invalidate because project 0d8d9b8bee0a48c1a506b1a2b313b588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:38:19.980552 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d44ab01f-02a7-4b58-8b19-61f06256ba6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:19.981226 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d44ab01f-02a7-4b58-8b19-61f06256ba6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:19.982836 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1345/2697] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:38:19 2022] DELETE /identity/v3/projects/0d8d9b8bee0a48c1a506b1a2b313b588 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:19.988245 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a86d80-fb47-4ee1-a427-aba22dadd2ee None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:19.988530 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a86d80-fb47-4ee1-a427-aba22dadd2ee None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:19.988792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a86d80-fb47-4ee1-a427-aba22dadd2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:20.008933 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-e1a86d80-fb47-4ee1-a427-aba22dadd2ee None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:20.010305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e1a86d80-fb47-4ee1-a427-aba22dadd2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:20.027705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:20.073104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1353/2698] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:20.081346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d69e15-56b4-4969-8323-c91035416ddd None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:20.081652 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d69e15-56b4-4969-8323-c91035416ddd None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:20.081946 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d69e15-56b4-4969-8323-c91035416ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:20.103142 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-17d69e15-56b4-4969-8323-c91035416ddd None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:20.104412 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-17d69e15-56b4-4969-8323-c91035416ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:20.113511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1346/2699] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:20.118014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a86d80-fb47-4ee1-a427-aba22dadd2ee None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:20.127972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a86d80-fb47-4ee1-a427-aba22dadd2ee None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:20.134250 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276816b-49f2-48df-a2d8-98356d44727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:20.134843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276816b-49f2-48df-a2d8-98356d44727e admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:20.135145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276816b-49f2-48df-a2d8-98356d44727e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:20.135414 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276816b-49f2-48df-a2d8-98356d44727e admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:20.136059 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276816b-49f2-48df-a2d8-98356d44727e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:38:20.136358 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276816b-49f2-48df-a2d8-98356d44727e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:20.137960 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276816b-49f2-48df-a2d8-98356d44727e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:20.149890 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1354/2700] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:38:20.154439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d69e15-56b4-4969-8323-c91035416ddd None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:20.165759 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d69e15-56b4-4969-8323-c91035416ddd None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:20.171315 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f7791-13fd-42f5-85f8-3dda8919552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:20.171918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f7791-13fd-42f5-85f8-3dda8919552b admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:20.172194 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f7791-13fd-42f5-85f8-3dda8919552b admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:20.172466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f7791-13fd-42f5-85f8-3dda8919552b admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:20.173103 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f7791-13fd-42f5-85f8-3dda8919552b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:20.175116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f7791-13fd-42f5-85f8-3dda8919552b admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:20.204663 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1347/2701] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:38:20 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:38:20.209409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276816b-49f2-48df-a2d8-98356d44727e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:20.219529 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276816b-49f2-48df-a2d8-98356d44727e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:20.280180 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d374e-c291-4552-b97a-85ba6df4ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:20.280693 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d374e-c291-4552-b97a-85ba6df4ba9e admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:20.280964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d374e-c291-4552-b97a-85ba6df4ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:20.281232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d374e-c291-4552-b97a-85ba6df4ba9e admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:20.281869 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d374e-c291-4552-b97a-85ba6df4ba9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:20.283839 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d374e-c291-4552-b97a-85ba6df4ba9e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:20.306154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1355/2702] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:38:20 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:38:20.312436 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f7791-13fd-42f5-85f8-3dda8919552b admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:20.324881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f7791-13fd-42f5-85f8-3dda8919552b admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:20.331426 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2f4d2-9fc9-43c7-9d19-be3114519f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:20.332034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2f4d2-9fc9-43c7-9d19-be3114519f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:20.332299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2f4d2-9fc9-43c7-9d19-be3114519f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:20.332562 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2f4d2-9fc9-43c7-9d19-be3114519f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:20.333191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2f4d2-9fc9-43c7-9d19-be3114519f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:20.334789 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2f4d2-9fc9-43c7-9d19-be3114519f60 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:20.345605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1348/2703] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:38:20.349835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d374e-c291-4552-b97a-85ba6df4ba9e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:20.359924 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d374e-c291-4552-b97a-85ba6df4ba9e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:20.365432 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67bf06-f882-465a-86a1-58b2188b7115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:20.366026 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67bf06-f882-465a-86a1-58b2188b7115 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:20.366343 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67bf06-f882-465a-86a1-58b2188b7115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:20.366600 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67bf06-f882-465a-86a1-58b2188b7115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:20.367290 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67bf06-f882-465a-86a1-58b2188b7115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:20.368920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67bf06-f882-465a-86a1-58b2188b7115 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:20.379708 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1356/2704] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:38:20.384861 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2f4d2-9fc9-43c7-9d19-be3114519f60 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:20.401300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2f4d2-9fc9-43c7-9d19-be3114519f60 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:20.406508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8973c8-9624-4dfd-ad8b-bda1951237ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:20.407261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8973c8-9624-4dfd-ad8b-bda1951237ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:20.407644 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8973c8-9624-4dfd-ad8b-bda1951237ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:20.407789 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8973c8-9624-4dfd-ad8b-bda1951237ca admin admin] PATH_INFO: `/v3/projects/364799837b404e35ad574b6a4ba6292c/users/ddcc570fed36421a84d4119267f26405/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:20.425770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8973c8-9624-4dfd-ad8b-bda1951237ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=364799837b404e35ad574b6a4ba6292c, user_id=ddcc570fed36421a84d4119267f26405, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:20.428491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8973c8-9624-4dfd-ad8b-bda1951237ca admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:20.442450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1349/2705] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:38:20 2022] PUT /identity/v3/projects/364799837b404e35ad574b6a4ba6292c/users/ddcc570fed36421a84d4119267f26405/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:20.511228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b2eb0-63fe-4ae6-adc1-1b8dff8fe35c None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:20.511539 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b2eb0-63fe-4ae6-adc1-1b8dff8fe35c None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:20.511759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b2eb0-63fe-4ae6-adc1-1b8dff8fe35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:20.539646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-925b2eb0-63fe-4ae6-adc1-1b8dff8fe35c None None] MFA Rules not processed for user `ddcc570fed36421a84d4119267f26405`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:20.541008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-925b2eb0-63fe-4ae6-adc1-1b8dff8fe35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:20.615179 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1357/2706] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:20.626206 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8973c8-9624-4dfd-ad8b-bda1951237ca admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:20.628152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-bd8973c8-9624-4dfd-ad8b-bda1951237ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:20.652817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:20.694874 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8973c8-9624-4dfd-ad8b-bda1951237ca admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:20.699034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182959a-bd01-4c10-8376-3ae1f51248f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:20.699637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182959a-bd01-4c10-8376-3ae1f51248f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:20.699911 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182959a-bd01-4c10-8376-3ae1f51248f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:20.700176 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182959a-bd01-4c10-8376-3ae1f51248f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:20.709754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182959a-bd01-4c10-8376-3ae1f51248f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:20.711237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182959a-bd01-4c10-8376-3ae1f51248f8 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:20.720378 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1350/2707] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:38:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:38:30.611893 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:30.716018 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=17 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:32.381888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b2eb0-63fe-4ae6-adc1-1b8dff8fe35c None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:32.449415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b2eb0-63fe-4ae6-adc1-1b8dff8fe35c None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:32.458875 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820d208-946b-42d1-bf23-c3750af7f11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:32.458875 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820d208-946b-42d1-bf23-c3750af7f11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:32.461276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820d208-946b-42d1-bf23-c3750af7f11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:32.461276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820d208-946b-42d1-bf23-c3750af7f11e admin admin] PATH_INFO: `/v3/users/ddcc570fed36421a84d4119267f26405` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:32.461276 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820d208-946b-42d1-bf23-c3750af7f11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddcc570fed36421a84d4119267f26405)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:32.463454 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820d208-946b-42d1-bf23-c3750af7f11e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:32.525689 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e820d208-946b-42d1-bf23-c3750af7f11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddcc570fed36421a84d4119267f26405'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:32.537566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e820d208-946b-42d1-bf23-c3750af7f11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddcc570fed36421a84d4119267f26405'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:32.546584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e820d208-946b-42d1-bf23-c3750af7f11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddcc570fed36421a84d4119267f26405'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:32.547344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e820d208-946b-42d1-bf23-c3750af7f11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddcc570fed36421a84d4119267f26405'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:32.547939 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e820d208-946b-42d1-bf23-c3750af7f11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddcc570fed36421a84d4119267f26405'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:32.563333 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1358/2708] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:38:32 2022] DELETE /identity/v3/users/ddcc570fed36421a84d4119267f26405 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:32.568419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed6ff9-9cd3-40e3-9427-acc35d30e36d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:32.569067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed6ff9-9cd3-40e3-9427-acc35d30e36d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:32.569373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed6ff9-9cd3-40e3-9427-acc35d30e36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:32.590369 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-9bed6ff9-9cd3-40e3-9427-acc35d30e36d None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:32.591694 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9bed6ff9-9cd3-40e3-9427-acc35d30e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:32.655245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1351/2709] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:32.665477 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820d208-946b-42d1-bf23-c3750af7f11e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:32.666995 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e820d208-946b-42d1-bf23-c3750af7f11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:32.734738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820d208-946b-42d1-bf23-c3750af7f11e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:32.738792 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef8c83-3e02-453e-a692-d593fe552b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:32.739438 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef8c83-3e02-453e-a692-d593fe552b20 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:32.739714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef8c83-3e02-453e-a692-d593fe552b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:32.739983 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef8c83-3e02-453e-a692-d593fe552b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:32.750312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef8c83-3e02-453e-a692-d593fe552b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:32.752052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef8c83-3e02-453e-a692-d593fe552b20 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:32.762836 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1359/2710] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:38:33.061013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed6ff9-9cd3-40e3-9427-acc35d30e36d None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:33.062487 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-9bed6ff9-9cd3-40e3-9427-acc35d30e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:33.075334 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed6ff9-9cd3-40e3-9427-acc35d30e36d None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:33.081174 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b839def-5e09-490d-993f-3b2a8003ac21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:33.081815 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b839def-5e09-490d-993f-3b2a8003ac21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:33.082120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b839def-5e09-490d-993f-3b2a8003ac21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:33.082366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b839def-5e09-490d-993f-3b2a8003ac21 admin admin] PATH_INFO: `/v3/projects/364799837b404e35ad574b6a4ba6292c` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:33.083527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b839def-5e09-490d-993f-3b2a8003ac21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=364799837b404e35ad574b6a4ba6292c)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:33.085531 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b839def-5e09-490d-993f-3b2a8003ac21 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:33.134586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0b839def-5e09-490d-993f-3b2a8003ac21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364799837b404e35ad574b6a4ba6292c', 'request_id': 'req-0b839def-5e09-490d-993f-3b2a8003ac21'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:33.142220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0b839def-5e09-490d-993f-3b2a8003ac21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364799837b404e35ad574b6a4ba6292c', 'request_id': 'req-0b839def-5e09-490d-993f-3b2a8003ac21'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:33.147770 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0b839def-5e09-490d-993f-3b2a8003ac21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364799837b404e35ad574b6a4ba6292c', 'request_id': 'req-0b839def-5e09-490d-993f-3b2a8003ac21'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:33.159835 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0b839def-5e09-490d-993f-3b2a8003ac21 admin admin] The token cache is being invalidate because project 364799837b404e35ad574b6a4ba6292c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:38:33.160121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0b839def-5e09-490d-993f-3b2a8003ac21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:33.160877 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0b839def-5e09-490d-993f-3b2a8003ac21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:33.162583 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1352/2711] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:38:33 2022] DELETE /identity/v3/projects/364799837b404e35ad574b6a4ba6292c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:33.167735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1eab7-2cc3-4388-b627-fa4ec6fc0e91 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:33.167970 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1eab7-2cc3-4388-b627-fa4ec6fc0e91 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:33.168271 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1eab7-2cc3-4388-b627-fa4ec6fc0e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:33.189086 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-9aa1eab7-2cc3-4388-b627-fa4ec6fc0e91 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:33.190178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9aa1eab7-2cc3-4388-b627-fa4ec6fc0e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:33.214797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:33.259055 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1360/2712] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:33.267056 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15088a-f93d-4107-9b20-966d0dcf5c96 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:33.267323 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15088a-f93d-4107-9b20-966d0dcf5c96 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:33.267616 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15088a-f93d-4107-9b20-966d0dcf5c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:33.290159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-cc15088a-f93d-4107-9b20-966d0dcf5c96 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:33.291429 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-cc15088a-f93d-4107-9b20-966d0dcf5c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:33.300595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1353/2713] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:33.305029 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1eab7-2cc3-4388-b627-fa4ec6fc0e91 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:33.314953 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1eab7-2cc3-4388-b627-fa4ec6fc0e91 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:33.320008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4af41-947f-43e4-ac8d-e53b5f896c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:33.320599 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4af41-947f-43e4-ac8d-e53b5f896c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:33.320874 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4af41-947f-43e4-ac8d-e53b5f896c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:33.321148 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4af41-947f-43e4-ac8d-e53b5f896c4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:33.321794 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4af41-947f-43e4-ac8d-e53b5f896c4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:38:33.322093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4af41-947f-43e4-ac8d-e53b5f896c4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:33.323734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4af41-947f-43e4-ac8d-e53b5f896c4f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:33.335558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1361/2714] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:38:33.340104 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15088a-f93d-4107-9b20-966d0dcf5c96 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:33.350593 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15088a-f93d-4107-9b20-966d0dcf5c96 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:33.356203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b767bbb-883a-43cb-8f7a-843dd3be5350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:33.356736 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b767bbb-883a-43cb-8f7a-843dd3be5350 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:33.357005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b767bbb-883a-43cb-8f7a-843dd3be5350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:33.357283 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b767bbb-883a-43cb-8f7a-843dd3be5350 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:33.357901 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b767bbb-883a-43cb-8f7a-843dd3be5350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:33.359834 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b767bbb-883a-43cb-8f7a-843dd3be5350 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:33.399768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1354/2715] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:38:33 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:38:33.404314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4af41-947f-43e4-ac8d-e53b5f896c4f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:33.415009 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4af41-947f-43e4-ac8d-e53b5f896c4f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:33.481124 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669402df-8450-4912-93cd-cfb743b0eea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:33.481681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669402df-8450-4912-93cd-cfb743b0eea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:33.481940 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669402df-8450-4912-93cd-cfb743b0eea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:33.482284 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669402df-8450-4912-93cd-cfb743b0eea5 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:33.482960 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669402df-8450-4912-93cd-cfb743b0eea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:33.485826 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669402df-8450-4912-93cd-cfb743b0eea5 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:33.511941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1362/2716] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:38:33 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:38:33.516179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b767bbb-883a-43cb-8f7a-843dd3be5350 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:33.526617 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b767bbb-883a-43cb-8f7a-843dd3be5350 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:33.531503 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c637df0-4715-47f0-ae19-4405cc8f1aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:33.532077 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637df0-4715-47f0-ae19-4405cc8f1aca admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:33.532344 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637df0-4715-47f0-ae19-4405cc8f1aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:33.532605 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637df0-4715-47f0-ae19-4405cc8f1aca admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:33.533243 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c637df0-4715-47f0-ae19-4405cc8f1aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:33.534838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c637df0-4715-47f0-ae19-4405cc8f1aca admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:33.544789 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1355/2717] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:38:33.548888 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669402df-8450-4912-93cd-cfb743b0eea5 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:33.559065 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669402df-8450-4912-93cd-cfb743b0eea5 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:33.564039 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e219ce-59d1-4e5b-a85a-8c41ff4bed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:33.564633 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e219ce-59d1-4e5b-a85a-8c41ff4bed64 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:33.564909 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e219ce-59d1-4e5b-a85a-8c41ff4bed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:33.565176 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e219ce-59d1-4e5b-a85a-8c41ff4bed64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:33.565822 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e219ce-59d1-4e5b-a85a-8c41ff4bed64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:33.567782 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e219ce-59d1-4e5b-a85a-8c41ff4bed64 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:33.578361 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1363/2718] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:38:33.583128 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c637df0-4715-47f0-ae19-4405cc8f1aca admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:33.596595 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c637df0-4715-47f0-ae19-4405cc8f1aca admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:33.603550 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fde8b-19db-46f0-92ef-a8f639f46eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:33.604198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fde8b-19db-46f0-92ef-a8f639f46eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:33.604471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fde8b-19db-46f0-92ef-a8f639f46eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:33.604763 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fde8b-19db-46f0-92ef-a8f639f46eb2 admin admin] PATH_INFO: `/v3/projects/c9f21434e76142bbbbf9cc6569a7dc2e/users/acdd515d78844bb89780f75e7b5825c5/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:33.619247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fde8b-19db-46f0-92ef-a8f639f46eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f21434e76142bbbbf9cc6569a7dc2e, user_id=acdd515d78844bb89780f75e7b5825c5, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:33.621859 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fde8b-19db-46f0-92ef-a8f639f46eb2 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:33.637245 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1356/2719] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:38:33 2022] PUT /identity/v3/projects/c9f21434e76142bbbbf9cc6569a7dc2e/users/acdd515d78844bb89780f75e7b5825c5/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:38:33.648901 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc7808-f530-4020-b989-d2c33d76c243 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:33.649178 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc7808-f530-4020-b989-d2c33d76c243 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:33.649475 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc7808-f530-4020-b989-d2c33d76c243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:33.677582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-43dc7808-f530-4020-b989-d2c33d76c243 None None] MFA Rules not processed for user `acdd515d78844bb89780f75e7b5825c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:33.678776 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-43dc7808-f530-4020-b989-d2c33d76c243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:33.754133 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1364/2720] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:33.765265 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fde8b-19db-46f0-92ef-a8f639f46eb2 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:33.767160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ac0fde8b-19db-46f0-92ef-a8f639f46eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:33.790599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:33.829012 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fde8b-19db-46f0-92ef-a8f639f46eb2 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:33.844166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053b4a7-3cec-445b-9fc3-445077f06f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:33.844166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053b4a7-3cec-445b-9fc3-445077f06f69 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:33.844166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053b4a7-3cec-445b-9fc3-445077f06f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:33.844166 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053b4a7-3cec-445b-9fc3-445077f06f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:33.844540 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053b4a7-3cec-445b-9fc3-445077f06f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:33.845304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053b4a7-3cec-445b-9fc3-445077f06f69 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:33.854930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1357/2721] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:38:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:38:36.974948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc7808-f530-4020-b989-d2c33d76c243 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:36.995575 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:37.040017 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc7808-f530-4020-b989-d2c33d76c243 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:37.045174 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc285c-4dfa-4b89-841c-25512293d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:37.045801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc285c-4dfa-4b89-841c-25512293d836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:37.046080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc285c-4dfa-4b89-841c-25512293d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:37.046353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc285c-4dfa-4b89-841c-25512293d836 admin admin] PATH_INFO: `/v3/users/acdd515d78844bb89780f75e7b5825c5` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:37.047545 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc285c-4dfa-4b89-841c-25512293d836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdd515d78844bb89780f75e7b5825c5)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:37.049471 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc285c-4dfa-4b89-841c-25512293d836 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:37.100468 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-1ccc285c-4dfa-4b89-841c-25512293d836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdd515d78844bb89780f75e7b5825c5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.112496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-1ccc285c-4dfa-4b89-841c-25512293d836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdd515d78844bb89780f75e7b5825c5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.121880 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-1ccc285c-4dfa-4b89-841c-25512293d836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdd515d78844bb89780f75e7b5825c5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.122753 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-1ccc285c-4dfa-4b89-841c-25512293d836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdd515d78844bb89780f75e7b5825c5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.123510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-1ccc285c-4dfa-4b89-841c-25512293d836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdd515d78844bb89780f75e7b5825c5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.136156 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1365/2722] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:38:36 2022] DELETE /identity/v3/users/acdd515d78844bb89780f75e7b5825c5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:37.141318 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42392710-85e6-4f18-ba70-059e255db0de None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:37.141817 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42392710-85e6-4f18-ba70-059e255db0de None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:37.141927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42392710-85e6-4f18-ba70-059e255db0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:37.165510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-42392710-85e6-4f18-ba70-059e255db0de None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:37.166765 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-42392710-85e6-4f18-ba70-059e255db0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:37.234406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1358/2723] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:37.245654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc285c-4dfa-4b89-841c-25512293d836 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:37.247220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1ccc285c-4dfa-4b89-841c-25512293d836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:37.265737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42392710-85e6-4f18-ba70-059e255db0de None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:37.267238 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-42392710-85e6-4f18-ba70-059e255db0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:37.279058 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42392710-85e6-4f18-ba70-059e255db0de None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:37.285572 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e76f1-91e6-408a-8ee8-aa4ba690c161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:37.286195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e76f1-91e6-408a-8ee8-aa4ba690c161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:37.286467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e76f1-91e6-408a-8ee8-aa4ba690c161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:37.286732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e76f1-91e6-408a-8ee8-aa4ba690c161 admin admin] PATH_INFO: `/v3/users/078a9e992d6742fbbe3624d846c9eb26` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:37.288349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e76f1-91e6-408a-8ee8-aa4ba690c161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=078a9e992d6742fbbe3624d846c9eb26)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:37.290611 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e76f1-91e6-408a-8ee8-aa4ba690c161 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:37.304994 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc285c-4dfa-4b89-841c-25512293d836 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:37.308964 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f28f38-4ae7-46a6-8aeb-545850090d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:37.309567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28f38-4ae7-46a6-8aeb-545850090d34 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:37.309840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28f38-4ae7-46a6-8aeb-545850090d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:37.310106 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28f38-4ae7-46a6-8aeb-545850090d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:37.321172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f28f38-4ae7-46a6-8aeb-545850090d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:37.322938 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f28f38-4ae7-46a6-8aeb-545850090d34 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:37.334278 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1366/2724] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:38:37.340572 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c11e76f1-91e6-408a-8ee8-aa4ba690c161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078a9e992d6742fbbe3624d846c9eb26'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.349494 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c11e76f1-91e6-408a-8ee8-aa4ba690c161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078a9e992d6742fbbe3624d846c9eb26'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.350145 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c11e76f1-91e6-408a-8ee8-aa4ba690c161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078a9e992d6742fbbe3624d846c9eb26'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.350850 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c11e76f1-91e6-408a-8ee8-aa4ba690c161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078a9e992d6742fbbe3624d846c9eb26'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.363209 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-c11e76f1-91e6-408a-8ee8-aa4ba690c161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078a9e992d6742fbbe3624d846c9eb26'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.376450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1359/2725] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:38:37 2022] DELETE /identity/v3/users/078a9e992d6742fbbe3624d846c9eb26 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:37.381157 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590b843-dc29-4444-b8c9-875524e28634 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:37.381445 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590b843-dc29-4444-b8c9-875524e28634 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:37.381818 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590b843-dc29-4444-b8c9-875524e28634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:37.402630 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-8590b843-dc29-4444-b8c9-875524e28634 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:37.404007 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-8590b843-dc29-4444-b8c9-875524e28634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:37.440687 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:37.470595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1367/2726] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:37.481239 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e76f1-91e6-408a-8ee8-aa4ba690c161 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:37.484179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c11e76f1-91e6-408a-8ee8-aa4ba690c161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:37.527359 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:37.547384 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e76f1-91e6-408a-8ee8-aa4ba690c161 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:37.551240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e6492-8c4d-4ac6-992a-b5f52c40c889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:37.551867 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e6492-8c4d-4ac6-992a-b5f52c40c889 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:37.552198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e6492-8c4d-4ac6-992a-b5f52c40c889 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:37.552489 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e6492-8c4d-4ac6-992a-b5f52c40c889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:37.562077 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e6492-8c4d-4ac6-992a-b5f52c40c889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:37.563564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e6492-8c4d-4ac6-992a-b5f52c40c889 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:37.573583 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1360/2727] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:38:37.645995 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590b843-dc29-4444-b8c9-875524e28634 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:37.648423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-8590b843-dc29-4444-b8c9-875524e28634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:37.665401 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590b843-dc29-4444-b8c9-875524e28634 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:37.671841 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ef022-f59b-46a7-b2fc-30b3aa375768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:37.672535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ef022-f59b-46a7-b2fc-30b3aa375768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:37.672834 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ef022-f59b-46a7-b2fc-30b3aa375768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:37.673172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ef022-f59b-46a7-b2fc-30b3aa375768 admin admin] PATH_INFO: `/v3/projects/c9f21434e76142bbbbf9cc6569a7dc2e` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:37.674645 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ef022-f59b-46a7-b2fc-30b3aa375768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f21434e76142bbbbf9cc6569a7dc2e)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:37.676613 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ef022-f59b-46a7-b2fc-30b3aa375768 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:37.730869 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-4c8ef022-f59b-46a7-b2fc-30b3aa375768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f21434e76142bbbbf9cc6569a7dc2e', 'request_id': 'req-4c8ef022-f59b-46a7-b2fc-30b3aa375768'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.739835 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-4c8ef022-f59b-46a7-b2fc-30b3aa375768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f21434e76142bbbbf9cc6569a7dc2e', 'request_id': 'req-4c8ef022-f59b-46a7-b2fc-30b3aa375768'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.749187 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-4c8ef022-f59b-46a7-b2fc-30b3aa375768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f21434e76142bbbbf9cc6569a7dc2e', 'request_id': 'req-4c8ef022-f59b-46a7-b2fc-30b3aa375768'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.760728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-4c8ef022-f59b-46a7-b2fc-30b3aa375768 admin admin] The token cache is being invalidate because project c9f21434e76142bbbbf9cc6569a7dc2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:38:37.761008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-4c8ef022-f59b-46a7-b2fc-30b3aa375768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.761651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-4c8ef022-f59b-46a7-b2fc-30b3aa375768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:37.763273 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1368/2728] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:38:37 2022] DELETE /identity/v3/projects/c9f21434e76142bbbbf9cc6569a7dc2e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:37.768280 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e1b6c-0217-4550-8cab-79e0a97a063e None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:37.768560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e1b6c-0217-4550-8cab-79e0a97a063e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:37.768813 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e1b6c-0217-4550-8cab-79e0a97a063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:37.790330 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-3e4e1b6c-0217-4550-8cab-79e0a97a063e None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:37.791726 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-3e4e1b6c-0217-4550-8cab-79e0a97a063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:37.852766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1361/2729] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:37.860605 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254c341-6931-47f1-901a-2cce84ad9f07 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:37.860973 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254c341-6931-47f1-901a-2cce84ad9f07 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:37.861315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254c341-6931-47f1-901a-2cce84ad9f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:37.884018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-d254c341-6931-47f1-901a-2cce84ad9f07 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:37.885364 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d254c341-6931-47f1-901a-2cce84ad9f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:37.893379 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1369/2730] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:37.897885 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e1b6c-0217-4550-8cab-79e0a97a063e None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:37.908622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e1b6c-0217-4550-8cab-79e0a97a063e None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:37.914599 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458224f9-75ed-4257-b48a-d0fd5a81c092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:37.915341 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458224f9-75ed-4257-b48a-d0fd5a81c092 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:37.915618 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458224f9-75ed-4257-b48a-d0fd5a81c092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:37.915916 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458224f9-75ed-4257-b48a-d0fd5a81c092 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:37.916753 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458224f9-75ed-4257-b48a-d0fd5a81c092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:38:37.917050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458224f9-75ed-4257-b48a-d0fd5a81c092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:37.918648 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458224f9-75ed-4257-b48a-d0fd5a81c092 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:37.924114 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254c341-6931-47f1-901a-2cce84ad9f07 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:37.925684 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d254c341-6931-47f1-901a-2cce84ad9f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:37.939658 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1362/2731] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:38:37.939769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254c341-6931-47f1-901a-2cce84ad9f07 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:37.939883 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458224f9-75ed-4257-b48a-d0fd5a81c092 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:37.944182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:37.944856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:37.945130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:37.945525 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] PATH_INFO: `/v3/projects/c286fbd36f6a419491732afc51146e2f` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:37.946787 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c286fbd36f6a419491732afc51146e2f)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:37.948854 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:37.950458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458224f9-75ed-4257-b48a-d0fd5a81c092 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:37.955881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b9f3-b0f5-40dc-b4e0-284b5bc50dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:37.956466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b9f3-b0f5-40dc-b4e0-284b5bc50dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:37.956782 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b9f3-b0f5-40dc-b4e0-284b5bc50dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:37.956994 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b9f3-b0f5-40dc-b4e0-284b5bc50dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:37.957844 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91b9f3-b0f5-40dc-b4e0-284b5bc50dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:37.959723 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91b9f3-b0f5-40dc-b4e0-284b5bc50dd0 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:37.992870 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1363/2732] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:38:37 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:38:37.993947 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b9f3-b0f5-40dc-b4e0-284b5bc50dd0 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:37.999654 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c286fbd36f6a419491732afc51146e2f', 'request_id': 'req-a512b493-217b-4fb2-beec-e4ce2f3df49e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:38.006359 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c286fbd36f6a419491732afc51146e2f', 'request_id': 'req-a512b493-217b-4fb2-beec-e4ce2f3df49e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:38.015291 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c286fbd36f6a419491732afc51146e2f', 'request_id': 'req-a512b493-217b-4fb2-beec-e4ce2f3df49e'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:38.026285 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] The token cache is being invalidate because project c286fbd36f6a419491732afc51146e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:38:38.026573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:38.027269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:38.028801 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1370/2733] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:38:37 2022] DELETE /identity/v3/projects/c286fbd36f6a419491732afc51146e2f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:38:38.061969 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b9f3-b0f5-40dc-b4e0-284b5bc50dd0 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:38.067278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04df666-8fef-4b48-b651-783699415d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:38.067965 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04df666-8fef-4b48-b651-783699415d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:38.068269 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04df666-8fef-4b48-b651-783699415d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:38.068521 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04df666-8fef-4b48-b651-783699415d60 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:38.069233 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04df666-8fef-4b48-b651-783699415d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:38.071366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04df666-8fef-4b48-b651-783699415d60 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:38.096762 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1364/2734] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:38:37 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:38:38.101165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:38.103315 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:38.159677 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:38.185578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512b493-217b-4fb2-beec-e4ce2f3df49e admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:38.190582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98227b2-e44a-4b18-85d2-ae8f152e4e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:38.191254 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98227b2-e44a-4b18-85d2-ae8f152e4e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:38.191522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98227b2-e44a-4b18-85d2-ae8f152e4e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:38.191785 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98227b2-e44a-4b18-85d2-ae8f152e4e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:38.192440 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98227b2-e44a-4b18-85d2-ae8f152e4e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:38.194179 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98227b2-e44a-4b18-85d2-ae8f152e4e90 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:38.206121 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1371/2735] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:38:38.210527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04df666-8fef-4b48-b651-783699415d60 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:38.221416 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04df666-8fef-4b48-b651-783699415d60 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:38.226658 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a4f8b-eb09-4a81-bc3e-076e266e4560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:38.227336 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a4f8b-eb09-4a81-bc3e-076e266e4560 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:38.227588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a4f8b-eb09-4a81-bc3e-076e266e4560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:38.227873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a4f8b-eb09-4a81-bc3e-076e266e4560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:38.228524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a4f8b-eb09-4a81-bc3e-076e266e4560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:38.230155 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a4f8b-eb09-4a81-bc3e-076e266e4560 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:38.241857 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1365/2736] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:38:38.246923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98227b2-e44a-4b18-85d2-ae8f152e4e90 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:38.258481 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98227b2-e44a-4b18-85d2-ae8f152e4e90 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:38.265917 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1908-8c63-4ce9-9305-345dcef556b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:38.266949 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1908-8c63-4ce9-9305-345dcef556b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:38.267366 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1908-8c63-4ce9-9305-345dcef556b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:38.267770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1908-8c63-4ce9-9305-345dcef556b6 admin admin] PATH_INFO: `/v3/projects/d71cd0d3c81c43e1ac8d43dcbd877fb1/users/c4d3d5ed7c4a4379affbec91e3ff3181/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:38.286588 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f1908-8c63-4ce9-9305-345dcef556b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71cd0d3c81c43e1ac8d43dcbd877fb1, user_id=c4d3d5ed7c4a4379affbec91e3ff3181, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:38.289670 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f1908-8c63-4ce9-9305-345dcef556b6 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:38.314864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1372/2737] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:38:38 2022] PUT /identity/v3/projects/d71cd0d3c81c43e1ac8d43dcbd877fb1/users/c4d3d5ed7c4a4379affbec91e3ff3181/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:38:38.331799 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720f13d-aaf6-47a7-bf43-8321bfff9585 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:38.332131 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720f13d-aaf6-47a7-bf43-8321bfff9585 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:38.332387 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720f13d-aaf6-47a7-bf43-8321bfff9585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:38.363121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-2720f13d-aaf6-47a7-bf43-8321bfff9585 None None] MFA Rules not processed for user `c4d3d5ed7c4a4379affbec91e3ff3181`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:38.364325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2720f13d-aaf6-47a7-bf43-8321bfff9585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:38.374264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:38.436316 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1366/2738] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:38.441212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1908-8c63-4ce9-9305-345dcef556b6 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:38.505487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1908-8c63-4ce9-9305-345dcef556b6 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:38.510945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334717a-899a-4d57-8c0e-974a98269c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:38.511643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334717a-899a-4d57-8c0e-974a98269c75 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:38.511927 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334717a-899a-4d57-8c0e-974a98269c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:38.512188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334717a-899a-4d57-8c0e-974a98269c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:38.512806 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334717a-899a-4d57-8c0e-974a98269c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:38.514729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334717a-899a-4d57-8c0e-974a98269c75 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:38.545005 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1373/2739] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:38:38 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:38:38.550660 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720f13d-aaf6-47a7-bf43-8321bfff9585 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:38.563406 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720f13d-aaf6-47a7-bf43-8321bfff9585 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:38.623311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6ad38-ed36-4ded-a890-04e4f159b0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:38.623923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6ad38-ed36-4ded-a890-04e4f159b0eb admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:38.624195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6ad38-ed36-4ded-a890-04e4f159b0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:38.624459 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6ad38-ed36-4ded-a890-04e4f159b0eb admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:38.625095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6ad38-ed36-4ded-a890-04e4f159b0eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:38.627682 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6ad38-ed36-4ded-a890-04e4f159b0eb admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:38.658036 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1367/2740] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:38:38 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:38:38.662959 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334717a-899a-4d57-8c0e-974a98269c75 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:38.680839 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334717a-899a-4d57-8c0e-974a98269c75 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:38.686087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c40a1-96dd-40db-9641-3ed35c3dbf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:38.686702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c40a1-96dd-40db-9641-3ed35c3dbf07 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:38.687012 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c40a1-96dd-40db-9641-3ed35c3dbf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:38.687287 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c40a1-96dd-40db-9641-3ed35c3dbf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:38.687936 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c40a1-96dd-40db-9641-3ed35c3dbf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:38.689573 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c40a1-96dd-40db-9641-3ed35c3dbf07 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:38.700750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1374/2741] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:38:38.705034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6ad38-ed36-4ded-a890-04e4f159b0eb admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:38.716838 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6ad38-ed36-4ded-a890-04e4f159b0eb admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:38.723345 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1fa89-d632-4861-aa90-15afb47ca4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:38.723989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1fa89-d632-4861-aa90-15afb47ca4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:38.724276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1fa89-d632-4861-aa90-15afb47ca4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:38.724539 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1fa89-d632-4861-aa90-15afb47ca4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:38.725179 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1fa89-d632-4861-aa90-15afb47ca4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:38.726781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1fa89-d632-4861-aa90-15afb47ca4a8 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:38.738185 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1368/2742] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:38:38.743109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c40a1-96dd-40db-9641-3ed35c3dbf07 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:38.760030 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c40a1-96dd-40db-9641-3ed35c3dbf07 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:38.768952 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c747da3-85bc-41d8-babe-0f40ffee5db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:38.769950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c747da3-85bc-41d8-babe-0f40ffee5db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:38.770282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c747da3-85bc-41d8-babe-0f40ffee5db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:38.770612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c747da3-85bc-41d8-babe-0f40ffee5db0 admin admin] PATH_INFO: `/v3/projects/afb0f83723624020bbfe736b93559d46/users/46ee125575e74e26953a8e2e17adf3a9/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:38.787452 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c747da3-85bc-41d8-babe-0f40ffee5db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb0f83723624020bbfe736b93559d46, user_id=46ee125575e74e26953a8e2e17adf3a9, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:38.790151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c747da3-85bc-41d8-babe-0f40ffee5db0 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:38.805372 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1375/2743] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:38:38 2022] PUT /identity/v3/projects/afb0f83723624020bbfe736b93559d46/users/46ee125575e74e26953a8e2e17adf3a9/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:38.817083 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e352c6-09aa-43f6-823a-d3003ee9c60d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:38.817367 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e352c6-09aa-43f6-823a-d3003ee9c60d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:38.817640 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e352c6-09aa-43f6-823a-d3003ee9c60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:38.847692 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-03e352c6-09aa-43f6-823a-d3003ee9c60d None None] MFA Rules not processed for user `46ee125575e74e26953a8e2e17adf3a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:38.848892 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-03e352c6-09aa-43f6-823a-d3003ee9c60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:38.923400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1369/2744] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:38.928191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c747da3-85bc-41d8-babe-0f40ffee5db0 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:39.006565 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c747da3-85bc-41d8-babe-0f40ffee5db0 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:39.014572 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c1f6f-5ea6-444d-9332-ad1b78080b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:39.015425 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c1f6f-5ea6-444d-9332-ad1b78080b41 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:39.015620 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c1f6f-5ea6-444d-9332-ad1b78080b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:39.015985 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c1f6f-5ea6-444d-9332-ad1b78080b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:39.016909 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c1f6f-5ea6-444d-9332-ad1b78080b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:39.019904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c1f6f-5ea6-444d-9332-ad1b78080b41 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:39.028516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:39.053623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1376/2745] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:38:38 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:38:39.057903 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e352c6-09aa-43f6-823a-d3003ee9c60d None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:39.069490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e352c6-09aa-43f6-823a-d3003ee9c60d None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:39.089911 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:39.134204 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67867cb3-127c-436f-ab72-29863c2fbc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:39.134839 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67867cb3-127c-436f-ab72-29863c2fbc04 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:39.135121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67867cb3-127c-436f-ab72-29863c2fbc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:39.135397 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67867cb3-127c-436f-ab72-29863c2fbc04 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:39.136017 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67867cb3-127c-436f-ab72-29863c2fbc04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:39.137927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67867cb3-127c-436f-ab72-29863c2fbc04 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:39.162864 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1370/2746] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:38:39 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:38:39.167316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c1f6f-5ea6-444d-9332-ad1b78080b41 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:39.178567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c1f6f-5ea6-444d-9332-ad1b78080b41 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:39.183811 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf86d8-943f-4995-992c-c8f1a79d9758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:39.184453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf86d8-943f-4995-992c-c8f1a79d9758 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:39.184725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf86d8-943f-4995-992c-c8f1a79d9758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:39.185000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf86d8-943f-4995-992c-c8f1a79d9758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:39.185647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf86d8-943f-4995-992c-c8f1a79d9758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:39.187294 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf86d8-943f-4995-992c-c8f1a79d9758 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:39.199020 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1377/2747] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:38:39.203834 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67867cb3-127c-436f-ab72-29863c2fbc04 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:39.215237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67867cb3-127c-436f-ab72-29863c2fbc04 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:39.220324 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e30bd-bed1-4499-84c1-e48eee8c293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:39.220979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e30bd-bed1-4499-84c1-e48eee8c293e admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:39.221250 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e30bd-bed1-4499-84c1-e48eee8c293e admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:39.221508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e30bd-bed1-4499-84c1-e48eee8c293e admin admin] PATH_INFO: `/v3/projects/673fc5d63c1c42658554ebd419528d23/users/deec1defa0e74dc3a854cbca1b1297bb/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:39.237589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e30bd-bed1-4499-84c1-e48eee8c293e admin admin] RBAC: Authorizing `identity:create_grant(project_id=673fc5d63c1c42658554ebd419528d23, user_id=deec1defa0e74dc3a854cbca1b1297bb, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:39.240252 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e30bd-bed1-4499-84c1-e48eee8c293e admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:39.256188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1371/2748] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:38:39 2022] PUT /identity/v3/projects/673fc5d63c1c42658554ebd419528d23/users/deec1defa0e74dc3a854cbca1b1297bb/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:39.260277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf86d8-943f-4995-992c-c8f1a79d9758 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:39.270433 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf86d8-943f-4995-992c-c8f1a79d9758 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:39.328861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2cf16-fcc7-4037-9598-b12515be2a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:39.329490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2cf16-fcc7-4037-9598-b12515be2a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:39.329766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2cf16-fcc7-4037-9598-b12515be2a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:39.330031 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2cf16-fcc7-4037-9598-b12515be2a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:39.331024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2cf16-fcc7-4037-9598-b12515be2a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:39.332664 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2cf16-fcc7-4037-9598-b12515be2a6b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:39.343138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1378/2749] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:38:39.348071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e30bd-bed1-4499-84c1-e48eee8c293e admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:39.363888 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e30bd-bed1-4499-84c1-e48eee8c293e admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:39.370351 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb3879-9020-4a5f-bc64-b96e4796cffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:39.371111 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb3879-9020-4a5f-bc64-b96e4796cffa admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:39.371385 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb3879-9020-4a5f-bc64-b96e4796cffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:39.371654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb3879-9020-4a5f-bc64-b96e4796cffa admin admin] PATH_INFO: `/v3/projects/673fc5d63c1c42658554ebd419528d23/users/deec1defa0e74dc3a854cbca1b1297bb/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:39.373849 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb3879-9020-4a5f-bc64-b96e4796cffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=673fc5d63c1c42658554ebd419528d23, user_id=deec1defa0e74dc3a854cbca1b1297bb, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:39.376563 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb3879-9020-4a5f-bc64-b96e4796cffa admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:39.388882 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1372/2750] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:38:39 2022] PUT /identity/v3/projects/673fc5d63c1c42658554ebd419528d23/users/deec1defa0e74dc3a854cbca1b1297bb/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:39.399453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036cb84-ddcb-4bbd-a356-0b94df1382e2 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:39.399734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036cb84-ddcb-4bbd-a356-0b94df1382e2 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:39.400000 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036cb84-ddcb-4bbd-a356-0b94df1382e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:39.436412 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f036cb84-ddcb-4bbd-a356-0b94df1382e2 None None] MFA Rules not processed for user `deec1defa0e74dc3a854cbca1b1297bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:39.437614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f036cb84-ddcb-4bbd-a356-0b94df1382e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:39.512401 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1379/2751] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:39.524781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb3879-9020-4a5f-bc64-b96e4796cffa admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:39.527737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c2cb3879-9020-4a5f-bc64-b96e4796cffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:39.597001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb3879-9020-4a5f-bc64-b96e4796cffa admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:39.601067 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc82209-5d90-4dce-ba5c-77056926ca60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:39.601659 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc82209-5d90-4dce-ba5c-77056926ca60 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:39.601936 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc82209-5d90-4dce-ba5c-77056926ca60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:39.602203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc82209-5d90-4dce-ba5c-77056926ca60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:39.669996 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc82209-5d90-4dce-ba5c-77056926ca60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:39.671524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc82209-5d90-4dce-ba5c-77056926ca60 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:39.681509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1373/2752] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:38:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:38:41.229815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036cb84-ddcb-4bbd-a356-0b94df1382e2 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:41.231569 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f036cb84-ddcb-4bbd-a356-0b94df1382e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:41.245410 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036cb84-ddcb-4bbd-a356-0b94df1382e2 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:41.249727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3895a9a-4e11-401f-8403-413b333d2b66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:41.250322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3895a9a-4e11-401f-8403-413b333d2b66 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:41.250584 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3895a9a-4e11-401f-8403-413b333d2b66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:41.250862 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3895a9a-4e11-401f-8403-413b333d2b66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:41.307816 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:41.310109 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3895a9a-4e11-401f-8403-413b333d2b66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:41.311979 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3895a9a-4e11-401f-8403-413b333d2b66 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:41.322083 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1380/2753] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:38:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:38:41.906059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc82209-5d90-4dce-ba5c-77056926ca60 service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:41.916573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc82209-5d90-4dce-ba5c-77056926ca60 service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:41.921182 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f8d23-7c49-4786-9234-609a9329bbd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:41.921854 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f8d23-7c49-4786-9234-609a9329bbd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:41.922125 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f8d23-7c49-4786-9234-609a9329bbd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:41.922400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f8d23-7c49-4786-9234-609a9329bbd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:41.932439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f8d23-7c49-4786-9234-609a9329bbd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:41.933877 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f8d23-7c49-4786-9234-609a9329bbd9 service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:41.943589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1374/2754] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:38:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:38:45.904613 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3895a9a-4e11-401f-8403-413b333d2b66 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:45.979446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3895a9a-4e11-401f-8403-413b333d2b66 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:45.984566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163a6f7-569c-4d0b-adbf-ffc034ce2fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:45.985199 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163a6f7-569c-4d0b-adbf-ffc034ce2fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:45.985473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163a6f7-569c-4d0b-adbf-ffc034ce2fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:45.985778 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163a6f7-569c-4d0b-adbf-ffc034ce2fcc admin admin] PATH_INFO: `/v3/users/c4d3d5ed7c4a4379affbec91e3ff3181` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:45.987027 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163a6f7-569c-4d0b-adbf-ffc034ce2fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d3d5ed7c4a4379affbec91e3ff3181)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:45.989072 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163a6f7-569c-4d0b-adbf-ffc034ce2fcc admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:46.042400 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b163a6f7-569c-4d0b-adbf-ffc034ce2fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d3d5ed7c4a4379affbec91e3ff3181'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.054098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b163a6f7-569c-4d0b-adbf-ffc034ce2fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d3d5ed7c4a4379affbec91e3ff3181'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.062844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b163a6f7-569c-4d0b-adbf-ffc034ce2fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d3d5ed7c4a4379affbec91e3ff3181'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.063576 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b163a6f7-569c-4d0b-adbf-ffc034ce2fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d3d5ed7c4a4379affbec91e3ff3181'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.064251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-b163a6f7-569c-4d0b-adbf-ffc034ce2fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d3d5ed7c4a4379affbec91e3ff3181'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.076522 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1381/2755] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:38:45 2022] DELETE /identity/v3/users/c4d3d5ed7c4a4379affbec91e3ff3181 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:46.081824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb0c6e-4039-4e1c-b00d-c1362c4749d7 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:46.082318 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb0c6e-4039-4e1c-b00d-c1362c4749d7 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:46.082318 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb0c6e-4039-4e1c-b00d-c1362c4749d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:46.101390 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-02cb0c6e-4039-4e1c-b00d-c1362c4749d7 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:38:46.102560 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-02cb0c6e-4039-4e1c-b00d-c1362c4749d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:46.111294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:46.163195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1375/2756] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:38:46.173669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163a6f7-569c-4d0b-adbf-ffc034ce2fcc admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:46.175652 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b163a6f7-569c-4d0b-adbf-ffc034ce2fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:46.236138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163a6f7-569c-4d0b-adbf-ffc034ce2fcc admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:46.239877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c64577-f315-4a2b-a85c-0ffb5f38d824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:46.240497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c64577-f315-4a2b-a85c-0ffb5f38d824 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:46.240754 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c64577-f315-4a2b-a85c-0ffb5f38d824 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:46.241049 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c64577-f315-4a2b-a85c-0ffb5f38d824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:46.250177 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c64577-f315-4a2b-a85c-0ffb5f38d824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:46.251651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c64577-f315-4a2b-a85c-0ffb5f38d824 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:46.261304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1382/2757] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:38:46.546515 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb0c6e-4039-4e1c-b00d-c1362c4749d7 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:46.551621 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-02cb0c6e-4039-4e1c-b00d-c1362c4749d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:46.572935 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb0c6e-4039-4e1c-b00d-c1362c4749d7 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:46.579466 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:46.580325 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:46.580972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:46.581292 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] PATH_INFO: `/v3/projects/d71cd0d3c81c43e1ac8d43dcbd877fb1` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:46.582510 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71cd0d3c81c43e1ac8d43dcbd877fb1)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:46.584807 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:46.649380 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71cd0d3c81c43e1ac8d43dcbd877fb1', 'request_id': 'req-92c1e8c3-54f7-447b-b0cd-cf801a89f400'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.658919 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71cd0d3c81c43e1ac8d43dcbd877fb1', 'request_id': 'req-92c1e8c3-54f7-447b-b0cd-cf801a89f400'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.665261 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71cd0d3c81c43e1ac8d43dcbd877fb1', 'request_id': 'req-92c1e8c3-54f7-447b-b0cd-cf801a89f400'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.676472 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] The token cache is being invalidate because project d71cd0d3c81c43e1ac8d43dcbd877fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:38:46.676758 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.677425 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.678949 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1376/2758] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:38:46 2022] DELETE /identity/v3/projects/d71cd0d3c81c43e1ac8d43dcbd877fb1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:46.683153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c64577-f315-4a2b-a85c-0ffb5f38d824 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:46.693651 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c64577-f315-4a2b-a85c-0ffb5f38d824 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:46.707024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:46.754309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330df610-2901-4460-a9bb-5c13ced8539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:46.755050 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330df610-2901-4460-a9bb-5c13ced8539b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:46.755328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330df610-2901-4460-a9bb-5c13ced8539b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:46.755597 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330df610-2901-4460-a9bb-5c13ced8539b admin admin] PATH_INFO: `/v3/users/46ee125575e74e26953a8e2e17adf3a9` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:46.756771 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330df610-2901-4460-a9bb-5c13ced8539b admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ee125575e74e26953a8e2e17adf3a9)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:46.758770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330df610-2901-4460-a9bb-5c13ced8539b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:46.808666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-330df610-2901-4460-a9bb-5c13ced8539b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ee125575e74e26953a8e2e17adf3a9'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.822097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-330df610-2901-4460-a9bb-5c13ced8539b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ee125575e74e26953a8e2e17adf3a9'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.830941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-330df610-2901-4460-a9bb-5c13ced8539b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ee125575e74e26953a8e2e17adf3a9'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.831552 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-330df610-2901-4460-a9bb-5c13ced8539b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ee125575e74e26953a8e2e17adf3a9'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.832161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-330df610-2901-4460-a9bb-5c13ced8539b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ee125575e74e26953a8e2e17adf3a9'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:46.847728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1383/2759] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:38:46 2022] DELETE /identity/v3/users/46ee125575e74e26953a8e2e17adf3a9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:47.155320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:47.158944 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:47.173970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1e8c3-54f7-447b-b0cd-cf801a89f400 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:47.234726 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:47.235377 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:47.235643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:47.235910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] PATH_INFO: `/v3/projects/afb0f83723624020bbfe736b93559d46` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:47.237015 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb0f83723624020bbfe736b93559d46)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:47.238985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:47.291541 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:47.299542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb0f83723624020bbfe736b93559d46', 'request_id': 'req-e442c24e-0983-4701-a610-99c71b62618c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.307989 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb0f83723624020bbfe736b93559d46', 'request_id': 'req-e442c24e-0983-4701-a610-99c71b62618c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.313777 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb0f83723624020bbfe736b93559d46', 'request_id': 'req-e442c24e-0983-4701-a610-99c71b62618c'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.326000 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] The token cache is being invalidate because project afb0f83723624020bbfe736b93559d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:38:47.326285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.326953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.328465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1377/2760] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:38:47 2022] DELETE /identity/v3/projects/afb0f83723624020bbfe736b93559d46 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:47.334116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330df610-2901-4460-a9bb-5c13ced8539b admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:47.335817 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-330df610-2901-4460-a9bb-5c13ced8539b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:47.351097 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330df610-2901-4460-a9bb-5c13ced8539b admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:47.415330 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157a990-1bc1-4937-bfa7-c3033da204fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:47.415967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157a990-1bc1-4937-bfa7-c3033da204fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:47.416244 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157a990-1bc1-4937-bfa7-c3033da204fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:47.416510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157a990-1bc1-4937-bfa7-c3033da204fa admin admin] PATH_INFO: `/v3/users/deec1defa0e74dc3a854cbca1b1297bb` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:47.417691 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157a990-1bc1-4937-bfa7-c3033da204fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=deec1defa0e74dc3a854cbca1b1297bb)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:47.419649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157a990-1bc1-4937-bfa7-c3033da204fa admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:47.461837 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:47.469447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a157a990-1bc1-4937-bfa7-c3033da204fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deec1defa0e74dc3a854cbca1b1297bb'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.483182 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a157a990-1bc1-4937-bfa7-c3033da204fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deec1defa0e74dc3a854cbca1b1297bb'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.494446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a157a990-1bc1-4937-bfa7-c3033da204fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deec1defa0e74dc3a854cbca1b1297bb'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.495201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a157a990-1bc1-4937-bfa7-c3033da204fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deec1defa0e74dc3a854cbca1b1297bb'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.496008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-a157a990-1bc1-4937-bfa7-c3033da204fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deec1defa0e74dc3a854cbca1b1297bb'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.508453 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1384/2761] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:38:47 2022] DELETE /identity/v3/users/deec1defa0e74dc3a854cbca1b1297bb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:47.801119 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:47.802584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:47.815524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442c24e-0983-4701-a610-99c71b62618c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:47.885358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:47.886188 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:47.886537 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:47.886882 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] PATH_INFO: `/v3/projects/673fc5d63c1c42658554ebd419528d23` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:47.889171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=673fc5d63c1c42658554ebd419528d23)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:47.891831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:47.945993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '673fc5d63c1c42658554ebd419528d23', 'request_id': 'req-efc2afa4-abf4-4992-b7b9-ad0322a79845'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.955897 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '673fc5d63c1c42658554ebd419528d23', 'request_id': 'req-efc2afa4-abf4-4992-b7b9-ad0322a79845'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.962766 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '673fc5d63c1c42658554ebd419528d23', 'request_id': 'req-efc2afa4-abf4-4992-b7b9-ad0322a79845'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.974313 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] The token cache is being invalidate because project 673fc5d63c1c42658554ebd419528d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:38:47.974589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.975247 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:47.976781 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1378/2762] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:38:47 2022] DELETE /identity/v3/projects/673fc5d63c1c42658554ebd419528d23 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:57.504877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:DELETE=5,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:57.971473 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:39:00.696041 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396709-8ae0-4411-a44e-6aaf62669c97 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:39:00.696608 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396709-8ae0-4411-a44e-6aaf62669c97 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:39:00.696608 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396709-8ae0-4411-a44e-6aaf62669c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:39:00.715916 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-d5396709-8ae0-4411-a44e-6aaf62669c97 None None] MFA Rules not processed for user `62968629eb0e4ccf8713787d6c4aef5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:39:00.717125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d5396709-8ae0-4411-a44e-6aaf62669c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:39:00.775137 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1385/2763] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:39:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:39:01.116972 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:39:01.119033 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:39:01.183567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2afa4-abf4-4992-b7b9-ad0322a79845 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:39:01.188135 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641c7c5-e226-44c6-a8b0-cb6aef2cb1b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:39:01.188751 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641c7c5-e226-44c6-a8b0-cb6aef2cb1b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:39:01.189025 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641c7c5-e226-44c6-a8b0-cb6aef2cb1b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:39:01.189295 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641c7c5-e226-44c6-a8b0-cb6aef2cb1b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:39:01.191328 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f641c7c5-e226-44c6-a8b0-cb6aef2cb1b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:39:01.201392 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641c7c5-e226-44c6-a8b0-cb6aef2cb1b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:39:01.202852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641c7c5-e226-44c6-a8b0-cb6aef2cb1b7 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:39:01.212822 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1379/2764] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:39:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:39:02.582340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396709-8ae0-4411-a44e-6aaf62669c97 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:39:02.583986 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d5396709-8ae0-4411-a44e-6aaf62669c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:39:02.653631 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396709-8ae0-4411-a44e-6aaf62669c97 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:39:02.658751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77b90-904d-4080-b3e3-82f704dbf459 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:39:02.659399 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77b90-904d-4080-b3e3-82f704dbf459 service placement] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:39:02.659673 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77b90-904d-4080-b3e3-82f704dbf459 service placement] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:39:02.659945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77b90-904d-4080-b3e3-82f704dbf459 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:39:02.661884 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cea77b90-904d-4080-b3e3-82f704dbf459 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:39:02.673790 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea77b90-904d-4080-b3e3-82f704dbf459 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:39:02.675421 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea77b90-904d-4080-b3e3-82f704dbf459 service placement] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:39:02.687329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1386/2765] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:39:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:39:11.207705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=26 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:39:12.681907 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=57 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:39:12.795289 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641c7c5-e226-44c6-a8b0-cb6aef2cb1b7 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:39:12.796788 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f641c7c5-e226-44c6-a8b0-cb6aef2cb1b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:39:12.877199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641c7c5-e226-44c6-a8b0-cb6aef2cb1b7 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:39:12.883370 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7cca8-f69f-4d45-9a01-48a2c05d2f0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:39:12.883976 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7cca8-f69f-4d45-9a01-48a2c05d2f0d service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:39:12.884252 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7cca8-f69f-4d45-9a01-48a2c05d2f0d service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:39:12.884517 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7cca8-f69f-4d45-9a01-48a2c05d2f0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:39:12.886462 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e3b7cca8-f69f-4d45-9a01-48a2c05d2f0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:39:12.899057 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7cca8-f69f-4d45-9a01-48a2c05d2f0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:39:12.900678 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7cca8-f69f-4d45-9a01-48a2c05d2f0d service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:39:12.912105 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1380/2766] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:39:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:39:22.907116 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=34 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:40:05.441559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77b90-904d-4080-b3e3-82f704dbf459 service placement] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:40:05.443586 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cea77b90-904d-4080-b3e3-82f704dbf459 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:40:05.462054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77b90-904d-4080-b3e3-82f704dbf459 service placement] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:40:05.469370 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15da74b-b78d-4b37-904a-3b46ce031bfd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:40:05.469974 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15da74b-b78d-4b37-904a-3b46ce031bfd service placement] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:40:05.470242 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15da74b-b78d-4b37-904a-3b46ce031bfd service placement] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:40:05.470502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15da74b-b78d-4b37-904a-3b46ce031bfd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:40:05.472805 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b15da74b-b78d-4b37-904a-3b46ce031bfd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:40:05.485484 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15da74b-b78d-4b37-904a-3b46ce031bfd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:40:05.487117 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15da74b-b78d-4b37-904a-3b46ce031bfd service placement] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:40:05.497378 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1387/2767] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:40:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:40:15.493008 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=6 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:40:31.709645 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7cca8-f69f-4d45-9a01-48a2c05d2f0d service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:40:31.721532 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7cca8-f69f-4d45-9a01-48a2c05d2f0d service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:40:31.728383 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce82c0f-2132-48ce-b884-0cb90ec542f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:40:31.728968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82c0f-2132-48ce-b884-0cb90ec542f6 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:40:31.729242 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82c0f-2132-48ce-b884-0cb90ec542f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:40:31.729509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82c0f-2132-48ce-b884-0cb90ec542f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:40:31.731456 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-dce82c0f-2132-48ce-b884-0cb90ec542f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:40:31.742470 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce82c0f-2132-48ce-b884-0cb90ec542f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:40:31.744089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce82c0f-2132-48ce-b884-0cb90ec542f6 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:40:31.753374 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1381/2768] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:40:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:40:41.749004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=6 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:40:49.936682 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30bbe7-d2bb-4e5b-842d-2747fa02dc25 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:40:49.937163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30bbe7-d2bb-4e5b-842d-2747fa02dc25 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:40:49.937269 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30bbe7-d2bb-4e5b-842d-2747fa02dc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:40:49.957343 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-1f30bbe7-d2bb-4e5b-842d-2747fa02dc25 None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:40:49.958592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1f30bbe7-d2bb-4e5b-842d-2747fa02dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:40:50.013069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1388/2769] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:40:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:40:50.068373 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce82c0f-2132-48ce-b884-0cb90ec542f6 service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:40:50.069998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-dce82c0f-2132-48ce-b884-0cb90ec542f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:40:50.141742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce82c0f-2132-48ce-b884-0cb90ec542f6 service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:40:50.147348 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cacc71-47ba-401d-aef2-42d22e9d92d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:40:50.147950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cacc71-47ba-401d-aef2-42d22e9d92d5 service swift] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:40:50.148220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cacc71-47ba-401d-aef2-42d22e9d92d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:40:50.148482 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cacc71-47ba-401d-aef2-42d22e9d92d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:40:50.156906 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cacc71-47ba-401d-aef2-42d22e9d92d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:40:50.158471 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cacc71-47ba-401d-aef2-42d22e9d92d5 service swift] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:40:50.166871 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1382/2770] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:40:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:41:00.006145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=25 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:41:00.163750 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=32 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:41:04.000993 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30bbe7-d2bb-4e5b-842d-2747fa02dc25 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:41:04.002657 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1f30bbe7-d2bb-4e5b-842d-2747fa02dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:41:04.015381 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30bbe7-d2bb-4e5b-842d-2747fa02dc25 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:41:04.019415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716e4e8-77f2-4268-a6ef-addc8ae62ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:41:04.020028 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716e4e8-77f2-4268-a6ef-addc8ae62ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:41:04.020311 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716e4e8-77f2-4268-a6ef-addc8ae62ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:41:04.020667 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716e4e8-77f2-4268-a6ef-addc8ae62ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:41:04.023126 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9716e4e8-77f2-4268-a6ef-addc8ae62ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:41:04.033704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716e4e8-77f2-4268-a6ef-addc8ae62ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:41:04.035186 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716e4e8-77f2-4268-a6ef-addc8ae62ef7 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:41:04.043703 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1389/2771] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:41:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:41:04.118002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cacc71-47ba-401d-aef2-42d22e9d92d5 service swift] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:41:04.127614 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cacc71-47ba-401d-aef2-42d22e9d92d5 service swift] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:41:04.131327 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e0c6a-37fc-4b99-ac61-351b4b104078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:41:04.132567 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e0c6a-37fc-4b99-ac61-351b4b104078 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:41:04.133024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e0c6a-37fc-4b99-ac61-351b4b104078 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:41:04.133146 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e0c6a-37fc-4b99-ac61-351b4b104078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:41:04.135983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-fe4e0c6a-37fc-4b99-ac61-351b4b104078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:41:04.153379 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e0c6a-37fc-4b99-ac61-351b4b104078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:41:04.154880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e0c6a-37fc-4b99-ac61-351b4b104078 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:41:04.166434 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1383/2772] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:41:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:41:05.918961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312a3c8-e633-4281-8aba-5fe0095cb404 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:41:05.919460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312a3c8-e633-4281-8aba-5fe0095cb404 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:41:05.919460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312a3c8-e633-4281-8aba-5fe0095cb404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:41:05.939282 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-f312a3c8-e633-4281-8aba-5fe0095cb404 None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:41:05.940478 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-f312a3c8-e633-4281-8aba-5fe0095cb404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:41:05.948262 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1390/2773] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Aug 9 11:41:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:41:05.960832 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e0c6a-37fc-4b99-ac61-351b4b104078 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:41:05.972895 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e0c6a-37fc-4b99-ac61-351b4b104078 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:41:05.979066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938aac9-8078-47fa-84be-eafee055979b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:41:05.979661 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938aac9-8078-47fa-84be-eafee055979b service swift] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:41:05.979938 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938aac9-8078-47fa-84be-eafee055979b service swift] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:41:05.980205 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938aac9-8078-47fa-84be-eafee055979b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:41:05.989420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938aac9-8078-47fa-84be-eafee055979b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:41:05.990992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938aac9-8078-47fa-84be-eafee055979b service swift] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:41:05.999271 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1384/2774] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:41:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:41:09.978491 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312a3c8-e633-4281-8aba-5fe0095cb404 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:41:09.989235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312a3c8-e633-4281-8aba-5fe0095cb404 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:41:09.993300 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a3f5b-ae25-4ba8-8610-12660b1b9e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:41:09.994019 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a3f5b-ae25-4ba8-8610-12660b1b9e03 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:41:09.994397 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a3f5b-ae25-4ba8-8610-12660b1b9e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:41:09.994666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a3f5b-ae25-4ba8-8610-12660b1b9e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:41:09.997142 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-ba4a3f5b-ae25-4ba8-8610-12660b1b9e03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:41:10.013212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a3f5b-ae25-4ba8-8610-12660b1b9e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:41:10.014750 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a3f5b-ae25-4ba8-8610-12660b1b9e03 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:41:10.026538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1391/2775] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:41:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:41:11.233104 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938aac9-8078-47fa-84be-eafee055979b service swift] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:41:11.244393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938aac9-8078-47fa-84be-eafee055979b service swift] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:41:11.248734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6235aa-b5de-4391-b027-02b6ce0c21d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:41:11.249615 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6235aa-b5de-4391-b027-02b6ce0c21d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:41:11.250223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6235aa-b5de-4391-b027-02b6ce0c21d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:41:11.250697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6235aa-b5de-4391-b027-02b6ce0c21d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:41:11.252860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6a6235aa-b5de-4391-b027-02b6ce0c21d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:41:11.276043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6235aa-b5de-4391-b027-02b6ce0c21d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:41:11.277509 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6235aa-b5de-4391-b027-02b6ce0c21d9 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:41:11.288305 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1385/2776] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:41:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:41:20.021024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=15 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:41:21.283715 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=18 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:41:23.644815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1687993-10ee-4535-aeda-993a90c9eecd None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:41:23.645307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1687993-10ee-4535-aeda-993a90c9eecd None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:41:23.645307 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1687993-10ee-4535-aeda-993a90c9eecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:41:23.666861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-a1687993-10ee-4535-aeda-993a90c9eecd None None] MFA Rules not processed for user `2c0549bc0a3445b48aa7fa7e341f8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:41:23.668079 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a1687993-10ee-4535-aeda-993a90c9eecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:41:23.676101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1392/2777] 10.222.0.59 () {58 vars in 967 bytes} [Tue Aug 9 11:41:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:41:23.688697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6235aa-b5de-4391-b027-02b6ce0c21d9 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:41:23.701085 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6235aa-b5de-4391-b027-02b6ce0c21d9 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:41:23.707191 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ddb91-fefc-4a08-a2a3-010d61036b7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913447120a2e42d8affdf50bb74dc5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:41:23.707789 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ddb91-fefc-4a08-a2a3-010d61036b7b service swift] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:41:23.708066 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ddb91-fefc-4a08-a2a3-010d61036b7b service swift] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:41:23.708338 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ddb91-fefc-4a08-a2a3-010d61036b7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:41:23.717143 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ddb91-fefc-4a08-a2a3-010d61036b7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:41:23.718860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ddb91-fefc-4a08-a2a3-010d61036b7b service swift] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:41:23.727589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1386/2778] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Aug 9 11:41:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:41:33.661918 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:41:33.723982 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=6 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:07.124464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1687993-10ee-4535-aeda-993a90c9eecd None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:07.134848 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1687993-10ee-4535-aeda-993a90c9eecd None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:07.139155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eac81f-5e6d-45c7-b60d-6466c39a73df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:07.139751 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eac81f-5e6d-45c7-b60d-6466c39a73df service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:07.140026 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eac81f-5e6d-45c7-b60d-6466c39a73df service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:07.140292 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eac81f-5e6d-45c7-b60d-6466c39a73df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:07.142214 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-a8eac81f-5e6d-45c7-b60d-6466c39a73df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:07.152829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eac81f-5e6d-45c7-b60d-6466c39a73df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:07.154265 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eac81f-5e6d-45c7-b60d-6466c39a73df service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:07.165596 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1393/2779] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:42:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:42:17.159486 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=6 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:22.690867 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ddb91-fefc-4a08-a2a3-010d61036b7b service swift] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:22.706733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ddb91-fefc-4a08-a2a3-010d61036b7b service swift] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:22.712215 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c5560-04f7-42dc-971a-e9a5bdb03fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:22.712831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c5560-04f7-42dc-971a-e9a5bdb03fab service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:22.719214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c5560-04f7-42dc-971a-e9a5bdb03fab service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:22.722303 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c5560-04f7-42dc-971a-e9a5bdb03fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:22.724366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-492c5560-04f7-42dc-971a-e9a5bdb03fab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:22.741072 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c5560-04f7-42dc-971a-e9a5bdb03fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:22.742749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c5560-04f7-42dc-971a-e9a5bdb03fab service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:22.759580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1387/2780] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:42:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:42:26.887514 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eac81f-5e6d-45c7-b60d-6466c39a73df service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:26.897990 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eac81f-5e6d-45c7-b60d-6466c39a73df service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:26.902084 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357daa5-60c5-4b4e-9a1b-c560e44378e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:26.902692 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357daa5-60c5-4b4e-9a1b-c560e44378e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:26.903026 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357daa5-60c5-4b4e-9a1b-c560e44378e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:26.903291 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357daa5-60c5-4b4e-9a1b-c560e44378e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:26.905903 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9357daa5-60c5-4b4e-9a1b-c560e44378e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:27.107064 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357daa5-60c5-4b4e-9a1b-c560e44378e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:27.108583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357daa5-60c5-4b4e-9a1b-c560e44378e5 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:27.119018 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1394/2781] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:42:30.269754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c5560-04f7-42dc-971a-e9a5bdb03fab service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:30.282320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c5560-04f7-42dc-971a-e9a5bdb03fab service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:30.288241 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567e1f6-7442-4bb7-b3f2-914114ed9087 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:30.289099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567e1f6-7442-4bb7-b3f2-914114ed9087 service placement] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:30.289444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567e1f6-7442-4bb7-b3f2-914114ed9087 service placement] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:30.289880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567e1f6-7442-4bb7-b3f2-914114ed9087 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:30.291968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-c567e1f6-7442-4bb7-b3f2-914114ed9087 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:30.306300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567e1f6-7442-4bb7-b3f2-914114ed9087 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:30.309637 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567e1f6-7442-4bb7-b3f2-914114ed9087 service placement] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:30.325196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1388/2782] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:42:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:42:30.344842 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357daa5-60c5-4b4e-9a1b-c560e44378e5 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:30.346479 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9357daa5-60c5-4b4e-9a1b-c560e44378e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:30.361681 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357daa5-60c5-4b4e-9a1b-c560e44378e5 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:30.366578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2e4fa-e96e-4c8f-8943-08a8672bd0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:30.367234 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2e4fa-e96e-4c8f-8943-08a8672bd0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:30.367506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2e4fa-e96e-4c8f-8943-08a8672bd0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:30.367773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2e4fa-e96e-4c8f-8943-08a8672bd0f4 admin admin] PATH_INFO: `/v3/users/62968629eb0e4ccf8713787d6c4aef5b` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:30.368883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2e4fa-e96e-4c8f-8943-08a8672bd0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62968629eb0e4ccf8713787d6c4aef5b)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:30.370789 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2e4fa-e96e-4c8f-8943-08a8672bd0f4 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:30.418354 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d9e2e4fa-e96e-4c8f-8943-08a8672bd0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62968629eb0e4ccf8713787d6c4aef5b'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:30.432462 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d9e2e4fa-e96e-4c8f-8943-08a8672bd0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62968629eb0e4ccf8713787d6c4aef5b'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:30.441260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d9e2e4fa-e96e-4c8f-8943-08a8672bd0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62968629eb0e4ccf8713787d6c4aef5b'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:30.441897 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d9e2e4fa-e96e-4c8f-8943-08a8672bd0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62968629eb0e4ccf8713787d6c4aef5b'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:30.442548 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-d9e2e4fa-e96e-4c8f-8943-08a8672bd0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62968629eb0e4ccf8713787d6c4aef5b'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:30.455516 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1395/2783] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:42:30 2022] DELETE /identity/v3/users/62968629eb0e4ccf8713787d6c4aef5b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:42:30.651075 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567e1f6-7442-4bb7-b3f2-914114ed9087 service placement] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:30.664223 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567e1f6-7442-4bb7-b3f2-914114ed9087 service placement] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:30.723353 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:30.723986 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:30.724270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:30.724543 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4 admin admin] PATH_INFO: `/v3/projects/4f10ad025e8e405e82f06156adef690e` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:30.725683 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f10ad025e8e405e82f06156adef690e)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:30.727630 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:30.781888 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f10ad025e8e405e82f06156adef690e', 'request_id': 'req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:30.790369 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f10ad025e8e405e82f06156adef690e', 'request_id': 'req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:30.796300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f10ad025e8e405e82f06156adef690e', 'request_id': 'req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:30.807171 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4 admin admin] The token cache is being invalidate because project 4f10ad025e8e405e82f06156adef690e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:42:30.807460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:30.808081 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2c40c9ec-e55d-40e2-b0e7-af078bbfc8c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:30.809609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1389/2784] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:42:30 2022] DELETE /identity/v3/projects/4f10ad025e8e405e82f06156adef690e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:30.814678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15506508-8704-4649-9023-8a8cb8db5e8c None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:30.814931 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15506508-8704-4649-9023-8a8cb8db5e8c None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:30.815201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15506508-8704-4649-9023-8a8cb8db5e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:30.835212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-15506508-8704-4649-9023-8a8cb8db5e8c None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:42:30.836409 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-15506508-8704-4649-9023-8a8cb8db5e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:30.903972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1396/2785] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:42:30.912897 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c54a7-2e87-4f96-a539-d4e9892e9455 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:30.913151 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c54a7-2e87-4f96-a539-d4e9892e9455 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:30.913511 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c54a7-2e87-4f96-a539-d4e9892e9455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:30.934639 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-601c54a7-2e87-4f96-a539-d4e9892e9455 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:42:30.935947 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-601c54a7-2e87-4f96-a539-d4e9892e9455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:30.944437 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1390/2786] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:42:30.948907 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15506508-8704-4649-9023-8a8cb8db5e8c None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:30.959583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15506508-8704-4649-9023-8a8cb8db5e8c None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:30.966301 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0b3d9-951d-4a1a-8582-7c5c7277b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:30.966944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0b3d9-951d-4a1a-8582-7c5c7277b4ab admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:30.967219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0b3d9-951d-4a1a-8582-7c5c7277b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:30.967465 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0b3d9-951d-4a1a-8582-7c5c7277b4ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:30.968146 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0b3d9-951d-4a1a-8582-7c5c7277b4ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:42:30.968437 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0b3d9-951d-4a1a-8582-7c5c7277b4ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:30.970040 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0b3d9-951d-4a1a-8582-7c5c7277b4ab admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:30.971622 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:30.986362 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1397/2787] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:42:30.990992 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c54a7-2e87-4f96-a539-d4e9892e9455 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:31.001354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c54a7-2e87-4f96-a539-d4e9892e9455 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:31.007300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43ddb8-4117-404e-b3d9-79a2578c70ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:31.007907 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43ddb8-4117-404e-b3d9-79a2578c70ec admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:31.008175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43ddb8-4117-404e-b3d9-79a2578c70ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:31.008439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43ddb8-4117-404e-b3d9-79a2578c70ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:31.009078 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43ddb8-4117-404e-b3d9-79a2578c70ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:31.011005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43ddb8-4117-404e-b3d9-79a2578c70ec admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:31.043661 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1391/2788] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:42:30 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:42:31.048783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0b3d9-951d-4a1a-8582-7c5c7277b4ab admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:31.060280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0b3d9-951d-4a1a-8582-7c5c7277b4ab admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:31.125443 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b22822-77a6-4f55-975b-c6af77a14eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:31.126052 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b22822-77a6-4f55-975b-c6af77a14eef admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:31.126328 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b22822-77a6-4f55-975b-c6af77a14eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:31.126608 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b22822-77a6-4f55-975b-c6af77a14eef admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:31.127255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b22822-77a6-4f55-975b-c6af77a14eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:31.129166 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b22822-77a6-4f55-975b-c6af77a14eef admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:31.152476 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1398/2789] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:42:31 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:42:31.157055 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43ddb8-4117-404e-b3d9-79a2578c70ec admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:31.167739 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43ddb8-4117-404e-b3d9-79a2578c70ec admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:31.173396 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96dc2f-bda0-4b23-8113-acab7d598952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:31.173986 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96dc2f-bda0-4b23-8113-acab7d598952 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:31.174287 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96dc2f-bda0-4b23-8113-acab7d598952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:31.174549 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96dc2f-bda0-4b23-8113-acab7d598952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:31.175212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96dc2f-bda0-4b23-8113-acab7d598952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:31.176819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96dc2f-bda0-4b23-8113-acab7d598952 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:31.187144 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1392/2790] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:42:31.193725 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b22822-77a6-4f55-975b-c6af77a14eef admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:31.210716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b22822-77a6-4f55-975b-c6af77a14eef admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:31.217809 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c44ef5-1756-4443-8f64-81efb96faeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:31.218411 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c44ef5-1756-4443-8f64-81efb96faeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:31.218685 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c44ef5-1756-4443-8f64-81efb96faeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:31.218996 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c44ef5-1756-4443-8f64-81efb96faeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:31.219653 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c44ef5-1756-4443-8f64-81efb96faeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:31.221257 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c44ef5-1756-4443-8f64-81efb96faeb1 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:31.232559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1399/2791] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:42:31.238053 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96dc2f-bda0-4b23-8113-acab7d598952 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:31.253416 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96dc2f-bda0-4b23-8113-acab7d598952 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:31.261776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e1412-cfc2-408b-b76c-2e5b67874708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:31.262716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e1412-cfc2-408b-b76c-2e5b67874708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:31.263153 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e1412-cfc2-408b-b76c-2e5b67874708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:31.263504 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e1412-cfc2-408b-b76c-2e5b67874708 admin admin] PATH_INFO: `/v3/projects/f8736eb333e444369ca3a6385fa97d28/users/99751d4636684ec6aa99aed7a1731553/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:31.283704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e1412-cfc2-408b-b76c-2e5b67874708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8736eb333e444369ca3a6385fa97d28, user_id=99751d4636684ec6aa99aed7a1731553, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:31.286671 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e1412-cfc2-408b-b76c-2e5b67874708 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:31.296973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:31.301895 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1393/2792] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:42:31 2022] PUT /identity/v3/projects/f8736eb333e444369ca3a6385fa97d28/users/99751d4636684ec6aa99aed7a1731553/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:31.312587 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c5d3e-d913-4ed9-974a-1cc35f833153 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:31.312855 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c5d3e-d913-4ed9-974a-1cc35f833153 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:31.313118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c5d3e-d913-4ed9-974a-1cc35f833153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:31.340772 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-7a0c5d3e-d913-4ed9-974a-1cc35f833153 None None] MFA Rules not processed for user `99751d4636684ec6aa99aed7a1731553`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:42:31.341918 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-7a0c5d3e-d913-4ed9-974a-1cc35f833153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:31.411003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1400/2793] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:42:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:42:31.417431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e1412-cfc2-408b-b76c-2e5b67874708 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:31.482584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e1412-cfc2-408b-b76c-2e5b67874708 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:31.488159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9b28c-131d-43bb-9ced-7b16dffa63cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:31.488767 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9b28c-131d-43bb-9ced-7b16dffa63cc admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:31.489043 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9b28c-131d-43bb-9ced-7b16dffa63cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:31.489321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9b28c-131d-43bb-9ced-7b16dffa63cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:31.489948 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9b28c-131d-43bb-9ced-7b16dffa63cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:31.491927 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9b28c-131d-43bb-9ced-7b16dffa63cc admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:31.521251 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1394/2794] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:42:31 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:42:31.525323 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c5d3e-d913-4ed9-974a-1cc35f833153 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:31.536800 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c5d3e-d913-4ed9-974a-1cc35f833153 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:31.606713 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fddcf-a067-456b-b16d-925b902ec6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:31.607502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fddcf-a067-456b-b16d-925b902ec6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:31.607872 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fddcf-a067-456b-b16d-925b902ec6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:31.608236 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fddcf-a067-456b-b16d-925b902ec6a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:31.608957 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fddcf-a067-456b-b16d-925b902ec6a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:31.611024 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fddcf-a067-456b-b16d-925b902ec6a4 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:31.620381 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:31.634357 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1401/2795] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:42:31 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:42:31.638559 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9b28c-131d-43bb-9ced-7b16dffa63cc admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:31.649385 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9b28c-131d-43bb-9ced-7b16dffa63cc admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:31.655118 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872111cc-8441-4c6a-b052-3d27a35aeb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:31.655732 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872111cc-8441-4c6a-b052-3d27a35aeb46 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:31.656004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872111cc-8441-4c6a-b052-3d27a35aeb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:31.656271 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872111cc-8441-4c6a-b052-3d27a35aeb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:31.656913 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872111cc-8441-4c6a-b052-3d27a35aeb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:31.658555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872111cc-8441-4c6a-b052-3d27a35aeb46 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:31.670517 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1395/2796] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:42:31.674860 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fddcf-a067-456b-b16d-925b902ec6a4 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:31.685612 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fddcf-a067-456b-b16d-925b902ec6a4 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:31.690743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3672e46-123f-4a6f-9f04-21ed032f676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:31.691426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3672e46-123f-4a6f-9f04-21ed032f676c admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:31.691702 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3672e46-123f-4a6f-9f04-21ed032f676c admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:31.691973 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3672e46-123f-4a6f-9f04-21ed032f676c admin admin] PATH_INFO: `/v3/projects/66f226439e504c9bbe5302abebc2eed0/users/4db2f28873e1426a9998ddc384c7c2f7/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:31.708003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3672e46-123f-4a6f-9f04-21ed032f676c admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f226439e504c9bbe5302abebc2eed0, user_id=4db2f28873e1426a9998ddc384c7c2f7, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:31.710664 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3672e46-123f-4a6f-9f04-21ed032f676c admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:31.726592 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1402/2797] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:42:31 2022] PUT /identity/v3/projects/66f226439e504c9bbe5302abebc2eed0/users/4db2f28873e1426a9998ddc384c7c2f7/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:31.730613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872111cc-8441-4c6a-b052-3d27a35aeb46 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:31.741082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872111cc-8441-4c6a-b052-3d27a35aeb46 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:31.802224 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3780e-db80-4687-93d3-5fa8e492f63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:31.802908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3780e-db80-4687-93d3-5fa8e492f63f admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:31.803186 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3780e-db80-4687-93d3-5fa8e492f63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:31.803488 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3780e-db80-4687-93d3-5fa8e492f63f admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:31.804137 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3780e-db80-4687-93d3-5fa8e492f63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:31.805811 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3780e-db80-4687-93d3-5fa8e492f63f admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:31.816528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1396/2798] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:42:31.821103 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3672e46-123f-4a6f-9f04-21ed032f676c admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:31.832225 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3672e46-123f-4a6f-9f04-21ed032f676c admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:31.837620 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3deb416-7eae-476b-b50e-1046f4d02a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:31.838258 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deb416-7eae-476b-b50e-1046f4d02a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:31.838527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deb416-7eae-476b-b50e-1046f4d02a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:31.838791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deb416-7eae-476b-b50e-1046f4d02a6d admin admin] PATH_INFO: `/v3/projects/66f226439e504c9bbe5302abebc2eed0/users/4db2f28873e1426a9998ddc384c7c2f7/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:31.841125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3deb416-7eae-476b-b50e-1046f4d02a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f226439e504c9bbe5302abebc2eed0, user_id=4db2f28873e1426a9998ddc384c7c2f7, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:31.843850 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3deb416-7eae-476b-b50e-1046f4d02a6d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:31.854556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1403/2799] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:42:31 2022] PUT /identity/v3/projects/66f226439e504c9bbe5302abebc2eed0/users/4db2f28873e1426a9998ddc384c7c2f7/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:31.865701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abb01e-3f3c-4dbe-9126-2fc84cec14c5 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:31.866024 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abb01e-3f3c-4dbe-9126-2fc84cec14c5 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:31.866354 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abb01e-3f3c-4dbe-9126-2fc84cec14c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:31.898589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-31abb01e-3f3c-4dbe-9126-2fc84cec14c5 None None] MFA Rules not processed for user `4db2f28873e1426a9998ddc384c7c2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:42:31.899876 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-31abb01e-3f3c-4dbe-9126-2fc84cec14c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:31.975399 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:31.985212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1397/2800] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:42:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:42:31.997105 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3deb416-7eae-476b-b50e-1046f4d02a6d admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:31.998917 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e3deb416-7eae-476b-b50e-1046f4d02a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:32.059235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3deb416-7eae-476b-b50e-1046f4d02a6d admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:32.063316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d90002-21c9-4d09-8761-45f8d5bab4e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:32.063926 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d90002-21c9-4d09-8761-45f8d5bab4e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:32.064196 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d90002-21c9-4d09-8761-45f8d5bab4e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:32.064464 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d90002-21c9-4d09-8761-45f8d5bab4e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:32.073630 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d90002-21c9-4d09-8761-45f8d5bab4e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:32.075161 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d90002-21c9-4d09-8761-45f8d5bab4e0 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:32.084834 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1404/2801] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:42:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:42:32.164460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abb01e-3f3c-4dbe-9126-2fc84cec14c5 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:32.177133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abb01e-3f3c-4dbe-9126-2fc84cec14c5 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:32.182174 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21415f-cbb4-42b3-ab32-7ff83914ecec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:32.182784 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21415f-cbb4-42b3-ab32-7ff83914ecec service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:32.183088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21415f-cbb4-42b3-ab32-7ff83914ecec service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:32.183360 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21415f-cbb4-42b3-ab32-7ff83914ecec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:32.246298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21415f-cbb4-42b3-ab32-7ff83914ecec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:32.247758 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21415f-cbb4-42b3-ab32-7ff83914ecec service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:32.257123 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1398/2802] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:42:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:42:42.080931 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:42.252588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=30 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:42.710608 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d90002-21c9-4d09-8761-45f8d5bab4e0 service cinder] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:42.773669 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d90002-21c9-4d09-8761-45f8d5bab4e0 service cinder] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:42.780196 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14cb07-5c60-4944-8906-aed8aa064e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:42.780799 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14cb07-5c60-4944-8906-aed8aa064e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:42.781069 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14cb07-5c60-4944-8906-aed8aa064e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:42.781332 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14cb07-5c60-4944-8906-aed8aa064e8c admin admin] PATH_INFO: `/v3/users/99751d4636684ec6aa99aed7a1731553` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:42.782506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14cb07-5c60-4944-8906-aed8aa064e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=99751d4636684ec6aa99aed7a1731553)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:42.784463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14cb07-5c60-4944-8906-aed8aa064e8c admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:42.833179 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-cd14cb07-5c60-4944-8906-aed8aa064e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99751d4636684ec6aa99aed7a1731553'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:42.844783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-cd14cb07-5c60-4944-8906-aed8aa064e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99751d4636684ec6aa99aed7a1731553'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:42.852915 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-cd14cb07-5c60-4944-8906-aed8aa064e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99751d4636684ec6aa99aed7a1731553'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:42.853697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-cd14cb07-5c60-4944-8906-aed8aa064e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99751d4636684ec6aa99aed7a1731553'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:42.854415 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-cd14cb07-5c60-4944-8906-aed8aa064e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99751d4636684ec6aa99aed7a1731553'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:42.866617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1405/2803] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:42:42 2022] DELETE /identity/v3/users/99751d4636684ec6aa99aed7a1731553 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:42.871267 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c5ec1-11a8-4ba3-bdcd-c7df6f291318 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:42.871555 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c5ec1-11a8-4ba3-bdcd-c7df6f291318 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:42.871828 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c5ec1-11a8-4ba3-bdcd-c7df6f291318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:42.890860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-4b7c5ec1-11a8-4ba3-bdcd-c7df6f291318 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:42:42.892101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4b7c5ec1-11a8-4ba3-bdcd-c7df6f291318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:42.953716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1399/2804] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:42:42.965068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14cb07-5c60-4944-8906-aed8aa064e8c admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:42.966595 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cd14cb07-5c60-4944-8906-aed8aa064e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:43.029615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14cb07-5c60-4944-8906-aed8aa064e8c admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:43.033658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8c34f-e083-48f1-b209-2fec64abfdde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:43.034260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8c34f-e083-48f1-b209-2fec64abfdde service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:43.034510 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8c34f-e083-48f1-b209-2fec64abfdde service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:43.034797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8c34f-e083-48f1-b209-2fec64abfdde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:43.044666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8c34f-e083-48f1-b209-2fec64abfdde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:43.046104 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8c34f-e083-48f1-b209-2fec64abfdde service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:43.056675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1406/2805] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:42:43.339917 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c5ec1-11a8-4ba3-bdcd-c7df6f291318 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:43.341930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4b7c5ec1-11a8-4ba3-bdcd-c7df6f291318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:43.359613 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c5ec1-11a8-4ba3-bdcd-c7df6f291318 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:43.365202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:43.365913 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:43.366181 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:43.366447 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] PATH_INFO: `/v3/projects/f8736eb333e444369ca3a6385fa97d28` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:43.367689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8736eb333e444369ca3a6385fa97d28)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:43.370517 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:43.422405 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8736eb333e444369ca3a6385fa97d28', 'request_id': 'req-0daefb8a-0b2a-4c43-9d07-99771ee7589b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:43.430039 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8736eb333e444369ca3a6385fa97d28', 'request_id': 'req-0daefb8a-0b2a-4c43-9d07-99771ee7589b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:43.435779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8736eb333e444369ca3a6385fa97d28', 'request_id': 'req-0daefb8a-0b2a-4c43-9d07-99771ee7589b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:43.446858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] The token cache is being invalidate because project f8736eb333e444369ca3a6385fa97d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:42:43.447164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:43.447802 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:43.449329 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1400/2806] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:42:43 2022] DELETE /identity/v3/projects/f8736eb333e444369ca3a6385fa97d28 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:43.453749 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8c34f-e083-48f1-b209-2fec64abfdde service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:43.464576 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8c34f-e083-48f1-b209-2fec64abfdde service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:43.485091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:43.525527 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899fe3b-3876-4836-9b3b-17e316f6f2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:43.526158 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899fe3b-3876-4836-9b3b-17e316f6f2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:43.526446 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899fe3b-3876-4836-9b3b-17e316f6f2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:43.526703 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899fe3b-3876-4836-9b3b-17e316f6f2b3 admin admin] PATH_INFO: `/v3/users/4db2f28873e1426a9998ddc384c7c2f7` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:43.527846 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899fe3b-3876-4836-9b3b-17e316f6f2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db2f28873e1426a9998ddc384c7c2f7)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:43.529766 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899fe3b-3876-4836-9b3b-17e316f6f2b3 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:43.581017 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e899fe3b-3876-4836-9b3b-17e316f6f2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db2f28873e1426a9998ddc384c7c2f7'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:43.592650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e899fe3b-3876-4836-9b3b-17e316f6f2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db2f28873e1426a9998ddc384c7c2f7'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:43.601129 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e899fe3b-3876-4836-9b3b-17e316f6f2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db2f28873e1426a9998ddc384c7c2f7'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:43.601877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e899fe3b-3876-4836-9b3b-17e316f6f2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db2f28873e1426a9998ddc384c7c2f7'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:43.602503 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e899fe3b-3876-4836-9b3b-17e316f6f2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db2f28873e1426a9998ddc384c7c2f7'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:43.614765 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1407/2807] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:42:43 2022] DELETE /identity/v3/users/4db2f28873e1426a9998ddc384c7c2f7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:43.909991 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:43.911931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:43.929107 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daefb8a-0b2a-4c43-9d07-99771ee7589b admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:43.988779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:43.989324 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:43.989631 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:43.989869 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9 admin admin] PATH_INFO: `/v3/projects/66f226439e504c9bbe5302abebc2eed0` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:43.991037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f226439e504c9bbe5302abebc2eed0)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:43.992970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:44.026064 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:44.044931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f226439e504c9bbe5302abebc2eed0', 'request_id': 'req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:44.052442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f226439e504c9bbe5302abebc2eed0', 'request_id': 'req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:44.057821 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f226439e504c9bbe5302abebc2eed0', 'request_id': 'req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:44.068906 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9 admin admin] The token cache is being invalidate because project 66f226439e504c9bbe5302abebc2eed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:42:44.069193 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:44.069830 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-40ceb83d-ea86-4e1f-8a82-b6dad6d19ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:44.071358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1401/2808] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:42:43 2022] DELETE /identity/v3/projects/66f226439e504c9bbe5302abebc2eed0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:42:44.076572 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18c0ee-750e-4bd2-8aab-4c4424aeb5ec None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:44.076883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18c0ee-750e-4bd2-8aab-4c4424aeb5ec None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:44.077151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18c0ee-750e-4bd2-8aab-4c4424aeb5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:44.098692 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-7e18c0ee-750e-4bd2-8aab-4c4424aeb5ec None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:42:44.099959 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-7e18c0ee-750e-4bd2-8aab-4c4424aeb5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:44.161400 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1408/2809] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:42:44.169957 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18eaa4-52bb-4b08-b3a5-ae824e1d4014 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:44.170272 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18eaa4-52bb-4b08-b3a5-ae824e1d4014 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:44.170716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18eaa4-52bb-4b08-b3a5-ae824e1d4014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:44.197969 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-ed18eaa4-52bb-4b08-b3a5-ae824e1d4014 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:42:44.199533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-ed18eaa4-52bb-4b08-b3a5-ae824e1d4014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:44.210734 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1402/2810] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:42:44.215306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18c0ee-750e-4bd2-8aab-4c4424aeb5ec None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:44.225229 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18c0ee-750e-4bd2-8aab-4c4424aeb5ec None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:44.230733 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb0a92-088e-4f17-8d81-cde6feb91a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:44.231352 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb0a92-088e-4f17-8d81-cde6feb91a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:44.231646 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb0a92-088e-4f17-8d81-cde6feb91a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:44.231910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb0a92-088e-4f17-8d81-cde6feb91a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:44.232655 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb0a92-088e-4f17-8d81-cde6feb91a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:42:44.232931 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb0a92-088e-4f17-8d81-cde6feb91a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:44.234473 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb0a92-088e-4f17-8d81-cde6feb91a4d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:44.247459 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1409/2811] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:42:44.251968 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18eaa4-52bb-4b08-b3a5-ae824e1d4014 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:44.261942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18eaa4-52bb-4b08-b3a5-ae824e1d4014 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:44.267264 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab73a0e-dbaa-40b4-be0f-6917af522bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:44.267861 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab73a0e-dbaa-40b4-be0f-6917af522bfe admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:44.268137 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab73a0e-dbaa-40b4-be0f-6917af522bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:44.268443 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab73a0e-dbaa-40b4-be0f-6917af522bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:44.269061 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab73a0e-dbaa-40b4-be0f-6917af522bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:44.270988 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab73a0e-dbaa-40b4-be0f-6917af522bfe admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:44.303160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1403/2812] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:42:44 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:42:44.309487 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb0a92-088e-4f17-8d81-cde6feb91a4d admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:44.320152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb0a92-088e-4f17-8d81-cde6feb91a4d admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:44.348260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:44.380711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b6dc7-8b40-4d56-b56b-6dd7e4e6d4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:44.381326 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b6dc7-8b40-4d56-b56b-6dd7e4e6d4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:44.381596 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b6dc7-8b40-4d56-b56b-6dd7e4e6d4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:44.381861 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b6dc7-8b40-4d56-b56b-6dd7e4e6d4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:44.382499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b6dc7-8b40-4d56-b56b-6dd7e4e6d4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:44.384449 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b6dc7-8b40-4d56-b56b-6dd7e4e6d4e2 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:44.407905 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1410/2813] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:42:44 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:42:44.413241 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab73a0e-dbaa-40b4-be0f-6917af522bfe admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:44.429322 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab73a0e-dbaa-40b4-be0f-6917af522bfe admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:44.438691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69607b8-46ff-4c46-b320-b7f642ebd05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:44.439320 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69607b8-46ff-4c46-b320-b7f642ebd05b admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:44.441684 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69607b8-46ff-4c46-b320-b7f642ebd05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:44.441990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69607b8-46ff-4c46-b320-b7f642ebd05b admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:44.442675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69607b8-46ff-4c46-b320-b7f642ebd05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:44.444309 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69607b8-46ff-4c46-b320-b7f642ebd05b admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:44.455135 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1404/2814] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:42:44.459391 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b6dc7-8b40-4d56-b56b-6dd7e4e6d4e2 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:44.474749 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b6dc7-8b40-4d56-b56b-6dd7e4e6d4e2 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:44.479978 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef61db-41fc-4e88-beb0-7ee3807dc2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:44.480619 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef61db-41fc-4e88-beb0-7ee3807dc2fc admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:44.480900 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef61db-41fc-4e88-beb0-7ee3807dc2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:44.481190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef61db-41fc-4e88-beb0-7ee3807dc2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:44.481843 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef61db-41fc-4e88-beb0-7ee3807dc2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:44.483518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef61db-41fc-4e88-beb0-7ee3807dc2fc admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:44.494547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1411/2815] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:42:44.499097 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69607b8-46ff-4c46-b320-b7f642ebd05b admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:44.509743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69607b8-46ff-4c46-b320-b7f642ebd05b admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:44.514768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82323c81-b9fd-4738-b995-b9b4f4b61e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:44.515460 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82323c81-b9fd-4738-b995-b9b4f4b61e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:44.515733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82323c81-b9fd-4738-b995-b9b4f4b61e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:44.516004 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82323c81-b9fd-4738-b995-b9b4f4b61e82 admin admin] PATH_INFO: `/v3/projects/a1435a3021d145dea78af599588f4afd/users/7a81392ea934483585fbb0e6cbe549ce/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:44.535432 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82323c81-b9fd-4738-b995-b9b4f4b61e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1435a3021d145dea78af599588f4afd, user_id=7a81392ea934483585fbb0e6cbe549ce, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:44.539916 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82323c81-b9fd-4738-b995-b9b4f4b61e82 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:44.558284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1405/2816] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:42:44 2022] PUT /identity/v3/projects/a1435a3021d145dea78af599588f4afd/users/7a81392ea934483585fbb0e6cbe549ce/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:44.570700 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8a130-ceaa-41e3-9dd6-c1708a810715 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:44.570997 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8a130-ceaa-41e3-9dd6-c1708a810715 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:44.571272 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8a130-ceaa-41e3-9dd6-c1708a810715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:44.600558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-9ae8a130-ceaa-41e3-9dd6-c1708a810715 None None] MFA Rules not processed for user `7a81392ea934483585fbb0e6cbe549ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:42:44.601758 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9ae8a130-ceaa-41e3-9dd6-c1708a810715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:44.672210 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1412/2817] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:42:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:42:44.677702 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82323c81-b9fd-4738-b995-b9b4f4b61e82 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:44.743014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82323c81-b9fd-4738-b995-b9b4f4b61e82 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:44.748444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb759500-3e59-4e1b-b676-6e5d666f3a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:44.749042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb759500-3e59-4e1b-b676-6e5d666f3a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:44.749414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb759500-3e59-4e1b-b676-6e5d666f3a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:44.749569 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb759500-3e59-4e1b-b676-6e5d666f3a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:44.750228 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb759500-3e59-4e1b-b676-6e5d666f3a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:44.752220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb759500-3e59-4e1b-b676-6e5d666f3a8a admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:44.786472 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1406/2818] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:42:44 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:42:44.790728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8a130-ceaa-41e3-9dd6-c1708a810715 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:44.801632 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8a130-ceaa-41e3-9dd6-c1708a810715 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:44.861344 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f1809-1192-41d9-904b-432698646222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:44.861948 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f1809-1192-41d9-904b-432698646222 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:44.862220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f1809-1192-41d9-904b-432698646222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:44.862490 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f1809-1192-41d9-904b-432698646222 admin admin] PATH_INFO: `/v3/users` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:44.863144 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f1809-1192-41d9-904b-432698646222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:44.865054 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f1809-1192-41d9-904b-432698646222 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:44.888864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1413/2819] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:42:44 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:42:44.894440 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb759500-3e59-4e1b-b676-6e5d666f3a8a admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:44.905382 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb759500-3e59-4e1b-b676-6e5d666f3a8a admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:44.910779 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04ba0f-2962-47b1-8223-92d6f3f6dc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:44.911478 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04ba0f-2962-47b1-8223-92d6f3f6dc8c admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:44.911777 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04ba0f-2962-47b1-8223-92d6f3f6dc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:44.912071 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04ba0f-2962-47b1-8223-92d6f3f6dc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:44.912737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04ba0f-2962-47b1-8223-92d6f3f6dc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:44.914349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04ba0f-2962-47b1-8223-92d6f3f6dc8c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:44.926846 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1407/2820] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:42:44.931171 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f1809-1192-41d9-904b-432698646222 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:44.941143 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f1809-1192-41d9-904b-432698646222 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:44.945671 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013d7bf-7b3c-43e2-a2e1-ce33a35f16d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:44.946305 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013d7bf-7b3c-43e2-a2e1-ce33a35f16d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:44.946577 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013d7bf-7b3c-43e2-a2e1-ce33a35f16d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:44.946867 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013d7bf-7b3c-43e2-a2e1-ce33a35f16d8 admin admin] PATH_INFO: `/v3/projects/6aaca2e808424b748dea453a6a0b480e/users/bad6f8a3de0d415487d6f20226b87b40/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:44.963184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013d7bf-7b3c-43e2-a2e1-ce33a35f16d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aaca2e808424b748dea453a6a0b480e, user_id=bad6f8a3de0d415487d6f20226b87b40, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:44.965798 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013d7bf-7b3c-43e2-a2e1-ce33a35f16d8 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:44.980912 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1414/2821] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:42:44 2022] PUT /identity/v3/projects/6aaca2e808424b748dea453a6a0b480e/users/bad6f8a3de0d415487d6f20226b87b40/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:44.986365 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04ba0f-2962-47b1-8223-92d6f3f6dc8c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:44.997218 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04ba0f-2962-47b1-8223-92d6f3f6dc8c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:45.019298 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:45.067746 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc51c83-fda5-4846-9840-af4bad947c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:45.068580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc51c83-fda5-4846-9840-af4bad947c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:45.068908 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc51c83-fda5-4846-9840-af4bad947c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:45.069203 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc51c83-fda5-4846-9840-af4bad947c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:45.070050 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc51c83-fda5-4846-9840-af4bad947c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:45.072400 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc51c83-fda5-4846-9840-af4bad947c1c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:45.085465 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1408/2822] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:42:45.089925 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013d7bf-7b3c-43e2-a2e1-ce33a35f16d8 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:45.095783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:45.101760 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013d7bf-7b3c-43e2-a2e1-ce33a35f16d8 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:45.108173 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a78e-9469-4332-be0e-5cdc898a156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:45.108795 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a78e-9469-4332-be0e-5cdc898a156a admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:45.109063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a78e-9469-4332-be0e-5cdc898a156a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:45.109320 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a78e-9469-4332-be0e-5cdc898a156a admin admin] PATH_INFO: `/v3/projects/6aaca2e808424b748dea453a6a0b480e/users/bad6f8a3de0d415487d6f20226b87b40/roles/169d11e171d04c87af71475295957618` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:45.111401 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a78e-9469-4332-be0e-5cdc898a156a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aaca2e808424b748dea453a6a0b480e, user_id=bad6f8a3de0d415487d6f20226b87b40, role_id=169d11e171d04c87af71475295957618)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:45.114078 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a78e-9469-4332-be0e-5cdc898a156a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:45.124918 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1415/2823] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:42:45 2022] PUT /identity/v3/projects/6aaca2e808424b748dea453a6a0b480e/users/bad6f8a3de0d415487d6f20226b87b40/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:45.192952 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc82eb-ddb5-48ef-ac5b-e493cd05bc0e None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:45.193304 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc82eb-ddb5-48ef-ac5b-e493cd05bc0e None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:45.193687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc82eb-ddb5-48ef-ac5b-e493cd05bc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:45.239181 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-91bc82eb-ddb5-48ef-ac5b-e493cd05bc0e None None] MFA Rules not processed for user `bad6f8a3de0d415487d6f20226b87b40`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:42:45.240819 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-91bc82eb-ddb5-48ef-ac5b-e493cd05bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:45.312894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1409/2824] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:42:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:42:45.325219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a78e-9469-4332-be0e-5cdc898a156a admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:45.327470 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9c08a78e-9469-4332-be0e-5cdc898a156a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:45.389450 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a78e-9469-4332-be0e-5cdc898a156a admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:45.393623 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93f93e-4333-451e-aa80-04a7eeeefb31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:45.394237 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93f93e-4333-451e-aa80-04a7eeeefb31 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:45.394509 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93f93e-4333-451e-aa80-04a7eeeefb31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:45.394774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93f93e-4333-451e-aa80-04a7eeeefb31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:45.404138 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93f93e-4333-451e-aa80-04a7eeeefb31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:45.405606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93f93e-4333-451e-aa80-04a7eeeefb31 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:45.415808 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1416/2825] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:42:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:42:46.011739 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc82eb-ddb5-48ef-ac5b-e493cd05bc0e None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:46.075687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc82eb-ddb5-48ef-ac5b-e493cd05bc0e None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:46.081371 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0395314-9adb-4afe-ba56-17943230d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:46.082026 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0395314-9adb-4afe-ba56-17943230d43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:46.082299 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0395314-9adb-4afe-ba56-17943230d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:46.082570 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0395314-9adb-4afe-ba56-17943230d43c admin admin] PATH_INFO: `/v3/users/7a81392ea934483585fbb0e6cbe549ce` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:46.083848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0395314-9adb-4afe-ba56-17943230d43c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a81392ea934483585fbb0e6cbe549ce)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:46.085777 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0395314-9adb-4afe-ba56-17943230d43c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:46.135458 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-a0395314-9adb-4afe-ba56-17943230d43c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a81392ea934483585fbb0e6cbe549ce'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.137120 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:46.144448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-a0395314-9adb-4afe-ba56-17943230d43c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a81392ea934483585fbb0e6cbe549ce'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.145184 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-a0395314-9adb-4afe-ba56-17943230d43c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a81392ea934483585fbb0e6cbe549ce'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.146014 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-a0395314-9adb-4afe-ba56-17943230d43c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a81392ea934483585fbb0e6cbe549ce'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.159002 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-a0395314-9adb-4afe-ba56-17943230d43c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a81392ea934483585fbb0e6cbe549ce'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.172431 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1410/2826] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:42:46 2022] DELETE /identity/v3/users/7a81392ea934483585fbb0e6cbe549ce => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:46.178504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04549908-5b3b-4328-b731-0af8381db7c9 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:46.179073 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04549908-5b3b-4328-b731-0af8381db7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:46.179073 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04549908-5b3b-4328-b731-0af8381db7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:46.202728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-04549908-5b3b-4328-b731-0af8381db7c9 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:42:46.204408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-04549908-5b3b-4328-b731-0af8381db7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:46.267556 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1417/2827] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:42:46.277523 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0395314-9adb-4afe-ba56-17943230d43c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:46.279109 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a0395314-9adb-4afe-ba56-17943230d43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:46.338796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0395314-9adb-4afe-ba56-17943230d43c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:46.342643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790da9a-10cd-43a9-80c3-da1b78960c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:46.343278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790da9a-10cd-43a9-80c3-da1b78960c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:46.343579 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790da9a-10cd-43a9-80c3-da1b78960c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:46.343844 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790da9a-10cd-43a9-80c3-da1b78960c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:46.358284 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790da9a-10cd-43a9-80c3-da1b78960c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:46.360581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790da9a-10cd-43a9-80c3-da1b78960c1b service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:46.370408 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1411/2828] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:42:46.678950 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04549908-5b3b-4328-b731-0af8381db7c9 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:46.680373 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-04549908-5b3b-4328-b731-0af8381db7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:46.692829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04549908-5b3b-4328-b731-0af8381db7c9 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:46.698403 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:46.699188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:46.699458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:46.699708 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] PATH_INFO: `/v3/projects/a1435a3021d145dea78af599588f4afd` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:46.700916 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1435a3021d145dea78af599588f4afd)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:46.702916 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:46.756447 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1435a3021d145dea78af599588f4afd', 'request_id': 'req-888f4e01-ed5b-472b-be87-eea00d6159e7'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.763274 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1435a3021d145dea78af599588f4afd', 'request_id': 'req-888f4e01-ed5b-472b-be87-eea00d6159e7'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.775734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1435a3021d145dea78af599588f4afd', 'request_id': 'req-888f4e01-ed5b-472b-be87-eea00d6159e7'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.787306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] The token cache is being invalidate because project a1435a3021d145dea78af599588f4afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:42:46.787593 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.788341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.789902 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1418/2829] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:42:46 2022] DELETE /identity/v3/projects/a1435a3021d145dea78af599588f4afd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:46.794280 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790da9a-10cd-43a9-80c3-da1b78960c1b service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:46.804670 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790da9a-10cd-43a9-80c3-da1b78960c1b service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:46.867045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f427dc-9333-4eb7-bb38-5a2c7cdb26e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:46.867701 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f427dc-9333-4eb7-bb38-5a2c7cdb26e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:46.867971 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f427dc-9333-4eb7-bb38-5a2c7cdb26e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:46.868349 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f427dc-9333-4eb7-bb38-5a2c7cdb26e5 admin admin] PATH_INFO: `/v3/users/bad6f8a3de0d415487d6f20226b87b40` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:46.869742 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f427dc-9333-4eb7-bb38-5a2c7cdb26e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad6f8a3de0d415487d6f20226b87b40)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:46.871725 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f427dc-9333-4eb7-bb38-5a2c7cdb26e5 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:46.925880 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-64f427dc-9333-4eb7-bb38-5a2c7cdb26e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad6f8a3de0d415487d6f20226b87b40'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.935705 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-64f427dc-9333-4eb7-bb38-5a2c7cdb26e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad6f8a3de0d415487d6f20226b87b40'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.936375 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-64f427dc-9333-4eb7-bb38-5a2c7cdb26e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad6f8a3de0d415487d6f20226b87b40'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.937260 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-64f427dc-9333-4eb7-bb38-5a2c7cdb26e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad6f8a3de0d415487d6f20226b87b40'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.949010 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:46.950852 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-64f427dc-9333-4eb7-bb38-5a2c7cdb26e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad6f8a3de0d415487d6f20226b87b40'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:46.965848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1412/2830] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:42:46 2022] DELETE /identity/v3/users/bad6f8a3de0d415487d6f20226b87b40 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:47.248112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:47.249645 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:47.263512 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f4e01-ed5b-472b-be87-eea00d6159e7 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:47.276635 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:47.323277 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46915-bec8-4f32-a6a4-e5e2e13362a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:47.323961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46915-bec8-4f32-a6a4-e5e2e13362a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:47.324235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46915-bec8-4f32-a6a4-e5e2e13362a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:47.324502 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46915-bec8-4f32-a6a4-e5e2e13362a1 admin admin] PATH_INFO: `/v3/projects/6aaca2e808424b748dea453a6a0b480e` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:47.325656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46915-bec8-4f32-a6a4-e5e2e13362a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aaca2e808424b748dea453a6a0b480e)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:47.327611 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46915-bec8-4f32-a6a4-e5e2e13362a1 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:47.382741 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-23a46915-bec8-4f32-a6a4-e5e2e13362a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aaca2e808424b748dea453a6a0b480e', 'request_id': 'req-23a46915-bec8-4f32-a6a4-e5e2e13362a1'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:47.388947 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-23a46915-bec8-4f32-a6a4-e5e2e13362a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aaca2e808424b748dea453a6a0b480e', 'request_id': 'req-23a46915-bec8-4f32-a6a4-e5e2e13362a1'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:47.397814 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-23a46915-bec8-4f32-a6a4-e5e2e13362a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aaca2e808424b748dea453a6a0b480e', 'request_id': 'req-23a46915-bec8-4f32-a6a4-e5e2e13362a1'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:47.413017 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-23a46915-bec8-4f32-a6a4-e5e2e13362a1 admin admin] The token cache is being invalidate because project 6aaca2e808424b748dea453a6a0b480e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:42:47.413208 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-23a46915-bec8-4f32-a6a4-e5e2e13362a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:47.413857 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-23a46915-bec8-4f32-a6a4-e5e2e13362a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:42:47.415666 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1419/2831] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:42:47 2022] DELETE /identity/v3/projects/6aaca2e808424b748dea453a6a0b480e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:47.420752 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fffd1-4c52-4b83-9071-368f153d0a47 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:47.421268 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fffd1-4c52-4b83-9071-368f153d0a47 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:47.421407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fffd1-4c52-4b83-9071-368f153d0a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:47.441441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-235fffd1-4c52-4b83-9071-368f153d0a47 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:42:47.442586 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-235fffd1-4c52-4b83-9071-368f153d0a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:47.507978 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1413/2832] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:42:47.516582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed571-f4a4-4906-822b-286d060158f8 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:47.516922 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed571-f4a4-4906-822b-286d060158f8 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:47.517291 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed571-f4a4-4906-822b-286d060158f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:47.541918 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-d20ed571-f4a4-4906-822b-286d060158f8 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:42:47.543153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-d20ed571-f4a4-4906-822b-286d060158f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:47.551693 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1420/2833] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:42:47.556214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fffd1-4c52-4b83-9071-368f153d0a47 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:47.566604 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fffd1-4c52-4b83-9071-368f153d0a47 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:47.571687 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66873ee9-08cd-46b3-b3c0-f2981b888930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:47.572302 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66873ee9-08cd-46b3-b3c0-f2981b888930 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:47.572577 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66873ee9-08cd-46b3-b3c0-f2981b888930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:47.572845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66873ee9-08cd-46b3-b3c0-f2981b888930 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:47.573491 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66873ee9-08cd-46b3-b3c0-f2981b888930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:42:47.573791 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66873ee9-08cd-46b3-b3c0-f2981b888930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:47.575451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66873ee9-08cd-46b3-b3c0-f2981b888930 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:47.588207 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1414/2834] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:42:47.592615 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ed571-f4a4-4906-822b-286d060158f8 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:47.601981 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ed571-f4a4-4906-822b-286d060158f8 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:47.607042 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274ed32-26f2-4632-8d75-827a8adb77ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:47.607636 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274ed32-26f2-4632-8d75-827a8adb77ec admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:47.607904 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274ed32-26f2-4632-8d75-827a8adb77ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:47.608170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274ed32-26f2-4632-8d75-827a8adb77ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:47.608819 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274ed32-26f2-4632-8d75-827a8adb77ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:47.610701 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274ed32-26f2-4632-8d75-827a8adb77ec admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:47.639770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1421/2835] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:42:47 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:42:47.644220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66873ee9-08cd-46b3-b3c0-f2981b888930 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:47.654527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66873ee9-08cd-46b3-b3c0-f2981b888930 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:47.713229 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276de194-c5c9-4c4f-95b2-9ae87ada207d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:47.713739 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276de194-c5c9-4c4f-95b2-9ae87ada207d admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:47.714013 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276de194-c5c9-4c4f-95b2-9ae87ada207d admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:47.714275 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276de194-c5c9-4c4f-95b2-9ae87ada207d admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:47.714923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276de194-c5c9-4c4f-95b2-9ae87ada207d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:47.716815 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276de194-c5c9-4c4f-95b2-9ae87ada207d admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:47.740672 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1415/2836] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:42:47 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:42:47.744878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274ed32-26f2-4632-8d75-827a8adb77ec admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:47.755662 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274ed32-26f2-4632-8d75-827a8adb77ec admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:47.760955 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb5fe3-8a8b-4d97-a867-2bf04994c9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:47.761531 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb5fe3-8a8b-4d97-a867-2bf04994c9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:47.761809 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb5fe3-8a8b-4d97-a867-2bf04994c9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:47.762081 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb5fe3-8a8b-4d97-a867-2bf04994c9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:47.762731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb5fe3-8a8b-4d97-a867-2bf04994c9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:47.764371 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb5fe3-8a8b-4d97-a867-2bf04994c9ae admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:47.774711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1422/2837] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:42:47.779030 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276de194-c5c9-4c4f-95b2-9ae87ada207d admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:47.789843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276de194-c5c9-4c4f-95b2-9ae87ada207d admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:47.796312 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8be03e-57c3-4d71-9314-a0657d89942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:47.796915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8be03e-57c3-4d71-9314-a0657d89942b admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:47.797186 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8be03e-57c3-4d71-9314-a0657d89942b admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:47.797439 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8be03e-57c3-4d71-9314-a0657d89942b admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:47.798132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8be03e-57c3-4d71-9314-a0657d89942b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:47.799756 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8be03e-57c3-4d71-9314-a0657d89942b admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:47.809947 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1416/2838] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:42:47.814148 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb5fe3-8a8b-4d97-a867-2bf04994c9ae admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:47.824291 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb5fe3-8a8b-4d97-a867-2bf04994c9ae admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:47.830087 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feaa0f-3755-459f-8d4f-1c3ead5843fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:47.830718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feaa0f-3755-459f-8d4f-1c3ead5843fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:47.831048 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feaa0f-3755-459f-8d4f-1c3ead5843fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:47.831322 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feaa0f-3755-459f-8d4f-1c3ead5843fd admin admin] PATH_INFO: `/v3/projects/57b2ecffb315472dbf9d521c5a71fce5/users/4ea1996574774e3b8d7f2c2c000c764b/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:47.846905 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9feaa0f-3755-459f-8d4f-1c3ead5843fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b2ecffb315472dbf9d521c5a71fce5, user_id=4ea1996574774e3b8d7f2c2c000c764b, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:47.849722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9feaa0f-3755-459f-8d4f-1c3ead5843fd admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:47.863963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1423/2839] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:42:47 2022] PUT /identity/v3/projects/57b2ecffb315472dbf9d521c5a71fce5/users/4ea1996574774e3b8d7f2c2c000c764b/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:42:47.874212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd474e0c-6d6d-418e-adb7-865eab8ed92d None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:47.874496 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd474e0c-6d6d-418e-adb7-865eab8ed92d None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:47.874768 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd474e0c-6d6d-418e-adb7-865eab8ed92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:47.904915 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-dd474e0c-6d6d-418e-adb7-865eab8ed92d None None] MFA Rules not processed for user `4ea1996574774e3b8d7f2c2c000c764b`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:42:47.906159 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-dd474e0c-6d6d-418e-adb7-865eab8ed92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:47.949444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:47.977676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1417/2840] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:42:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:42:47.993566 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feaa0f-3755-459f-8d4f-1c3ead5843fd admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:42:47.995548 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b9feaa0f-3755-459f-8d4f-1c3ead5843fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:42:48.043123 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:48.056548 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feaa0f-3755-459f-8d4f-1c3ead5843fd admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:42:48.060564 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35dc217-e263-44ef-8bac-b9c0dcebce0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7f8976306ff477592c6c5b62af60f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:42:48.061155 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dc217-e263-44ef-8bac-b9c0dcebce0b service glance] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:42:48.061423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dc217-e263-44ef-8bac-b9c0dcebce0b service glance] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:42:48.061687 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dc217-e263-44ef-8bac-b9c0dcebce0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:42:48.070660 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35dc217-e263-44ef-8bac-b9c0dcebce0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:42:48.072590 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35dc217-e263-44ef-8bac-b9c0dcebce0b service glance] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:42:48.082204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1424/2841] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:42:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:42:57.974249 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=8 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:58.077618 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=7 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:30.169300 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd474e0c-6d6d-418e-adb7-865eab8ed92d None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:30.235255 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd474e0c-6d6d-418e-adb7-865eab8ed92d None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:30.241490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac0211-1ea7-4ba5-b431-5a78ff387333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:30.242141 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac0211-1ea7-4ba5-b431-5a78ff387333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:30.242418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac0211-1ea7-4ba5-b431-5a78ff387333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:30.242684 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac0211-1ea7-4ba5-b431-5a78ff387333 admin admin] PATH_INFO: `/v3/users/4ea1996574774e3b8d7f2c2c000c764b` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:30.243894 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac0211-1ea7-4ba5-b431-5a78ff387333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea1996574774e3b8d7f2c2c000c764b)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:30.245824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac0211-1ea7-4ba5-b431-5a78ff387333 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:30.295051 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d6ac0211-1ea7-4ba5-b431-5a78ff387333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea1996574774e3b8d7f2c2c000c764b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:30.305220 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d6ac0211-1ea7-4ba5-b431-5a78ff387333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea1996574774e3b8d7f2c2c000c764b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:30.305925 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d6ac0211-1ea7-4ba5-b431-5a78ff387333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea1996574774e3b8d7f2c2c000c764b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:30.306624 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d6ac0211-1ea7-4ba5-b431-5a78ff387333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea1996574774e3b8d7f2c2c000c764b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:30.320256 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-d6ac0211-1ea7-4ba5-b431-5a78ff387333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea1996574774e3b8d7f2c2c000c764b'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:30.334038 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1418/2842] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:43:30 2022] DELETE /identity/v3/users/4ea1996574774e3b8d7f2c2c000c764b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:43:30.338680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8f801-c74e-4645-b958-21cc8b90e908 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:30.339235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8f801-c74e-4645-b958-21cc8b90e908 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:30.339353 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8f801-c74e-4645-b958-21cc8b90e908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:30.358973 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-cbd8f801-c74e-4645-b958-21cc8b90e908 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:43:30.360264 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cbd8f801-c74e-4645-b958-21cc8b90e908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:30.427304 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1425/2843] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:43:30.437270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac0211-1ea7-4ba5-b431-5a78ff387333 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:30.438931 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d6ac0211-1ea7-4ba5-b431-5a78ff387333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:30.500394 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac0211-1ea7-4ba5-b431-5a78ff387333 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:30.504778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a8703-91b9-472b-960d-7a722e042008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:30.505390 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8703-91b9-472b-960d-7a722e042008 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:30.505668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8703-91b9-472b-960d-7a722e042008 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:30.505942 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8703-91b9-472b-960d-7a722e042008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:30.515314 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a8703-91b9-472b-960d-7a722e042008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:30.516743 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a8703-91b9-472b-960d-7a722e042008 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:30.526199 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1419/2844] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:43:30.807314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8f801-c74e-4645-b958-21cc8b90e908 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:30.808944 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-cbd8f801-c74e-4645-b958-21cc8b90e908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:30.821538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8f801-c74e-4645-b958-21cc8b90e908 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:30.826697 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab42ae-ec36-4a00-91bf-5c6438888de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:30.827376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab42ae-ec36-4a00-91bf-5c6438888de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:30.827658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab42ae-ec36-4a00-91bf-5c6438888de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:30.827923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab42ae-ec36-4a00-91bf-5c6438888de5 admin admin] PATH_INFO: `/v3/projects/57b2ecffb315472dbf9d521c5a71fce5` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:30.829581 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab42ae-ec36-4a00-91bf-5c6438888de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b2ecffb315472dbf9d521c5a71fce5)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:30.831489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab42ae-ec36-4a00-91bf-5c6438888de5 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:30.880781 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-acab42ae-ec36-4a00-91bf-5c6438888de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b2ecffb315472dbf9d521c5a71fce5', 'request_id': 'req-acab42ae-ec36-4a00-91bf-5c6438888de5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:30.886743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-acab42ae-ec36-4a00-91bf-5c6438888de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b2ecffb315472dbf9d521c5a71fce5', 'request_id': 'req-acab42ae-ec36-4a00-91bf-5c6438888de5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:30.894255 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-acab42ae-ec36-4a00-91bf-5c6438888de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b2ecffb315472dbf9d521c5a71fce5', 'request_id': 'req-acab42ae-ec36-4a00-91bf-5c6438888de5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:30.904637 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-acab42ae-ec36-4a00-91bf-5c6438888de5 admin admin] The token cache is being invalidate because project 57b2ecffb315472dbf9d521c5a71fce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:43:30.904920 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-acab42ae-ec36-4a00-91bf-5c6438888de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:30.905541 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-acab42ae-ec36-4a00-91bf-5c6438888de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:30.907118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1426/2845] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:43:30 2022] DELETE /identity/v3/projects/57b2ecffb315472dbf9d521c5a71fce5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:43:30.912187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fbaec-59a4-4e72-9a36-99d313f7cca7 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:30.912472 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fbaec-59a4-4e72-9a36-99d313f7cca7 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:30.912745 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fbaec-59a4-4e72-9a36-99d313f7cca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:30.932481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-4d6fbaec-59a4-4e72-9a36-99d313f7cca7 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:43:30.933689 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4d6fbaec-59a4-4e72-9a36-99d313f7cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:30.950893 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:30.996068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1420/2846] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:43:31.004172 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438cd30-b504-472f-a91e-b3b97bba4b15 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:31.004452 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438cd30-b504-472f-a91e-b3b97bba4b15 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:31.004718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438cd30-b504-472f-a91e-b3b97bba4b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:31.031865 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-9438cd30-b504-472f-a91e-b3b97bba4b15 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:43:31.033088 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-9438cd30-b504-472f-a91e-b3b97bba4b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:31.042204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1427/2847] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:43:31.046922 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fbaec-59a4-4e72-9a36-99d313f7cca7 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:31.058189 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fbaec-59a4-4e72-9a36-99d313f7cca7 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:31.063589 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7257b-bb7e-44b1-9a05-29b7ba048836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:31.064202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7257b-bb7e-44b1-9a05-29b7ba048836 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:31.064480 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7257b-bb7e-44b1-9a05-29b7ba048836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:31.064744 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7257b-bb7e-44b1-9a05-29b7ba048836 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:31.065399 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7257b-bb7e-44b1-9a05-29b7ba048836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:43:31.065699 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7257b-bb7e-44b1-9a05-29b7ba048836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:31.067609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7257b-bb7e-44b1-9a05-29b7ba048836 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:31.080538 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1421/2848] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:43:31.085220 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438cd30-b504-472f-a91e-b3b97bba4b15 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:31.094832 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438cd30-b504-472f-a91e-b3b97bba4b15 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:31.100125 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25606275-bd2a-4561-83f1-393e08344825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:31.100728 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25606275-bd2a-4561-83f1-393e08344825 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:31.101001 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25606275-bd2a-4561-83f1-393e08344825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:31.101260 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25606275-bd2a-4561-83f1-393e08344825 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:31.101883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25606275-bd2a-4561-83f1-393e08344825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:31.103846 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25606275-bd2a-4561-83f1-393e08344825 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:31.133082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1428/2849] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:43:31 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:43:31.137481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7257b-bb7e-44b1-9a05-29b7ba048836 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:31.150728 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7257b-bb7e-44b1-9a05-29b7ba048836 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:31.213556 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c288db3-3328-46b5-a34f-392b0a77f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:31.214311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288db3-3328-46b5-a34f-392b0a77f461 admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:31.214446 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288db3-3328-46b5-a34f-392b0a77f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:31.214711 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288db3-3328-46b5-a34f-392b0a77f461 admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:31.215393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c288db3-3328-46b5-a34f-392b0a77f461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:31.217308 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c288db3-3328-46b5-a34f-392b0a77f461 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:31.242950 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1422/2850] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:43:31 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:43:31.247350 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25606275-bd2a-4561-83f1-393e08344825 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:31.259810 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25606275-bd2a-4561-83f1-393e08344825 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:31.264738 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fae79-a232-4120-a2eb-fa0db520cd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:31.265334 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fae79-a232-4120-a2eb-fa0db520cd46 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:31.265610 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fae79-a232-4120-a2eb-fa0db520cd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:31.265873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fae79-a232-4120-a2eb-fa0db520cd46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:31.266518 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fae79-a232-4120-a2eb-fa0db520cd46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:31.268180 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fae79-a232-4120-a2eb-fa0db520cd46 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:31.280558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1429/2851] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:43:31.288490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c288db3-3328-46b5-a34f-392b0a77f461 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:31.304045 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c288db3-3328-46b5-a34f-392b0a77f461 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:31.312020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60fd0a-e764-43c1-a792-c0f69b878a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:31.312726 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60fd0a-e764-43c1-a792-c0f69b878a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:31.312997 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60fd0a-e764-43c1-a792-c0f69b878a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:31.313260 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60fd0a-e764-43c1-a792-c0f69b878a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:31.314128 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60fd0a-e764-43c1-a792-c0f69b878a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:31.316654 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60fd0a-e764-43c1-a792-c0f69b878a02 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:31.327506 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1423/2852] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:43:31.332296 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fae79-a232-4120-a2eb-fa0db520cd46 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:31.343232 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fae79-a232-4120-a2eb-fa0db520cd46 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:31.349293 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9583ad9-9ac4-4d91-86da-d9e0beb9e59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:31.349955 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9583ad9-9ac4-4d91-86da-d9e0beb9e59f admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:31.350228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9583ad9-9ac4-4d91-86da-d9e0beb9e59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:31.350498 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9583ad9-9ac4-4d91-86da-d9e0beb9e59f admin admin] PATH_INFO: `/v3/projects/8d20779820e941c8801e262cbd9a8299/users/71c099d051604aa893566a246d085749/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:31.366108 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9583ad9-9ac4-4d91-86da-d9e0beb9e59f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d20779820e941c8801e262cbd9a8299, user_id=71c099d051604aa893566a246d085749, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:31.368797 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9583ad9-9ac4-4d91-86da-d9e0beb9e59f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:31.382705 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1430/2853] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:43:31 2022] PUT /identity/v3/projects/8d20779820e941c8801e262cbd9a8299/users/71c099d051604aa893566a246d085749/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:43:31.393323 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b29c-e8dc-40d1-a284-1b158f4db16a None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:31.393512 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b29c-e8dc-40d1-a284-1b158f4db16a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:31.393789 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b29c-e8dc-40d1-a284-1b158f4db16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:31.422727 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-b1c7b29c-e8dc-40d1-a284-1b158f4db16a None None] MFA Rules not processed for user `71c099d051604aa893566a246d085749`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:43:31.423953 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-b1c7b29c-e8dc-40d1-a284-1b158f4db16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:31.491610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1424/2854] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:43:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:43:31.503189 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9583ad9-9ac4-4d91-86da-d9e0beb9e59f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:31.505116 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e9583ad9-9ac4-4d91-86da-d9e0beb9e59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:31.528806 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:31.565859 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9583ad9-9ac4-4d91-86da-d9e0beb9e59f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:31.569856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a46224-862e-4253-8685-8cf5f84b2cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:31.570457 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a46224-862e-4253-8685-8cf5f84b2cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:31.570729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a46224-862e-4253-8685-8cf5f84b2cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:31.571034 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a46224-862e-4253-8685-8cf5f84b2cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:31.580012 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a46224-862e-4253-8685-8cf5f84b2cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:31.581609 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a46224-862e-4253-8685-8cf5f84b2cb5 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:31.590883 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1431/2855] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:43:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:43:31.615695 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7b29c-e8dc-40d1-a284-1b158f4db16a None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:31.635704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:31.683311 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7b29c-e8dc-40d1-a284-1b158f4db16a None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:31.687970 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a351739-c111-4566-9d1b-65d89ce92c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:31.688600 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351739-c111-4566-9d1b-65d89ce92c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:31.688872 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351739-c111-4566-9d1b-65d89ce92c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:31.689142 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351739-c111-4566-9d1b-65d89ce92c6e admin admin] PATH_INFO: `/v3/users/71c099d051604aa893566a246d085749` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:31.690282 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a351739-c111-4566-9d1b-65d89ce92c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c099d051604aa893566a246d085749)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:31.692252 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a351739-c111-4566-9d1b-65d89ce92c6e admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:31.738800 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2a351739-c111-4566-9d1b-65d89ce92c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c099d051604aa893566a246d085749'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:31.747444 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2a351739-c111-4566-9d1b-65d89ce92c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c099d051604aa893566a246d085749'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:31.748101 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2a351739-c111-4566-9d1b-65d89ce92c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c099d051604aa893566a246d085749'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:31.748726 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2a351739-c111-4566-9d1b-65d89ce92c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c099d051604aa893566a246d085749'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:31.761068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-2a351739-c111-4566-9d1b-65d89ce92c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c099d051604aa893566a246d085749'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:31.774467 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1425/2856] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:43:31 2022] DELETE /identity/v3/users/71c099d051604aa893566a246d085749 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:43:31.779170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c869c15-9749-4320-943a-68241a700948 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:31.779452 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c869c15-9749-4320-943a-68241a700948 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:31.779721 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c869c15-9749-4320-943a-68241a700948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:31.799360 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-1c869c15-9749-4320-943a-68241a700948 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:43:31.800606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1c869c15-9749-4320-943a-68241a700948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:31.875542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1432/2857] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:43:31.885958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a351739-c111-4566-9d1b-65d89ce92c6e admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:31.887518 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-2a351739-c111-4566-9d1b-65d89ce92c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:31.948362 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a351739-c111-4566-9d1b-65d89ce92c6e admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:31.952198 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28befdcd-01bf-494b-b556-374187b873c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:31.952813 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28befdcd-01bf-494b-b556-374187b873c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:31.953089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28befdcd-01bf-494b-b556-374187b873c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:31.953720 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28befdcd-01bf-494b-b556-374187b873c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:31.963095 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28befdcd-01bf-494b-b556-374187b873c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:31.964522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28befdcd-01bf-494b-b556-374187b873c9 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:31.974461 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1426/2858] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:43:32.252614 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c869c15-9749-4320-943a-68241a700948 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:32.254141 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-1c869c15-9749-4320-943a-68241a700948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:32.266704 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c869c15-9749-4320-943a-68241a700948 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:32.272559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0716370-01dd-48f5-a28b-e6f2a2af39d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:32.273235 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0716370-01dd-48f5-a28b-e6f2a2af39d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:32.273538 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0716370-01dd-48f5-a28b-e6f2a2af39d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:32.274152 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0716370-01dd-48f5-a28b-e6f2a2af39d5 admin admin] PATH_INFO: `/v3/projects/8d20779820e941c8801e262cbd9a8299` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:32.275118 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0716370-01dd-48f5-a28b-e6f2a2af39d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d20779820e941c8801e262cbd9a8299)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:32.277057 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0716370-01dd-48f5-a28b-e6f2a2af39d5 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:32.324864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e0716370-01dd-48f5-a28b-e6f2a2af39d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d20779820e941c8801e262cbd9a8299', 'request_id': 'req-e0716370-01dd-48f5-a28b-e6f2a2af39d5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:32.331552 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e0716370-01dd-48f5-a28b-e6f2a2af39d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d20779820e941c8801e262cbd9a8299', 'request_id': 'req-e0716370-01dd-48f5-a28b-e6f2a2af39d5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:32.341599 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e0716370-01dd-48f5-a28b-e6f2a2af39d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d20779820e941c8801e262cbd9a8299', 'request_id': 'req-e0716370-01dd-48f5-a28b-e6f2a2af39d5'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:32.353710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e0716370-01dd-48f5-a28b-e6f2a2af39d5 admin admin] The token cache is being invalidate because project 8d20779820e941c8801e262cbd9a8299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:43:32.354356 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e0716370-01dd-48f5-a28b-e6f2a2af39d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:32.357505 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e0716370-01dd-48f5-a28b-e6f2a2af39d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:32.359127 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1433/2859] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:43:32 2022] DELETE /identity/v3/projects/8d20779820e941c8801e262cbd9a8299 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:43:32.365542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7b153-d1e4-4cf1-9d79-6378061a96a6 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:32.366020 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7b153-d1e4-4cf1-9d79-6378061a96a6 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:32.366168 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7b153-d1e4-4cf1-9d79-6378061a96a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:32.386273 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-a3b7b153-d1e4-4cf1-9d79-6378061a96a6 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:43:32.387481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-a3b7b153-d1e4-4cf1-9d79-6378061a96a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:32.423407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:32.449964 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1427/2860] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:43:32.460163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76f63f-8b65-4178-8490-a2058112f33b None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:32.460398 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76f63f-8b65-4178-8490-a2058112f33b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:32.460709 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76f63f-8b65-4178-8490-a2058112f33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:32.484774 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-dc76f63f-8b65-4178-8490-a2058112f33b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:43:32.485993 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-dc76f63f-8b65-4178-8490-a2058112f33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:32.494856 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1434/2861] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:43:32.499716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7b153-d1e4-4cf1-9d79-6378061a96a6 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:32.509681 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7b153-d1e4-4cf1-9d79-6378061a96a6 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:32.514945 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892030b-9f24-4df1-ae35-a543d8421c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:32.515533 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892030b-9f24-4df1-ae35-a543d8421c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:32.515848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892030b-9f24-4df1-ae35-a543d8421c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:32.516106 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892030b-9f24-4df1-ae35-a543d8421c36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:32.516750 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892030b-9f24-4df1-ae35-a543d8421c36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:43:32.517042 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892030b-9f24-4df1-ae35-a543d8421c36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:32.518667 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892030b-9f24-4df1-ae35-a543d8421c36 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:32.532212 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1428/2862] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:43:32.537808 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76f63f-8b65-4178-8490-a2058112f33b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:32.547264 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76f63f-8b65-4178-8490-a2058112f33b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:32.552168 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca188d-6fbc-4bb5-8f25-20750ae190f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:32.552755 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca188d-6fbc-4bb5-8f25-20750ae190f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:32.553021 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca188d-6fbc-4bb5-8f25-20750ae190f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:32.553280 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca188d-6fbc-4bb5-8f25-20750ae190f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:32.553900 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca188d-6fbc-4bb5-8f25-20750ae190f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:32.555830 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca188d-6fbc-4bb5-8f25-20750ae190f3 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:32.583101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1435/2863] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:43:32 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:43:32.587581 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892030b-9f24-4df1-ae35-a543d8421c36 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:32.598324 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892030b-9f24-4df1-ae35-a543d8421c36 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:32.661103 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdb899-387d-4a3d-8001-285b15b23acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:32.661704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdb899-387d-4a3d-8001-285b15b23acd admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:32.661979 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdb899-387d-4a3d-8001-285b15b23acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:32.662246 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdb899-387d-4a3d-8001-285b15b23acd admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:32.663399 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdb899-387d-4a3d-8001-285b15b23acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:32.666411 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdb899-387d-4a3d-8001-285b15b23acd admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:32.688749 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1429/2864] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:43:32 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:43:32.693091 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca188d-6fbc-4bb5-8f25-20750ae190f3 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:32.703882 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca188d-6fbc-4bb5-8f25-20750ae190f3 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:32.708547 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bad30d-ca17-469f-9944-e5ae2290e75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:32.709150 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bad30d-ca17-469f-9944-e5ae2290e75f admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:32.709423 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bad30d-ca17-469f-9944-e5ae2290e75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:32.709690 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bad30d-ca17-469f-9944-e5ae2290e75f admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:32.710341 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bad30d-ca17-469f-9944-e5ae2290e75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:32.712007 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bad30d-ca17-469f-9944-e5ae2290e75f admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:32.723306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1436/2865] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:43:32.727709 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdb899-387d-4a3d-8001-285b15b23acd admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:32.742733 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdb899-387d-4a3d-8001-285b15b23acd admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:32.748316 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bffdc8-10ed-45b9-ab5c-d85534182219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:32.748930 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bffdc8-10ed-45b9-ab5c-d85534182219 admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:32.749201 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bffdc8-10ed-45b9-ab5c-d85534182219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:32.749464 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bffdc8-10ed-45b9-ab5c-d85534182219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:32.750170 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bffdc8-10ed-45b9-ab5c-d85534182219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:32.752542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bffdc8-10ed-45b9-ab5c-d85534182219 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:32.764738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1430/2866] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:43:32.769251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bad30d-ca17-469f-9944-e5ae2290e75f admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:32.779716 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bad30d-ca17-469f-9944-e5ae2290e75f admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:32.784735 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822aa99-44da-48cd-b941-31734bfa3886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:32.785501 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822aa99-44da-48cd-b941-31734bfa3886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:32.785770 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822aa99-44da-48cd-b941-31734bfa3886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:32.786035 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822aa99-44da-48cd-b941-31734bfa3886 admin admin] PATH_INFO: `/v3/projects/36d930465f204293ae6d69c0291f784c/users/bcb57cc5164946a4b720b595ac04877e/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:32.788489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:32.804489 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822aa99-44da-48cd-b941-31734bfa3886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d930465f204293ae6d69c0291f784c, user_id=bcb57cc5164946a4b720b595ac04877e, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:32.807387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822aa99-44da-48cd-b941-31734bfa3886 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:32.822154 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1437/2867] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:43:32 2022] PUT /identity/v3/projects/36d930465f204293ae6d69c0291f784c/users/bcb57cc5164946a4b720b595ac04877e/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:43:32.834052 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75bd04-14ab-45e5-b3f2-b2347cb8cf42 None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:32.834337 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75bd04-14ab-45e5-b3f2-b2347cb8cf42 None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:32.834609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75bd04-14ab-45e5-b3f2-b2347cb8cf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:32.865147 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-5b75bd04-14ab-45e5-b3f2-b2347cb8cf42 None None] MFA Rules not processed for user `bcb57cc5164946a4b720b595ac04877e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:43:32.867086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-5b75bd04-14ab-45e5-b3f2-b2347cb8cf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:32.937982 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1431/2868] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:43:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:43:32.949844 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822aa99-44da-48cd-b941-31734bfa3886 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:32.952408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e822aa99-44da-48cd-b941-31734bfa3886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:33.015617 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822aa99-44da-48cd-b941-31734bfa3886 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:33.020295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14afa6-c9ac-4495-ba64-0e4bdcbbaf76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:33.020941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14afa6-c9ac-4495-ba64-0e4bdcbbaf76 service cinder] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:33.021213 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14afa6-c9ac-4495-ba64-0e4bdcbbaf76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:33.021474 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14afa6-c9ac-4495-ba64-0e4bdcbbaf76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:33.032376 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14afa6-c9ac-4495-ba64-0e4bdcbbaf76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:33.034658 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14afa6-c9ac-4495-ba64-0e4bdcbbaf76 service cinder] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:33.048578 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1438/2869] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:43:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:43:42.934858 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:43.041204 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:43.317316 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75bd04-14ab-45e5-b3f2-b2347cb8cf42 None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:43.384488 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75bd04-14ab-45e5-b3f2-b2347cb8cf42 None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:43.389522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbad96-fda7-4b59-b924-ad32450042ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:43.390146 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbad96-fda7-4b59-b924-ad32450042ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:43.390414 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbad96-fda7-4b59-b924-ad32450042ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:43.390677 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbad96-fda7-4b59-b924-ad32450042ce admin admin] PATH_INFO: `/v3/users/bcb57cc5164946a4b720b595ac04877e` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:43.391881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbad96-fda7-4b59-b924-ad32450042ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb57cc5164946a4b720b595ac04877e)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:43.393802 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbad96-fda7-4b59-b924-ad32450042ce admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:43.450923 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-71dbad96-fda7-4b59-b924-ad32450042ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb57cc5164946a4b720b595ac04877e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:43.460528 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-71dbad96-fda7-4b59-b924-ad32450042ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb57cc5164946a4b720b595ac04877e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:43.461441 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-71dbad96-fda7-4b59-b924-ad32450042ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb57cc5164946a4b720b595ac04877e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:43.462054 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-71dbad96-fda7-4b59-b924-ad32450042ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb57cc5164946a4b720b595ac04877e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:43.475445 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-71dbad96-fda7-4b59-b924-ad32450042ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb57cc5164946a4b720b595ac04877e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:43.489717 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1432/2870] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:43:43 2022] DELETE /identity/v3/users/bcb57cc5164946a4b720b595ac04877e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:43:43.496082 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc406d-3139-4db0-a820-2fee72135262 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:43.496377 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc406d-3139-4db0-a820-2fee72135262 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:43.496680 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc406d-3139-4db0-a820-2fee72135262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:43.523759 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-b2cc406d-3139-4db0-a820-2fee72135262 None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:43:43.524972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b2cc406d-3139-4db0-a820-2fee72135262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:43.583717 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1439/2871] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:43:43.593716 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbad96-fda7-4b59-b924-ad32450042ce admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:43.595409 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-71dbad96-fda7-4b59-b924-ad32450042ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:43.659680 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbad96-fda7-4b59-b924-ad32450042ce admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:43.663920 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdd590-1ff0-4700-9e2c-c914582250ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:43.664522 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdd590-1ff0-4700-9e2c-c914582250ef service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:43.664797 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdd590-1ff0-4700-9e2c-c914582250ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:43.665021 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdd590-1ff0-4700-9e2c-c914582250ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:43.676086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdd590-1ff0-4700-9e2c-c914582250ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:43.677535 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdd590-1ff0-4700-9e2c-c914582250ef service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:43.687346 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1433/2872] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:43:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:43:43.975370 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc406d-3139-4db0-a820-2fee72135262 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:43.977387 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-b2cc406d-3139-4db0-a820-2fee72135262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:43.991829 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc406d-3139-4db0-a820-2fee72135262 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:43.999558 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:44.000649 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:44.001098 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:44.001482 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c admin admin] PATH_INFO: `/v3/projects/36d930465f204293ae6d69c0291f784c` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:44.003153 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d930465f204293ae6d69c0291f784c)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:44.005508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:44.064251 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d930465f204293ae6d69c0291f784c', 'request_id': 'req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:44.070647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d930465f204293ae6d69c0291f784c', 'request_id': 'req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:44.080227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d930465f204293ae6d69c0291f784c', 'request_id': 'req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:44.092221 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c admin admin] The token cache is being invalidate because project 36d930465f204293ae6d69c0291f784c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:43:44.092461 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:44.093062 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-e09f7c7e-c0b6-428d-83bd-8cd6c4fd836c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:43:44.094555 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1440/2873] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:43:43 2022] DELETE /identity/v3/projects/36d930465f204293ae6d69c0291f784c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:43:44.102608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87788b-b6d0-4d11-8d39-9a48ae8fc41a None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:44.103176 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87788b-b6d0-4d11-8d39-9a48ae8fc41a None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:44.103278 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87788b-b6d0-4d11-8d39-9a48ae8fc41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:44.130477 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-6b87788b-b6d0-4d11-8d39-9a48ae8fc41a None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:43:44.131776 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-6b87788b-b6d0-4d11-8d39-9a48ae8fc41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:44.149831 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:44.202493 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1434/2874] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:43:44.211369 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57d780-e20e-4066-ab0c-a069ae09cc7b None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:44.211621 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57d780-e20e-4066-ab0c-a069ae09cc7b None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:44.211906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57d780-e20e-4066-ab0c-a069ae09cc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:44.234014 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-0e57d780-e20e-4066-ab0c-a069ae09cc7b None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:43:44.235257 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-0e57d780-e20e-4066-ab0c-a069ae09cc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:44.243815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1441/2875] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:43:44.249592 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87788b-b6d0-4d11-8d39-9a48ae8fc41a None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:44.265423 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87788b-b6d0-4d11-8d39-9a48ae8fc41a None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:44.273745 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc600f21-6d26-4c73-82fa-1670b75785ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:44.274355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc600f21-6d26-4c73-82fa-1670b75785ed admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:44.274634 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc600f21-6d26-4c73-82fa-1670b75785ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:44.274983 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc600f21-6d26-4c73-82fa-1670b75785ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:44.275646 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc600f21-6d26-4c73-82fa-1670b75785ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:43:44.275990 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc600f21-6d26-4c73-82fa-1670b75785ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:44.277647 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc600f21-6d26-4c73-82fa-1670b75785ed admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:44.291086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1435/2876] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Aug 9 11:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:43:44.296448 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57d780-e20e-4066-ab0c-a069ae09cc7b None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:44.308061 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57d780-e20e-4066-ab0c-a069ae09cc7b None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:44.313582 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fc8d3-fccc-4f4c-8751-af01563ff861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:44.314181 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fc8d3-fccc-4f4c-8751-af01563ff861 admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:44.314458 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fc8d3-fccc-4f4c-8751-af01563ff861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:44.314727 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fc8d3-fccc-4f4c-8751-af01563ff861 admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:44.315460 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fc8d3-fccc-4f4c-8751-af01563ff861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:44.317407 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fc8d3-fccc-4f4c-8751-af01563ff861 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:44.349917 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1442/2877] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:43:44 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:43:44.354449 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc600f21-6d26-4c73-82fa-1670b75785ed admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:44.366258 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc600f21-6d26-4c73-82fa-1670b75785ed admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:44.426415 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dc12a-1d63-4b28-9fc8-fbeda1e4d7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:44.427052 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dc12a-1d63-4b28-9fc8-fbeda1e4d7ec admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:44.427332 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dc12a-1d63-4b28-9fc8-fbeda1e4d7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:44.427602 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dc12a-1d63-4b28-9fc8-fbeda1e4d7ec admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:44.428279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dc12a-1d63-4b28-9fc8-fbeda1e4d7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:44.430207 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dc12a-1d63-4b28-9fc8-fbeda1e4d7ec admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:44.457525 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1436/2878] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:43:44 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:43:44.458734 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fc8d3-fccc-4f4c-8751-af01563ff861 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:44.470877 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fc8d3-fccc-4f4c-8751-af01563ff861 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:44.475809 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fd2e8-4941-4bf0-8163-3b28baf72f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:44.476383 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fd2e8-4941-4bf0-8163-3b28baf72f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:44.476650 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fd2e8-4941-4bf0-8163-3b28baf72f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:44.476911 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fd2e8-4941-4bf0-8163-3b28baf72f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:44.477549 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fd2e8-4941-4bf0-8163-3b28baf72f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:44.479190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fd2e8-4941-4bf0-8163-3b28baf72f3a admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:44.489559 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1443/2879] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:43:44.494393 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dc12a-1d63-4b28-9fc8-fbeda1e4d7ec admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:44.504675 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dc12a-1d63-4b28-9fc8-fbeda1e4d7ec admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:44.509588 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83b6ad-4fba-4a4d-8174-76c8bee392db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:44.510176 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b6ad-4fba-4a4d-8174-76c8bee392db admin admin] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:44.510418 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b6ad-4fba-4a4d-8174-76c8bee392db admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:44.510685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b6ad-4fba-4a4d-8174-76c8bee392db admin admin] PATH_INFO: `/v3/roles` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:44.511355 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83b6ad-4fba-4a4d-8174-76c8bee392db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:44.512939 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83b6ad-4fba-4a4d-8174-76c8bee392db admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:44.523806 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1437/2880] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:43:44.527959 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fd2e8-4941-4bf0-8163-3b28baf72f3a admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:44.538112 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fd2e8-4941-4bf0-8163-3b28baf72f3a admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:44.543135 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2d646-3113-40a3-8c8f-5de376b12e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:44.543783 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2d646-3113-40a3-8c8f-5de376b12e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:44.544060 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2d646-3113-40a3-8c8f-5de376b12e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:44.544327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2d646-3113-40a3-8c8f-5de376b12e09 admin admin] PATH_INFO: `/v3/projects/ef4b4745a37c42c7b0d60bd9c5f8c8fd/users/2e88ebde3f9b4f1fb4269e71152e99f7/roles/04b89a35fc5442af92047f11f75d7b14` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:44.560263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2d646-3113-40a3-8c8f-5de376b12e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4b4745a37c42c7b0d60bd9c5f8c8fd, user_id=2e88ebde3f9b4f1fb4269e71152e99f7, role_id=04b89a35fc5442af92047f11f75d7b14)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:44.562937 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2d646-3113-40a3-8c8f-5de376b12e09 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:44.578624 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1444/2881] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:43:44 2022] PUT /identity/v3/projects/ef4b4745a37c42c7b0d60bd9c5f8c8fd/users/2e88ebde3f9b4f1fb4269e71152e99f7/roles/04b89a35fc5442af92047f11f75d7b14 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:43:44.584758 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192e73a-ce5b-45ba-a947-57fd656a40ad None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:44.585137 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192e73a-ce5b-45ba-a947-57fd656a40ad None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:44.585524 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192e73a-ce5b-45ba-a947-57fd656a40ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:44.610073 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-f192e73a-ce5b-45ba-a947-57fd656a40ad None None] MFA Rules not processed for user `b49c0d97d3434e41bf484d267b0b8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:43:44.611231 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-f192e73a-ce5b-45ba-a947-57fd656a40ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:44.677955 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1438/2882] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:43:44.688868 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2d646-3113-40a3-8c8f-5de376b12e09 admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:44.691006 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-02e2d646-3113-40a3-8c8f-5de376b12e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:44.713878 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:44.753499 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2d646-3113-40a3-8c8f-5de376b12e09 admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:44.757714 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d3106-d617-4061-b06b-632d094700e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:44.758312 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d3106-d617-4061-b06b-632d094700e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:44.758583 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d3106-d617-4061-b06b-632d094700e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:44.758840 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d3106-d617-4061-b06b-632d094700e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:44.768132 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d3106-d617-4061-b06b-632d094700e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:44.769563 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d3106-d617-4061-b06b-632d094700e8 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:44.779120 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1445/2883] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:43:48.646703 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581f816-8679-4308-b91a-2b28be0676fa None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:48.647372 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581f816-8679-4308-b91a-2b28be0676fa None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:48.647372 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581f816-8679-4308-b91a-2b28be0676fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:48.677785 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-e581f816-8679-4308-b91a-2b28be0676fa None None] MFA Rules not processed for user `2e88ebde3f9b4f1fb4269e71152e99f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:43:48.679121 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e581f816-8679-4308-b91a-2b28be0676fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:48.698497 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:48.752490 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1439/2884] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:43:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:43:48.756987 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d3106-d617-4061-b06b-632d094700e8 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:48.767093 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d3106-d617-4061-b06b-632d094700e8 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:48.771900 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70c244-ede8-44c5-acaa-908c85131e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:48.772532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70c244-ede8-44c5-acaa-908c85131e0d admin admin] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:48.772711 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70c244-ede8-44c5-acaa-908c85131e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:48.772972 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70c244-ede8-44c5-acaa-908c85131e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:48.773603 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70c244-ede8-44c5-acaa-908c85131e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:48.775575 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70c244-ede8-44c5-acaa-908c85131e0d admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:48.806731 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1446/2885] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Aug 9 11:43:48 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:43:48.807824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581f816-8679-4308-b91a-2b28be0676fa None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:48.818844 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581f816-8679-4308-b91a-2b28be0676fa None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:48.876609 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9ba9f-555d-4b2a-82ef-14d25238686b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:48.877240 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9ba9f-555d-4b2a-82ef-14d25238686b admin admin] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:48.877513 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9ba9f-555d-4b2a-82ef-14d25238686b admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:48.877787 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9ba9f-555d-4b2a-82ef-14d25238686b admin admin] PATH_INFO: `/v3/users` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:48.878413 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9ba9f-555d-4b2a-82ef-14d25238686b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:48.880410 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9ba9f-555d-4b2a-82ef-14d25238686b admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:48.903389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1440/2886] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Aug 9 11:43:48 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:43:48.907218 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70c244-ede8-44c5-acaa-908c85131e0d admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:48.918233 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70c244-ede8-44c5-acaa-908c85131e0d admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:48.922967 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad6a5c-c559-4676-91c0-1ad68d0a709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:48.923551 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad6a5c-c559-4676-91c0-1ad68d0a709b admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:48.923825 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad6a5c-c559-4676-91c0-1ad68d0a709b admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:48.924095 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad6a5c-c559-4676-91c0-1ad68d0a709b admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:48.924743 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad6a5c-c559-4676-91c0-1ad68d0a709b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:48.926372 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad6a5c-c559-4676-91c0-1ad68d0a709b admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:48.938910 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1447/2887] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:43:48.943135 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9ba9f-555d-4b2a-82ef-14d25238686b admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:48.954059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9ba9f-555d-4b2a-82ef-14d25238686b admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:48.958861 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0060c2-5168-4ffe-ac25-9c01dd1939b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:48.959573 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0060c2-5168-4ffe-ac25-9c01dd1939b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:48.959843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0060c2-5168-4ffe-ac25-9c01dd1939b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:48.960110 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0060c2-5168-4ffe-ac25-9c01dd1939b3 admin admin] PATH_INFO: `/v3/projects/e5b323bde26e40eeb077baf422e0859d/users/37219be1cb344c5b86ec8ddb4ea65a0e/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:48.975730 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0060c2-5168-4ffe-ac25-9c01dd1939b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b323bde26e40eeb077baf422e0859d, user_id=37219be1cb344c5b86ec8ddb4ea65a0e, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:48.978358 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0060c2-5168-4ffe-ac25-9c01dd1939b3 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:48.992160 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1441/2888] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:43:48 2022] PUT /identity/v3/projects/e5b323bde26e40eeb077baf422e0859d/users/37219be1cb344c5b86ec8ddb4ea65a0e/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:43:48.996585 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad6a5c-c559-4676-91c0-1ad68d0a709b admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:49.006585 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad6a5c-c559-4676-91c0-1ad68d0a709b admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:49.063656 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131dca2-9cd2-4f0a-8ec6-b3b312a233e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:49.064165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131dca2-9cd2-4f0a-8ec6-b3b312a233e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:49.064441 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131dca2-9cd2-4f0a-8ec6-b3b312a233e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:49.064710 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131dca2-9cd2-4f0a-8ec6-b3b312a233e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:49.065346 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131dca2-9cd2-4f0a-8ec6-b3b312a233e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:49.066976 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131dca2-9cd2-4f0a-8ec6-b3b312a233e7 admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:49.076794 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1448/2889] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Aug 9 11:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:43:49.081420 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0060c2-5168-4ffe-ac25-9c01dd1939b3 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:49.092250 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0060c2-5168-4ffe-ac25-9c01dd1939b3 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:49.097451 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f16fc8-7d21-4e23-94e2-15cf4b217c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:49.098104 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f16fc8-7d21-4e23-94e2-15cf4b217c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:49.098407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f16fc8-7d21-4e23-94e2-15cf4b217c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:49.098676 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f16fc8-7d21-4e23-94e2-15cf4b217c05 admin admin] PATH_INFO: `/v3/projects/e5b323bde26e40eeb077baf422e0859d/users/37219be1cb344c5b86ec8ddb4ea65a0e/roles/169d11e171d04c87af71475295957618` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:49.100833 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f16fc8-7d21-4e23-94e2-15cf4b217c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b323bde26e40eeb077baf422e0859d, user_id=37219be1cb344c5b86ec8ddb4ea65a0e, role_id=169d11e171d04c87af71475295957618)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:49.103540 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f16fc8-7d21-4e23-94e2-15cf4b217c05 admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:49.114769 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1442/2890] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Aug 9 11:43:49 2022] PUT /identity/v3/projects/e5b323bde26e40eeb077baf422e0859d/users/37219be1cb344c5b86ec8ddb4ea65a0e/roles/169d11e171d04c87af71475295957618 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:43:53.881675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3f56-0935-4ff8-979b-12a59d671e12 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:53.882184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3f56-0935-4ff8-979b-12a59d671e12 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:53.882184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3f56-0935-4ff8-979b-12a59d671e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:53.918072 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-608a3f56-0935-4ff8-979b-12a59d671e12 None None] MFA Rules not processed for user `37219be1cb344c5b86ec8ddb4ea65a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:43:53.919303 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-608a3f56-0935-4ff8-979b-12a59d671e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:53.999600 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1449/2891] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:43:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:43:54.016601 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f16fc8-7d21-4e23-94e2-15cf4b217c05 admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:54.018421 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-72f16fc8-7d21-4e23-94e2-15cf4b217c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:54.103130 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f16fc8-7d21-4e23-94e2-15cf4b217c05 admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:54.109665 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a25fa-06c9-4a1a-baaf-7710f3e816a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:54.110294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a25fa-06c9-4a1a-baaf-7710f3e816a2 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:54.110569 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a25fa-06c9-4a1a-baaf-7710f3e816a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:54.110860 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a25fa-06c9-4a1a-baaf-7710f3e816a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:54.117282 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:54.185132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a25fa-06c9-4a1a-baaf-7710f3e816a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:54.186700 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a25fa-06c9-4a1a-baaf-7710f3e816a2 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:54.201569 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1443/2892] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:43:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:44:03.996330 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:44:04.193985 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=24 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:44:15.908627 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6c680-d8aa-43ac-8117-791f998e6997 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:44:15.909209 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6c680-d8aa-43ac-8117-791f998e6997 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:44:15.909209 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6c680-d8aa-43ac-8117-791f998e6997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:44:15.942469 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-36f6c680-d8aa-43ac-8117-791f998e6997 None None] MFA Rules not processed for user `2e88ebde3f9b4f1fb4269e71152e99f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:44:15.943764 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-36f6c680-d8aa-43ac-8117-791f998e6997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:44:15.972917 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1450/2893] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:44:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:44:16.308270 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a25fa-06c9-4a1a-baaf-7710f3e816a2 service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:44:16.309997 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-783a25fa-06c9-4a1a-baaf-7710f3e816a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:44:16.413164 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a25fa-06c9-4a1a-baaf-7710f3e816a2 service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:44:16.416998 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a939f08-966a-401b-9512-17a39068df74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:44:16.417603 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a939f08-966a-401b-9512-17a39068df74 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:44:16.417873 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a939f08-966a-401b-9512-17a39068df74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:44:16.418133 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a939f08-966a-401b-9512-17a39068df74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:44:16.419993 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-4a939f08-966a-401b-9512-17a39068df74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:44:16.429622 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a939f08-966a-401b-9512-17a39068df74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:44:16.431068 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a939f08-966a-401b-9512-17a39068df74 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:44:16.438887 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1444/2894] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:44:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:44:17.965647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6c680-d8aa-43ac-8117-791f998e6997 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:44:17.967227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-36f6c680-d8aa-43ac-8117-791f998e6997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:44:18.075003 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6c680-d8aa-43ac-8117-791f998e6997 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:44:18.082184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9053fcc-a91f-443b-a032-cd8f4c08d48c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:44:18.083056 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9053fcc-a91f-443b-a032-cd8f4c08d48c service placement] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:44:18.083291 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9053fcc-a91f-443b-a032-cd8f4c08d48c service placement] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:44:18.095794 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9053fcc-a91f-443b-a032-cd8f4c08d48c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:44:18.095794 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-e9053fcc-a91f-443b-a032-cd8f4c08d48c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:44:18.099744 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9053fcc-a91f-443b-a032-cd8f4c08d48c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:44:18.101504 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9053fcc-a91f-443b-a032-cd8f4c08d48c service placement] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:44:18.111647 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1451/2895] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:44:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:44:26.435369 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=44 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:44:28.107340 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=59 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:44:34.585697 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a939f08-966a-401b-9512-17a39068df74 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:44:34.624343 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a939f08-966a-401b-9512-17a39068df74 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:44:34.630778 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f68b21-f0bc-4e5b-b321-8b22608fc473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:44:34.631411 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f68b21-f0bc-4e5b-b321-8b22608fc473 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:44:34.631685 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f68b21-f0bc-4e5b-b321-8b22608fc473 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:44:34.631958 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f68b21-f0bc-4e5b-b321-8b22608fc473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:44:34.633815 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e9f68b21-f0bc-4e5b-b321-8b22608fc473 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:44:34.659737 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f68b21-f0bc-4e5b-b321-8b22608fc473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:44:34.660610 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f68b21-f0bc-4e5b-b321-8b22608fc473 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:44:34.671481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1445/2896] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:44:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:44:38.124945 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9053fcc-a91f-443b-a032-cd8f4c08d48c service placement] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:44:38.135140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9053fcc-a91f-443b-a032-cd8f4c08d48c service placement] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:44:38.139101 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc144401-d6c4-40cd-9af4-823958db51b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:44:38.139688 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc144401-d6c4-40cd-9af4-823958db51b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:44:38.139961 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc144401-d6c4-40cd-9af4-823958db51b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:44:38.140222 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc144401-d6c4-40cd-9af4-823958db51b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:44:38.149784 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc144401-d6c4-40cd-9af4-823958db51b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:44:38.151252 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc144401-d6c4-40cd-9af4-823958db51b2 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:44:38.162729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1452/2897] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:44:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:44:39.848940 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f68b21-f0bc-4e5b-b321-8b22608fc473 service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:44:39.860584 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f68b21-f0bc-4e5b-b321-8b22608fc473 service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:44:39.866754 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd66c0a-ec67-4d99-af8b-0085ab53559d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:44:39.867442 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd66c0a-ec67-4d99-af8b-0085ab53559d service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:44:39.867855 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd66c0a-ec67-4d99-af8b-0085ab53559d service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:44:39.868132 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd66c0a-ec67-4d99-af8b-0085ab53559d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:44:39.869944 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-1fd66c0a-ec67-4d99-af8b-0085ab53559d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:44:39.883005 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd66c0a-ec67-4d99-af8b-0085ab53559d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:44:39.884824 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd66c0a-ec67-4d99-af8b-0085ab53559d service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:44:39.895904 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1446/2898] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:44:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:44:48.156496 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=6 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:44:49.891479 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=24 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:45:08.445208 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc144401-d6c4-40cd-9af4-823958db51b2 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:45:08.457546 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc144401-d6c4-40cd-9af4-823958db51b2 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:45:08.463906 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287cf1d-85d1-4ff0-b935-ae1f03b03ebf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:45:08.464492 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287cf1d-85d1-4ff0-b935-ae1f03b03ebf service placement] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:45:08.464769 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287cf1d-85d1-4ff0-b935-ae1f03b03ebf service placement] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:45:08.465036 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287cf1d-85d1-4ff0-b935-ae1f03b03ebf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:45:08.467128 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-3287cf1d-85d1-4ff0-b935-ae1f03b03ebf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:45:08.480144 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287cf1d-85d1-4ff0-b935-ae1f03b03ebf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:45:08.481873 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287cf1d-85d1-4ff0-b935-ae1f03b03ebf service placement] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:45:08.492998 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1453/2899] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:45:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:45:18.488506 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=6 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:46:54.988049 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd66c0a-ec67-4d99-af8b-0085ab53559d service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:46:54.998080 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd66c0a-ec67-4d99-af8b-0085ab53559d service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:46:55.002329 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128f716-7de2-476a-aefd-121b2dce6769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:46:55.002944 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128f716-7de2-476a-aefd-121b2dce6769 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:46:55.003214 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128f716-7de2-476a-aefd-121b2dce6769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:46:55.003475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128f716-7de2-476a-aefd-121b2dce6769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:46:55.005389 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-d128f716-7de2-476a-aefd-121b2dce6769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:46:55.018808 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128f716-7de2-476a-aefd-121b2dce6769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:46:55.020233 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128f716-7de2-476a-aefd-121b2dce6769 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:46:55.031369 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1447/2900] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:46:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:46:56.483542 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287cf1d-85d1-4ff0-b935-ae1f03b03ebf service placement] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:46:56.496606 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287cf1d-85d1-4ff0-b935-ae1f03b03ebf service placement] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:46:56.500534 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880dbfe-fd24-47b4-97f9-412f0e76860d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:46:56.501151 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880dbfe-fd24-47b4-97f9-412f0e76860d service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:46:56.501421 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880dbfe-fd24-47b4-97f9-412f0e76860d service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:46:56.501684 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880dbfe-fd24-47b4-97f9-412f0e76860d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:46:56.503441 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-6880dbfe-fd24-47b4-97f9-412f0e76860d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:46:56.517063 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880dbfe-fd24-47b4-97f9-412f0e76860d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:46:56.518497 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880dbfe-fd24-47b4-97f9-412f0e76860d service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:46:56.529477 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1454/2901] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:46:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:46:58.823937 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c0c2-c76a-44da-bcf4-5847e1a876ab None None] REQUEST_METHOD: `POST` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:46:58.824448 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c0c2-c76a-44da-bcf4-5847e1a876ab None None] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:46:58.824564 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c0c2-c76a-44da-bcf4-5847e1a876ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:46:58.845611 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.auth.core [None req-e152c0c2-c76a-44da-bcf4-5847e1a876ab None None] MFA Rules not processed for user `2e88ebde3f9b4f1fb4269e71152e99f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:46:58.846843 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e152c0c2-c76a-44da-bcf4-5847e1a876ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:46:58.855162 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1448/2902] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:46:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:47:06.524686 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=6 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:47:08.840835 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=9 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:47:13.532140 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880dbfe-fd24-47b4-97f9-412f0e76860d service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:47:13.541552 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880dbfe-fd24-47b4-97f9-412f0e76860d service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:47:13.546130 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3a0a9-f7af-46d3-863e-68cb06172fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:47:13.546722 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3a0a9-f7af-46d3-863e-68cb06172fdc service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:47:13.547053 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3a0a9-f7af-46d3-863e-68cb06172fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:47:13.547319 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3a0a9-f7af-46d3-863e-68cb06172fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:47:13.549309 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-27a3a0a9-f7af-46d3-863e-68cb06172fdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:47:13.560380 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3a0a9-f7af-46d3-863e-68cb06172fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:47:13.561849 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3a0a9-f7af-46d3-863e-68cb06172fdc service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:47:13.571068 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1455/2903] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:47:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:47:23.566629 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=6 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:49:08.823126 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152c0c2-c76a-44da-bcf4-5847e1a876ab None None] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:49:08.825722 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-e152c0c2-c76a-44da-bcf4-5847e1a876ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:49:08.913536 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152c0c2-c76a-44da-bcf4-5847e1a876ab None None] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:49:08.917580 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadf68d-d3da-416b-93ea-54f5c6f1932f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8bcbc6393d341a7be009f3b8c329e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:49:08.918175 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf68d-d3da-416b-93ea-54f5c6f1932f service cinder] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:49:08.918450 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf68d-d3da-416b-93ea-54f5c6f1932f service cinder] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:49:08.918721 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf68d-d3da-416b-93ea-54f5c6f1932f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:49:08.927668 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadf68d-d3da-416b-93ea-54f5c6f1932f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:49:08.929085 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadf68d-d3da-416b-93ea-54f5c6f1932f service cinder] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:49:08.938321 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1449/2904] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:49:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:49:18.934059 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=35 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:49:19.016699 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d39f8-d55b-49c9-b6d9-9cf0c75a4776 None None] REQUEST_METHOD: `POST` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:49:19.017240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d39f8-d55b-49c9-b6d9-9cf0c75a4776 None None] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:49:19.017240 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d39f8-d55b-49c9-b6d9-9cf0c75a4776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:49:19.037058 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.auth.core [None req-c89d39f8-d55b-49c9-b6d9-9cf0c75a4776 None None] MFA Rules not processed for user `2e88ebde3f9b4f1fb4269e71152e99f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:49:19.038201 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c89d39f8-d55b-49c9-b6d9-9cf0c75a4776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:49:19.046223 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1456/2905] 10.222.0.59 () {58 vars in 958 bytes} [Tue Aug 9 11:49:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:49:19.368099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadf68d-d3da-416b-93ea-54f5c6f1932f service cinder] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:49:19.377945 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadf68d-d3da-416b-93ea-54f5c6f1932f service cinder] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:49:19.382447 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730980b4-70bb-472f-9059-da2f730356e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:49:19.383065 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730980b4-70bb-472f-9059-da2f730356e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:49:19.383361 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730980b4-70bb-472f-9059-da2f730356e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:49:19.383628 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730980b4-70bb-472f-9059-da2f730356e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:49:19.391086 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730980b4-70bb-472f-9059-da2f730356e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:49:19.392500 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730980b4-70bb-472f-9059-da2f730356e5 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:49:19.400618 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1450/2906] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:49:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:49:20.875804 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d39f8-d55b-49c9-b6d9-9cf0c75a4776 None None] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:49:20.889016 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d39f8-d55b-49c9-b6d9-9cf0c75a4776 None None] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:49:20.895295 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe7798-d7a2-4892-b525-debc2470307a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:49:20.895887 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe7798-d7a2-4892-b525-debc2470307a service placement] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:49:20.896160 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe7798-d7a2-4892-b525-debc2470307a service placement] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:49:20.896429 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe7798-d7a2-4892-b525-debc2470307a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:49:20.905219 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe7798-d7a2-4892-b525-debc2470307a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:49:20.906788 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe7798-d7a2-4892-b525-debc2470307a service placement] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:49:20.916791 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1457/2907] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:49:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:49:26.349287 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730980b4-70bb-472f-9059-da2f730356e5 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:49:26.364848 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730980b4-70bb-472f-9059-da2f730356e5 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:49:26.371037 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d4898-cd6c-4fed-b5cb-4c4cbf590875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:49:26.371643 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4898-cd6c-4fed-b5cb-4c4cbf590875 service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:49:26.371943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4898-cd6c-4fed-b5cb-4c4cbf590875 service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:49:26.372173 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4898-cd6c-4fed-b5cb-4c4cbf590875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:49:26.373918 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-929d4898-cd6c-4fed-b5cb-4c4cbf590875 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:49:26.386547 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d4898-cd6c-4fed-b5cb-4c4cbf590875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:49:26.388187 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d4898-cd6c-4fed-b5cb-4c4cbf590875 service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:49:26.399911 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1451/2908] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:49:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:49:30.912756 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=9 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:49:36.395003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=12 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:49:38.100279 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe7798-d7a2-4892-b525-debc2470307a service placement] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:49:38.101815 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-7bbe7798-d7a2-4892-b525-debc2470307a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:49:38.119145 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe7798-d7a2-4892-b525-debc2470307a service placement] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:49:38.124648 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f31e0-6bdb-467e-b27f-5eebd2d409a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:49:38.125190 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f31e0-6bdb-467e-b27f-5eebd2d409a1 service nova] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:49:38.125463 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f31e0-6bdb-467e-b27f-5eebd2d409a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:49:38.125729 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f31e0-6bdb-467e-b27f-5eebd2d409a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:49:38.135329 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f31e0-6bdb-467e-b27f-5eebd2d409a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:49:38.136965 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f31e0-6bdb-467e-b27f-5eebd2d409a1 service nova] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:49:38.148441 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1458/2909] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:49:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:49:42.185152 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d4898-cd6c-4fed-b5cb-4c4cbf590875 service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:49:42.197279 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d4898-cd6c-4fed-b5cb-4c4cbf590875 service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:49:42.201082 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c4b05-15d9-49cc-a0ee-548c9778e10a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:49:42.201704 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4b05-15d9-49cc-a0ee-548c9778e10a service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:49:42.201973 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4b05-15d9-49cc-a0ee-548c9778e10a service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:49:42.202237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4b05-15d9-49cc-a0ee-548c9778e10a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:49:42.211237 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c4b05-15d9-49cc-a0ee-548c9778e10a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:49:42.212656 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c4b05-15d9-49cc-a0ee-548c9778e10a service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:49:42.221845 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1452/2910] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:49:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:49:48.143188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=6 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:49:52.217815 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=6 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:50:13.433773 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f31e0-6bdb-467e-b27f-5eebd2d409a1 service nova] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:50:13.445567 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f31e0-6bdb-467e-b27f-5eebd2d409a1 service nova] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:50:13.451827 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abf0b6-ef26-4c7a-9447-5c0acdf37158 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:50:13.452408 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf0b6-ef26-4c7a-9447-5c0acdf37158 service placement] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:50:13.452678 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf0b6-ef26-4c7a-9447-5c0acdf37158 service placement] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:50:13.452941 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf0b6-ef26-4c7a-9447-5c0acdf37158 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:50:13.462596 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abf0b6-ef26-4c7a-9447-5c0acdf37158 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:50:13.464210 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abf0b6-ef26-4c7a-9447-5c0acdf37158 service placement] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:50:13.474103 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1459/2911] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:50:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:50:23.470188 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=6 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:51:49.505202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c4b05-15d9-49cc-a0ee-548c9778e10a service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:51:49.520089 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c4b05-15d9-49cc-a0ee-548c9778e10a service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:51:49.527038 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2af9c0-ad7b-4caf-9aff-6ca798d5e3ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2136cf1160a64951ad780424cb28403b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:51:49.527655 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2af9c0-ad7b-4caf-9aff-6ca798d5e3ef service nova] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:51:49.527934 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2af9c0-ad7b-4caf-9aff-6ca798d5e3ef service nova] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:51:49.528202 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2af9c0-ad7b-4caf-9aff-6ca798d5e3ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:51:49.539196 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2af9c0-ad7b-4caf-9aff-6ca798d5e3ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:51:49.540724 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2af9c0-ad7b-4caf-9aff-6ca798d5e3ef service nova] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:51:49.553625 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1453/2912] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:51:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:51:56.629580 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abf0b6-ef26-4c7a-9447-5c0acdf37158 service placement] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:51:56.639675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abf0b6-ef26-4c7a-9447-5c0acdf37158 service placement] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:51:56.644327 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca899ec-9174-485c-a994-1ff51fd1b212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:51:56.644923 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca899ec-9174-485c-a994-1ff51fd1b212 service neutron] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:51:56.645163 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca899ec-9174-485c-a994-1ff51fd1b212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:51:56.645426 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca899ec-9174-485c-a994-1ff51fd1b212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:51:56.656165 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca899ec-9174-485c-a994-1ff51fd1b212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:51:56.657675 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca899ec-9174-485c-a994-1ff51fd1b212 service neutron] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:51:56.668687 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1460/2913] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:51:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:51:59.547088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=6 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:52:00.680608 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2af9c0-ad7b-4caf-9aff-6ca798d5e3ef service nova] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:52:00.690795 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2af9c0-ad7b-4caf-9aff-6ca798d5e3ef service nova] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:52:00.695481 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd9cba-ab25-46ef-849b-831de4f934a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54cdc076295642bf945fe63a972b8aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:52:00.696070 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd9cba-ab25-46ef-849b-831de4f934a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:52:00.696347 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd9cba-ab25-46ef-849b-831de4f934a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:52:00.696611 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd9cba-ab25-46ef-849b-831de4f934a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:52:00.767540 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd9cba-ab25-46ef-849b-831de4f934a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:52:00.768966 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd9cba-ab25-46ef-849b-831de4f934a7 service neutron] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:52:00.788177 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1454/2914] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:52:03.860826 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca899ec-9174-485c-a994-1ff51fd1b212 service neutron] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:52:03.873212 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca899ec-9174-485c-a994-1ff51fd1b212 service neutron] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:52:03.878314 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9c324-bde6-4f62-8308-6bec4e0d85cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:52:03.878922 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9c324-bde6-4f62-8308-6bec4e0d85cf service placement] REQUEST_METHOD: `GET` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:52:03.879228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9c324-bde6-4f62-8308-6bec4e0d85cf service placement] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:52:03.879535 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9c324-bde6-4f62-8308-6bec4e0d85cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:52:03.881233 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-c6e9c324-bde6-4f62-8308-6bec4e0d85cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:52:03.894198 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9c324-bde6-4f62-8308-6bec4e0d85cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:52:03.895930 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9c324-bde6-4f62-8308-6bec4e0d85cf service placement] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:52:03.914870 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1461/2915] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:52:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:52:06.805281 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd9cba-ab25-46ef-849b-831de4f934a7 service neutron] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:52:06.815328 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd9cba-ab25-46ef-849b-831de4f934a7 service neutron] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:52:06.820438 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd36996-839a-4721-bf4a-162469b96a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:52:06.821186 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd36996-839a-4721-bf4a-162469b96a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:52:06.821527 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd36996-839a-4721-bf4a-162469b96a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:52:06.821910 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd36996-839a-4721-bf4a-162469b96a3a admin admin] PATH_INFO: `/v3/users/2e88ebde3f9b4f1fb4269e71152e99f7` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:52:06.823177 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd36996-839a-4721-bf4a-162469b96a3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e88ebde3f9b4f1fb4269e71152e99f7)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:52:06.825094 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd36996-839a-4721-bf4a-162469b96a3a admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:52:06.874410 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-5bd36996-839a-4721-bf4a-162469b96a3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e88ebde3f9b4f1fb4269e71152e99f7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:06.883088 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-5bd36996-839a-4721-bf4a-162469b96a3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e88ebde3f9b4f1fb4269e71152e99f7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:06.883691 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-5bd36996-839a-4721-bf4a-162469b96a3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e88ebde3f9b4f1fb4269e71152e99f7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:06.884285 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-5bd36996-839a-4721-bf4a-162469b96a3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e88ebde3f9b4f1fb4269e71152e99f7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:06.896475 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-5bd36996-839a-4721-bf4a-162469b96a3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e88ebde3f9b4f1fb4269e71152e99f7'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:06.908835 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1455/2916] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:52:06 2022] DELETE /identity/v3/users/2e88ebde3f9b4f1fb4269e71152e99f7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:52:07.095316 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9c324-bde6-4f62-8308-6bec4e0d85cf service placement] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:52:07.112679 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9c324-bde6-4f62-8308-6bec4e0d85cf service placement] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:52:07.169864 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:52:07.170513 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:52:07.170788 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:52:07.171105 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] PATH_INFO: `/v3/projects/ef4b4745a37c42c7b0d60bd9c5f8c8fd` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:52:07.172263 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4b4745a37c42c7b0d60bd9c5f8c8fd)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:52:07.174170 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:52:07.223963 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'request_id': 'req-4945dae8-273c-433c-9334-241a9081da6c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.230184 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'request_id': 'req-4945dae8-273c-433c-9334-241a9081da6c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.238885 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'request_id': 'req-4945dae8-273c-433c-9334-241a9081da6c'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.261227 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] The token cache is being invalidate because project ef4b4745a37c42c7b0d60bd9c5f8c8fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:52:07.261508 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.262228 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.263718 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1462/2917] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:52:07 2022] DELETE /identity/v3/projects/ef4b4745a37c42c7b0d60bd9c5f8c8fd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:52:07.267881 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd36996-839a-4721-bf4a-162469b96a3a admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:52:07.269390 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-5bd36996-839a-4721-bf4a-162469b96a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:52:07.282951 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd36996-839a-4721-bf4a-162469b96a3a admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:52:07.328003 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:52:07.341366 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be216f94-d53f-4d86-8fa5-e700ec59906c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:52:07.342001 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be216f94-d53f-4d86-8fa5-e700ec59906c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:52:07.342276 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be216f94-d53f-4d86-8fa5-e700ec59906c admin admin] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:52:07.342542 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be216f94-d53f-4d86-8fa5-e700ec59906c admin admin] PATH_INFO: `/v3/users/37219be1cb344c5b86ec8ddb4ea65a0e` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:52:07.343738 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be216f94-d53f-4d86-8fa5-e700ec59906c admin admin] RBAC: Authorizing `identity:delete_user(user_id=37219be1cb344c5b86ec8ddb4ea65a0e)` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:52:07.345796 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be216f94-d53f-4d86-8fa5-e700ec59906c admin admin] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:52:07.397034 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-be216f94-d53f-4d86-8fa5-e700ec59906c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37219be1cb344c5b86ec8ddb4ea65a0e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.405195 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-be216f94-d53f-4d86-8fa5-e700ec59906c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37219be1cb344c5b86ec8ddb4ea65a0e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.405837 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-be216f94-d53f-4d86-8fa5-e700ec59906c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37219be1cb344c5b86ec8ddb4ea65a0e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.406449 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-be216f94-d53f-4d86-8fa5-e700ec59906c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37219be1cb344c5b86ec8ddb4ea65a0e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.418943 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.notifications [None req-be216f94-d53f-4d86-8fa5-e700ec59906c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37219be1cb344c5b86ec8ddb4ea65a0e'} {{(pid=80054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.431407 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1456/2918] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Aug 9 11:52:07 2022] DELETE /identity/v3/users/37219be1cb344c5b86ec8ddb4ea65a0e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:52:07.621890 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] Authenticating user token {{(pid=80055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:52:07.623394 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.fernet_utils [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:52:07.636080 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945dae8-273c-433c-9334-241a9081da6c admin admin] Validating token access rules against request {{(pid=80055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:52:07.684306 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:52:07.696532 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b49c0d97d3434e41bf484d267b0b8e0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f8f671817444c358cd7614c06a172b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:52:07.697191 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:52:07.697483 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:52:07.698043 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb admin admin] PATH_INFO: `/v3/projects/e5b323bde26e40eeb077baf422e0859d` {{(pid=80055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:52:07.699360 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b323bde26e40eeb077baf422e0859d)` {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:52:07.701607 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb admin admin] RBAC: Authorization granted {{(pid=80055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:52:07.752444 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b323bde26e40eeb077baf422e0859d', 'request_id': 'req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.759164 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b323bde26e40eeb077baf422e0859d', 'request_id': 'req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.768602 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b323bde26e40eeb077baf422e0859d', 'request_id': 'req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb'} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.780088 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb admin admin] The token cache is being invalidate because project e5b323bde26e40eeb077baf422e0859d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:52:07.780321 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.781023 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG keystone.notifications [None req-7e7593e1-108c-4eaa-a55d-e9ee0fdd38fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:52:07.782643 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: [pid: 80055|app: 0|req: 1463/2919] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Aug 9 11:52:07 2022] DELETE /identity/v3/projects/e5b323bde26e40eeb077baf422e0859d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:52:17.427889 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:52:17.777194 dv-cinder-849890-5-iscsi devstack@keystone.service[80055]: DEBUG dbcounter [-] [80055] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:55:19.391658 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be216f94-d53f-4d86-8fa5-e700ec59906c admin admin] Authenticating user token {{(pid=80054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:55:19.393217 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-be216f94-d53f-4d86-8fa5-e700ec59906c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:55:19.537181 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be216f94-d53f-4d86-8fa5-e700ec59906c admin admin] Validating token access rules against request {{(pid=80054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:55:19.597281 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37f8e7-b268-485d-ba50-24a076b23c10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04b584a68cb488492046faa23e15463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53fb3d6b68b4654ae7247c9b74015e7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:55:19.597877 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37f8e7-b268-485d-ba50-24a076b23c10 service placement] REQUEST_METHOD: `GET` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:55:19.598154 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37f8e7-b268-485d-ba50-24a076b23c10 service placement] SCRIPT_NAME: `/identity` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:55:19.598419 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37f8e7-b268-485d-ba50-24a076b23c10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:55:19.600508 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.fernet_utils [None req-7b37f8e7-b268-485d-ba50-24a076b23c10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:55:19.612099 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37f8e7-b268-485d-ba50-24a076b23c10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:55:19.613677 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37f8e7-b268-485d-ba50-24a076b23c10 service placement] RBAC: Authorization granted {{(pid=80054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:55:19.623620 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: [pid: 80054|app: 0|req: 1457/2920] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Aug 9 11:55:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:55:29.619294 dv-cinder-849890-5-iscsi devstack@keystone.service[80054]: DEBUG dbcounter [-] [80054] Writing DB stats keystone:SELECT=89 {{(pid=80054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}